Nov 17 02:55:09 user nova-compute[74898]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74898) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 17 02:55:09 user nova-compute[74898]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74898) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 17 02:55:09 user nova-compute[74898]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74898) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 17 02:55:09 user nova-compute[74898]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 17 02:55:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:55:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:55:09 user nova-compute[74898]: INFO nova.virt.driver [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 17 02:55:10 user nova-compute[74898]: INFO nova.compute.provider_config [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] Acquiring lock "singleton_lock" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] Acquired lock "singleton_lock" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] Releasing lock "singleton_lock" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] Full set of CONF: {{(pid=74898) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ******************************************************************************** {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] Configuration options gathered from: {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ================================================================================ {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] allow_resize_to_same_host      = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] arq_binding_timeout            = 300 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] backdoor_port                  = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] backdoor_socket                = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] block_device_allocate_retries  = 300 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] block_device_allocate_retries_interval = 5 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cert                           = self.pem {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] compute_monitors               = [] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] config_dir                     = [] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] config_drive_format            = iso9660 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] config_source                  = [] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] console_host                   = user {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] control_exchange               = nova {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cpu_allocation_ratio           = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] daemon                         = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] debug                          = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] default_access_ip_network_name = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] default_availability_zone      = nova {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] default_ephemeral_format       = ext4 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] default_green_pool_size        = 1000 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] default_schedule_zone          = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] disk_allocation_ratio          = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] enable_new_services            = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] enabled_ssl_apis               = [] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] flat_injected                  = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] force_config_drive             = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] force_raw_images               = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] graceful_shutdown_timeout      = 5 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] heal_instance_info_cache_interval = 60 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] host                           = user {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] instance_build_timeout         = 0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] instance_delete_interval       = 300 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] instance_name_template         = instance-%08x {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] instance_usage_audit           = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] instance_usage_audit_period    = month {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] internal_service_availability_zone = internal {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] key                            = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] live_migration_retry_count     = 30 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] log_config_append              = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] log_dir                        = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] log_file                       = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] log_options                    = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] log_rotate_interval            = 1 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] log_rotate_interval_type       = days {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] log_rotation_type              = none {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] long_rpc_timeout               = 1800 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] max_concurrent_builds          = 10 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] max_concurrent_live_migrations = 1 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] max_concurrent_snapshots       = 5 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] max_local_block_devices        = 3 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] max_logfile_count              = 30 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] max_logfile_size_mb            = 200 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] maximum_instance_delete_attempts = 5 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] metadata_listen                = 0.0.0.0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] metadata_listen_port           = 8775 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] metadata_workers               = 3 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] migrate_max_retries            = -1 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] mkisofs_cmd                    = genisoimage {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] my_ip                          = 10.0.0.210 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] network_allocate_retries       = 0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] osapi_compute_listen_port      = 8774 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] osapi_compute_unique_server_name_scope =  {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] osapi_compute_workers          = 3 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] password_length                = 12 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] periodic_enable                = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] periodic_fuzzy_delay           = 60 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] pointer_model                  = ps2mouse {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] preallocate_images             = none {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] publish_errors                 = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] pybasedir                      = /opt/stack/nova {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ram_allocation_ratio           = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] rate_limit_burst               = 0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] rate_limit_except_level        = CRITICAL {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] rate_limit_interval            = 0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] reboot_timeout                 = 0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] reclaim_instance_interval      = 0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] record                         = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] reimage_timeout_per_gb         = 60 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] report_interval                = 120 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] rescue_timeout                 = 0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] reserved_host_cpus             = 0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] reserved_host_disk_mb          = 0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] reserved_host_memory_mb        = 512 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] reserved_huge_pages            = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] resize_confirm_window          = 0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] resize_fs_using_block_device   = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] resume_guests_state_on_host_boot = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] rpc_response_timeout           = 60 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] run_external_periodic_tasks    = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] running_deleted_instance_action = reap {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] running_deleted_instance_timeout = 0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] scheduler_instance_sync_interval = 120 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] service_down_time              = 720 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] servicegroup_driver            = db {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] shelved_offload_time           = 0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] shelved_poll_interval          = 3600 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] shutdown_timeout               = 0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] source_is_ipv6                 = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ssl_only                       = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] state_path                     = /opt/stack/data/nova {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] sync_power_state_interval      = 600 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] sync_power_state_pool_size     = 1000 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] syslog_log_facility            = LOG_USER {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] tempdir                        = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] timeout_nbd                    = 10 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] transport_url                  = **** {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] update_resources_interval      = 0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] use_cow_images                 = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] use_eventlog                   = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] use_journal                    = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] use_json                       = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] use_rootwrap_daemon            = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] use_stderr                     = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] use_syslog                     = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vcpu_pin_set                   = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vif_plugging_is_fatal          = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vif_plugging_timeout           = 0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] virt_mkfs                      = [] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] volume_usage_poll_interval     = 0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] watch_log_file                 = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] web                            = /usr/share/spice-html5 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_concurrency.disable_process_locking = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api.auth_strategy              = keystone {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api.compute_link_prefix        = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api.dhcp_domain                = novalocal {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api.enable_instance_password   = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api.glance_link_prefix         = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api.instance_list_per_project_cells = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api.list_records_by_skipping_down_cells = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api.local_metadata_per_cell    = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api.max_limit                  = 1000 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api.metadata_cache_expiration  = 15 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api.neutron_default_tenant_id  = default {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api.use_forwarded_for          = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api.use_neutron_default_nets   = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api.vendordata_dynamic_targets = [] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api.vendordata_jsonfile_path   = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.backend_argument         = **** {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.config_prefix            = cache.oslo {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.dead_timeout             = 60.0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.debug_cache_backend      = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.enable_retry_client      = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.enable_socket_keepalive  = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.enabled                  = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.expiration_time          = 600 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.hashclient_retry_attempts = 2 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.memcache_dead_retry      = 300 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.memcache_password        =  {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.memcache_sasl_enabled    = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.memcache_username        =  {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.proxies                  = [] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.retry_attempts           = 2 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.retry_delay              = 0.0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.socket_keepalive_count   = 1 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.socket_keepalive_idle    = 1 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.socket_keepalive_interval = 1 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.tls_allowed_ciphers      = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.tls_cafile               = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.tls_certfile             = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.tls_enabled              = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cache.tls_keyfile              = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cinder.auth_section            = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cinder.auth_type               = password {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cinder.cafile                  = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cinder.certfile                = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cinder.collect_timing          = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cinder.cross_az_attach         = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cinder.debug                   = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cinder.endpoint_template       = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cinder.http_retries            = 3 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cinder.insecure                = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cinder.keyfile                 = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cinder.os_region_name          = RegionOne {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cinder.split_loggers           = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cinder.timeout                 = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] compute.cpu_dedicated_set      = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] compute.cpu_shared_set         = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] compute.image_type_exclude_list = [] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] compute.resource_provider_association_refresh = 300 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] compute.shutdown_retry_interval = 10 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] conductor.workers              = 3 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] console.allowed_origins        = [] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] console.ssl_ciphers            = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] console.ssl_minimum_version    = default {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] consoleauth.token_ttl          = 600 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cyborg.cafile                  = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cyborg.certfile                = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cyborg.collect_timing          = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cyborg.connect_retries         = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cyborg.connect_retry_delay     = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cyborg.endpoint_override       = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cyborg.insecure                = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cyborg.keyfile                 = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cyborg.max_version             = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cyborg.min_version             = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cyborg.region_name             = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cyborg.service_name            = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cyborg.service_type            = accelerator {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cyborg.split_loggers           = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cyborg.status_code_retries     = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cyborg.status_code_retry_delay = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cyborg.timeout                 = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] cyborg.version                 = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] database.backend               = sqlalchemy {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] database.connection            = **** {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] database.connection_debug      = 0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] database.connection_parameters =  {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] database.connection_recycle_time = 3600 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] database.connection_trace      = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] database.db_inc_retry_interval = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] database.db_max_retries        = 20 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] database.db_max_retry_interval = 10 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] database.db_retry_interval     = 1 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] database.max_overflow          = 50 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] database.max_pool_size         = 5 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] database.max_retries           = 10 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] database.mysql_wsrep_sync_wait = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] database.pool_timeout          = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] database.retry_interval        = 10 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] database.slave_connection      = **** {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] database.sqlite_synchronous    = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api_database.backend           = sqlalchemy {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api_database.connection        = **** {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api_database.connection_debug  = 0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api_database.connection_parameters =  {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api_database.connection_recycle_time = 3600 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api_database.connection_trace  = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api_database.db_inc_retry_interval = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api_database.db_max_retries    = 20 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api_database.db_max_retry_interval = 10 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api_database.db_retry_interval = 1 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api_database.max_overflow      = 50 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api_database.max_pool_size     = 5 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api_database.max_retries       = 10 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api_database.pool_timeout      = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api_database.retry_interval    = 10 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api_database.slave_connection  = **** {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] api_database.sqlite_synchronous = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] devices.enabled_mdev_types     = [] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ephemeral_storage_encryption.enabled = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] glance.api_servers             = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] glance.cafile                  = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] glance.certfile                = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] glance.collect_timing          = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] glance.connect_retries         = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] glance.connect_retry_delay     = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] glance.debug                   = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] glance.default_trusted_certificate_ids = [] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] glance.enable_certificate_validation = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] glance.enable_rbd_download     = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] glance.endpoint_override       = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] glance.insecure                = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] glance.keyfile                 = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] glance.max_version             = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] glance.min_version             = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] glance.num_retries             = 3 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] glance.rbd_ceph_conf           =  {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] glance.rbd_connect_timeout     = 5 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] glance.rbd_pool                =  {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] glance.rbd_user                =  {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] glance.region_name             = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] glance.service_name            = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] glance.service_type            = image {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] glance.split_loggers           = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] glance.status_code_retries     = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] glance.status_code_retry_delay = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] glance.timeout                 = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] glance.verify_glance_signatures = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] glance.version                 = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] guestfs.debug                  = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] hyperv.config_drive_cdrom      = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] hyperv.config_drive_inject_password = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] hyperv.enable_remotefx         = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] hyperv.instances_path_share    =  {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] hyperv.limit_cpu_features      = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] hyperv.use_multipath_io        = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] hyperv.vswitch_name            = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] mks.enabled                    = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] image_cache.manager_interval   = 2400 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] image_cache.precache_concurrency = 1 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] image_cache.remove_unused_base_images = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] image_cache.subdirectory_name  = _base {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ironic.api_max_retries         = 60 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ironic.api_retry_interval      = 2 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ironic.auth_section            = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ironic.auth_type               = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ironic.cafile                  = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ironic.certfile                = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ironic.collect_timing          = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ironic.conductor_group         = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ironic.connect_retries         = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ironic.connect_retry_delay     = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ironic.endpoint_override       = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ironic.insecure                = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ironic.keyfile                 = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ironic.max_version             = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ironic.min_version             = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ironic.peer_list               = [] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ironic.region_name             = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ironic.serial_console_state_timeout = 10 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ironic.service_name            = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ironic.service_type            = baremetal {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ironic.split_loggers           = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ironic.status_code_retries     = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ironic.status_code_retry_delay = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ironic.timeout                 = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ironic.version                 = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] key_manager.fixed_key          = **** {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] barbican.barbican_api_version  = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] barbican.barbican_endpoint     = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] barbican.barbican_endpoint_type = public {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] barbican.barbican_region_name  = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] barbican.cafile                = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] barbican.certfile              = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] barbican.collect_timing        = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] barbican.insecure              = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] barbican.keyfile               = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] barbican.number_of_retries     = 60 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] barbican.retry_delay           = 1 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] barbican.send_service_user_token = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] barbican.split_loggers         = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] barbican.timeout               = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] barbican.verify_ssl            = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] barbican.verify_ssl_path       = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] barbican_service_user.auth_section = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] barbican_service_user.auth_type = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] barbican_service_user.cafile   = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] barbican_service_user.certfile = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] barbican_service_user.collect_timing = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] barbican_service_user.insecure = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] barbican_service_user.keyfile  = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] barbican_service_user.split_loggers = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] barbican_service_user.timeout  = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vault.approle_role_id          = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vault.approle_secret_id        = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vault.cafile                   = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vault.certfile                 = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vault.collect_timing           = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vault.insecure                 = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vault.keyfile                  = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vault.kv_mountpoint            = secret {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vault.kv_path                  = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vault.kv_version               = 2 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vault.namespace                = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vault.root_token_id            = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vault.split_loggers            = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vault.ssl_ca_crt_file          = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vault.timeout                  = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vault.use_ssl                  = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] keystone.auth_section          = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] keystone.auth_type             = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] keystone.cafile                = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] keystone.certfile              = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] keystone.collect_timing        = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] keystone.connect_retries       = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] keystone.connect_retry_delay   = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] keystone.endpoint_override     = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] keystone.insecure              = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] keystone.keyfile               = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] keystone.max_version           = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] keystone.min_version           = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] keystone.region_name           = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] keystone.service_name          = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] keystone.service_type          = identity {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] keystone.split_loggers         = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] keystone.status_code_retries   = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] keystone.status_code_retry_delay = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] keystone.timeout               = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] keystone.version               = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.connection_uri         =  {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.cpu_mode               = custom {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: WARNING oslo_config.cfg [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.cpu_power_governor_high = performance {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.cpu_power_management   = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.device_detach_attempts = 8 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.device_detach_timeout  = 20 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.disk_cachemodes        = [] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.disk_prefix            = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.enabled_perf_events    = [] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.file_backed_memory     = 0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.gid_maps               = [] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.hw_disk_discard        = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.hw_machine_type        = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.images_rbd_pool        = rbd {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.images_type            = default {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.images_volume_group    = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.inject_key             = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.inject_partition       = -2 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.inject_password        = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.iscsi_iface            = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.iser_use_multipath     = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.live_migration_downtime = 500 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.live_migration_inbound_addr = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.live_migration_scheme  = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.live_migration_timeout_action = abort {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.live_migration_tunnelled = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: WARNING oslo_config.cfg [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 17 02:55:10 user nova-compute[74898]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 17 02:55:10 user nova-compute[74898]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 17 02:55:10 user nova-compute[74898]: and ``live_migration_inbound_addr`` respectively.
Nov 17 02:55:10 user nova-compute[74898]: ).  Its value may be silently ignored in the future.
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.live_migration_with_native_tls = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.max_queues             = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.nfs_mount_options      = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.num_pcie_ports         = 0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.pmem_namespaces        = [] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.quobyte_client_cfg     = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.rbd_secret_uuid        = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.rbd_user               = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.rescue_image_id        = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.rescue_kernel_id       = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.rx_queue_size          = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.smbfs_mount_options    =  {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.snapshot_compression   = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.snapshot_image_format  = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.sparse_logical_volumes = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.swtpm_enabled          = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.swtpm_group            = tss {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.swtpm_user             = tss {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.sysinfo_serial         = unique {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.tb_cache_size          = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.tx_queue_size          = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.uid_maps               = [] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.use_virtio_for_bridges = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.virt_type              = kvm {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.volume_clear           = zero {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.volume_clear_size      = 0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.volume_use_multipath   = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.vzstorage_cache_path   = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] neutron.auth_section           = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] neutron.auth_type              = password {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] neutron.cafile                 = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] neutron.certfile               = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] neutron.collect_timing         = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] neutron.connect_retries        = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] neutron.connect_retry_delay    = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] neutron.default_floating_pool  = public {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] neutron.endpoint_override      = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] neutron.extension_sync_interval = 600 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] neutron.http_retries           = 3 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] neutron.insecure               = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] neutron.keyfile                = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] neutron.max_version            = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] neutron.min_version            = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] neutron.ovs_bridge             = br-int {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] neutron.physnets               = [] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] neutron.region_name            = RegionOne {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] neutron.service_metadata_proxy = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] neutron.service_name           = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] neutron.service_type           = network {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] neutron.split_loggers          = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] neutron.status_code_retries    = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] neutron.status_code_retry_delay = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] neutron.timeout                = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] neutron.version                = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] notifications.bdms_in_notifications = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] notifications.default_level    = INFO {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] notifications.notification_format = unversioned {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] notifications.notify_on_state_change = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] pci.alias                      = [] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] pci.device_spec                = [] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] pci.report_in_placement        = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.auth_section         = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.auth_type            = password {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.cafile               = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.certfile             = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.collect_timing       = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.connect_retries      = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.connect_retry_delay  = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.default_domain_id    = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.default_domain_name  = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.domain_id            = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.domain_name          = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.endpoint_override    = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.insecure             = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.keyfile              = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.max_version          = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.min_version          = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.password             = **** {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.project_domain_id    = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.project_domain_name  = Default {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.project_id           = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.project_name         = service {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.region_name          = RegionOne {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.service_name         = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.service_type         = placement {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.split_loggers        = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.status_code_retries  = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.status_code_retry_delay = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.system_scope         = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.timeout              = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.trust_id             = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.user_domain_id       = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.user_domain_name     = Default {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.user_id              = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.username             = placement {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] placement.version              = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] quota.cores                    = 20 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] quota.count_usage_from_placement = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] quota.injected_file_content_bytes = 10240 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] quota.injected_file_path_length = 255 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] quota.injected_files           = 5 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] quota.instances                = 10 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] quota.key_pairs                = 100 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] quota.metadata_items           = 128 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] quota.ram                      = 51200 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] quota.recheck_quota            = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] quota.server_group_members     = 10 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] quota.server_groups            = 10 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] rdp.enabled                    = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] scheduler.image_metadata_prefilter = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] scheduler.max_attempts         = 3 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] scheduler.max_placement_results = 1000 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] scheduler.workers              = 3 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] filter_scheduler.host_subset_size = 1 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] filter_scheduler.isolated_hosts = [] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] filter_scheduler.isolated_images = [] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] filter_scheduler.pci_in_placement = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] filter_scheduler.track_instance_changes = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] metrics.required               = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] metrics.weight_multiplier      = 1.0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] metrics.weight_setting         = [] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] serial_console.enabled         = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] serial_console.port_range      = 10000:20000 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] serial_console.serialproxy_port = 6083 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] service_user.auth_section      = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] service_user.auth_type         = password {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] service_user.cafile            = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] service_user.certfile          = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] service_user.collect_timing    = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] service_user.insecure          = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] service_user.keyfile           = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] service_user.send_service_user_token = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] service_user.split_loggers     = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] service_user.timeout           = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] spice.agent_enabled            = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] spice.enabled                  = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] spice.html5proxy_port          = 6082 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] spice.image_compression        = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] spice.jpeg_compression         = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] spice.playback_compression     = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] spice.server_listen            = 127.0.0.1 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] spice.streaming_mode           = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] spice.zlib_compression         = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] upgrade_levels.baseapi         = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] upgrade_levels.compute         = auto {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] upgrade_levels.conductor       = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] upgrade_levels.scheduler       = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vendordata_dynamic_auth.cafile = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vendordata_dynamic_auth.certfile = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vendordata_dynamic_auth.insecure = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vendordata_dynamic_auth.timeout = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vmware.api_retry_count         = 10 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vmware.ca_file                 = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vmware.cache_prefix            = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vmware.cluster_name            = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vmware.connection_pool_size    = 10 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vmware.console_delay_seconds   = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vmware.datastore_regex         = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vmware.host_ip                 = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vmware.host_password           = **** {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vmware.host_port               = 443 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vmware.host_username           = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vmware.insecure                = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vmware.integration_bridge      = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vmware.maximum_objects         = 100 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vmware.pbm_default_policy      = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vmware.pbm_enabled             = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vmware.pbm_wsdl_location       = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vmware.serial_port_proxy_uri   = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vmware.serial_port_service_uri = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vmware.task_poll_interval      = 0.5 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vmware.use_linked_clone        = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vmware.vnc_keymap              = en-us {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vmware.vnc_port                = 5900 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vmware.vnc_port_total          = 10000 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vnc.auth_schemes               = ['none'] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vnc.enabled                    = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vnc.novncproxy_port            = 6080 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vnc.vencrypt_ca_certs          = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vnc.vencrypt_client_cert       = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vnc.vencrypt_client_key        = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] workarounds.disable_rootwrap   = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] workarounds.enable_numa_live_migration = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] workarounds.libvirt_disable_apic = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] wsgi.client_socket_timeout     = 900 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] wsgi.default_pool_size         = 1000 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] wsgi.keep_alive                = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] wsgi.max_header_line           = 16384 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] wsgi.ssl_ca_file               = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] wsgi.ssl_cert_file             = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] wsgi.ssl_key_file              = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] wsgi.tcp_keepidle              = 600 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] zvm.ca_file                    = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] zvm.cloud_connector_url        = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] zvm.reachable_timeout          = 300 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_policy.enforce_new_defaults = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_policy.enforce_scope      = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_policy.policy_default_rule = default {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] profiler.connection_string     = messaging:// {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] profiler.enabled               = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] profiler.es_doc_type           = notification {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] profiler.es_scroll_size        = 10000 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] profiler.es_scroll_time        = 2m {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] profiler.filter_error_trace    = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] profiler.hmac_keys             = **** {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] profiler.sentinel_service_name = mymaster {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] profiler.socket_timeout        = 0.1 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] profiler.trace_requests        = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] profiler.trace_sqlalchemy      = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] profiler_jaeger.process_tags   = {} {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] profiler_jaeger.service_name_prefix = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] profiler_otlp.service_name_prefix = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] remote_debug.host              = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] remote_debug.port              = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_notifications.retry = -1 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_limit.auth_section        = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_limit.auth_type           = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_limit.cafile              = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_limit.certfile            = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_limit.collect_timing      = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_limit.connect_retries     = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_limit.connect_retry_delay = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_limit.endpoint_id         = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_limit.endpoint_override   = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_limit.insecure            = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_limit.keyfile             = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_limit.max_version         = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_limit.min_version         = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_limit.region_name         = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_limit.service_name        = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_limit.service_type        = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_limit.split_loggers       = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_limit.status_code_retries = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_limit.status_code_retry_delay = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_limit.timeout             = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_limit.valid_interfaces    = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_limit.version             = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_reports.file_event_handler = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] oslo_reports.log_dir           = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vif_plug_ovs_privileged.group  = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] vif_plug_ovs_privileged.user   = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] os_vif_ovs.isolate_vif         = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] os_brick.lock_path             = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] privsep_osbrick.capabilities   = [21] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] privsep_osbrick.group          = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] privsep_osbrick.helper_command = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] privsep_osbrick.user           = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] nova_sys_admin.group           = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] nova_sys_admin.helper_command  = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] nova_sys_admin.user            = None {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG oslo_service.service [None req-72c7434f-fc9a-41e5-99f1-fd16eb52e0d3 None None] ******************************************************************************** {{(pid=74898) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 17 02:55:10 user nova-compute[74898]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 17 02:55:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Connecting to libvirt: qemu:///system {{(pid=74898) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f9c20bf64d0> {{(pid=74898) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 17 02:55:10 user nova-compute[74898]: libvirt:  error : internal error: could not initialize domain event timer
Nov 17 02:55:10 user nova-compute[74898]: WARNING nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 17 02:55:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f9c20bf64d0> {{(pid=74898) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Starting native event thread {{(pid=74898) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Starting green dispatch thread {{(pid=74898) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 17 02:55:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Starting connection event dispatch thread {{(pid=74898) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 17 02:55:10 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Connection event '1' reason 'None'
Nov 17 02:55:10 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 17 02:55:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.mount [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Initialising _HostMountState generation 0 {{(pid=74898) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 17 02:55:17 user nova-compute[74898]: INFO nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Libvirt host capabilities <capabilities>
Nov 17 02:55:17 user nova-compute[74898]:   <host>
Nov 17 02:55:17 user nova-compute[74898]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 17 02:55:17 user nova-compute[74898]:     <cpu>
Nov 17 02:55:17 user nova-compute[74898]:       <arch>x86_64</arch>
Nov 17 02:55:17 user nova-compute[74898]:       <model>IvyBridge-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <vendor>Intel</vendor>
Nov 17 02:55:17 user nova-compute[74898]:       <microcode version='1070'/>
Nov 17 02:55:17 user nova-compute[74898]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 17 02:55:17 user nova-compute[74898]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature name='ss'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature name='vmx'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature name='pcid'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature name='osxsave'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature name='hypervisor'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature name='arat'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature name='tsc_adjust'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature name='md-clear'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature name='stibp'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature name='arch-capabilities'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature name='ssbd'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature name='invtsc'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature name='rsba'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature name='skip-l1dfl-vmentry'/>
Nov 17 02:55:17 user nova-compute[74898]:       <pages unit='KiB' size='4'/>
Nov 17 02:55:17 user nova-compute[74898]:       <pages unit='KiB' size='2048'/>
Nov 17 02:55:17 user nova-compute[74898]:     </cpu>
Nov 17 02:55:17 user nova-compute[74898]:     <power_management>
Nov 17 02:55:17 user nova-compute[74898]:       <suspend_mem/>
Nov 17 02:55:17 user nova-compute[74898]:       <suspend_disk/>
Nov 17 02:55:17 user nova-compute[74898]:       <suspend_hybrid/>
Nov 17 02:55:17 user nova-compute[74898]:     </power_management>
Nov 17 02:55:17 user nova-compute[74898]:     <iommu support='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     <migration_features>
Nov 17 02:55:17 user nova-compute[74898]:       <live/>
Nov 17 02:55:17 user nova-compute[74898]:       <uri_transports>
Nov 17 02:55:17 user nova-compute[74898]:         <uri_transport>tcp</uri_transport>
Nov 17 02:55:17 user nova-compute[74898]:         <uri_transport>rdma</uri_transport>
Nov 17 02:55:17 user nova-compute[74898]:       </uri_transports>
Nov 17 02:55:17 user nova-compute[74898]:     </migration_features>
Nov 17 02:55:17 user nova-compute[74898]:     <topology>
Nov 17 02:55:17 user nova-compute[74898]:       <cells num='2'>
Nov 17 02:55:17 user nova-compute[74898]:         <cell id='0'>
Nov 17 02:55:17 user nova-compute[74898]:           <memory unit='KiB'>8189224</memory>
Nov 17 02:55:17 user nova-compute[74898]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 17 02:55:17 user nova-compute[74898]:           <pages unit='KiB' size='2048'>0</pages>
Nov 17 02:55:17 user nova-compute[74898]:           <distances>
Nov 17 02:55:17 user nova-compute[74898]:             <sibling id='0' value='10'/>
Nov 17 02:55:17 user nova-compute[74898]:             <sibling id='1' value='20'/>
Nov 17 02:55:17 user nova-compute[74898]:           </distances>
Nov 17 02:55:17 user nova-compute[74898]:           <cpus num='6'>
Nov 17 02:55:17 user nova-compute[74898]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 17 02:55:17 user nova-compute[74898]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 17 02:55:17 user nova-compute[74898]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 17 02:55:17 user nova-compute[74898]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 17 02:55:17 user nova-compute[74898]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 17 02:55:17 user nova-compute[74898]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 17 02:55:17 user nova-compute[74898]:           </cpus>
Nov 17 02:55:17 user nova-compute[74898]:         </cell>
Nov 17 02:55:17 user nova-compute[74898]:         <cell id='1'>
Nov 17 02:55:17 user nova-compute[74898]:           <memory unit='KiB'>8206460</memory>
Nov 17 02:55:17 user nova-compute[74898]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 17 02:55:17 user nova-compute[74898]:           <pages unit='KiB' size='2048'>0</pages>
Nov 17 02:55:17 user nova-compute[74898]:           <distances>
Nov 17 02:55:17 user nova-compute[74898]:             <sibling id='0' value='20'/>
Nov 17 02:55:17 user nova-compute[74898]:             <sibling id='1' value='10'/>
Nov 17 02:55:17 user nova-compute[74898]:           </distances>
Nov 17 02:55:17 user nova-compute[74898]:           <cpus num='6'>
Nov 17 02:55:17 user nova-compute[74898]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 17 02:55:17 user nova-compute[74898]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 17 02:55:17 user nova-compute[74898]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 17 02:55:17 user nova-compute[74898]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 17 02:55:17 user nova-compute[74898]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 17 02:55:17 user nova-compute[74898]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 17 02:55:17 user nova-compute[74898]:           </cpus>
Nov 17 02:55:17 user nova-compute[74898]:         </cell>
Nov 17 02:55:17 user nova-compute[74898]:       </cells>
Nov 17 02:55:17 user nova-compute[74898]:     </topology>
Nov 17 02:55:17 user nova-compute[74898]:     <cache>
Nov 17 02:55:17 user nova-compute[74898]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 17 02:55:17 user nova-compute[74898]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 17 02:55:17 user nova-compute[74898]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 17 02:55:17 user nova-compute[74898]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 17 02:55:17 user nova-compute[74898]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 17 02:55:17 user nova-compute[74898]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 17 02:55:17 user nova-compute[74898]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 17 02:55:17 user nova-compute[74898]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 17 02:55:17 user nova-compute[74898]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 17 02:55:17 user nova-compute[74898]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 17 02:55:17 user nova-compute[74898]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 17 02:55:17 user nova-compute[74898]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 17 02:55:17 user nova-compute[74898]:     </cache>
Nov 17 02:55:17 user nova-compute[74898]:     <secmodel>
Nov 17 02:55:17 user nova-compute[74898]:       <model>apparmor</model>
Nov 17 02:55:17 user nova-compute[74898]:       <doi>0</doi>
Nov 17 02:55:17 user nova-compute[74898]:     </secmodel>
Nov 17 02:55:17 user nova-compute[74898]:     <secmodel>
Nov 17 02:55:17 user nova-compute[74898]:       <model>dac</model>
Nov 17 02:55:17 user nova-compute[74898]:       <doi>0</doi>
Nov 17 02:55:17 user nova-compute[74898]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 17 02:55:17 user nova-compute[74898]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 17 02:55:17 user nova-compute[74898]:     </secmodel>
Nov 17 02:55:17 user nova-compute[74898]:   </host>
Nov 17 02:55:17 user nova-compute[74898]:   <guest>
Nov 17 02:55:17 user nova-compute[74898]:     <os_type>hvm</os_type>
Nov 17 02:55:17 user nova-compute[74898]:     <arch name='alpha'>
Nov 17 02:55:17 user nova-compute[74898]:       <wordsize>64</wordsize>
Nov 17 02:55:17 user nova-compute[74898]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>clipper</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <domain type='qemu'/>
Nov 17 02:55:17 user nova-compute[74898]:     </arch>
Nov 17 02:55:17 user nova-compute[74898]:     <features>
Nov 17 02:55:17 user nova-compute[74898]:       <cpuselection/>
Nov 17 02:55:17 user nova-compute[74898]:       <deviceboot/>
Nov 17 02:55:17 user nova-compute[74898]:       <disksnapshot default='on' toggle='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     </features>
Nov 17 02:55:17 user nova-compute[74898]:   </guest>
Nov 17 02:55:17 user nova-compute[74898]:   <guest>
Nov 17 02:55:17 user nova-compute[74898]:     <os_type>hvm</os_type>
Nov 17 02:55:17 user nova-compute[74898]:     <arch name='armv6l'>
Nov 17 02:55:17 user nova-compute[74898]:       <wordsize>32</wordsize>
Nov 17 02:55:17 user nova-compute[74898]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>integratorcp</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>borzoi</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>spitz</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>nuri</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>musca-b1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>versatileab</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>kzm</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>musca-a</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>smdkc210</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>sx1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>z2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>tosa</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>sabrelite</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>realview-eb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>n810</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>n800</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>versatilepb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>terrier</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mainstone</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>midway</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>musicpal</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>microbit</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>cubieboard</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>verdex</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>netduino2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>raspi2b</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>cheetah</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>highbank</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>akita</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>connex</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>collie</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>raspi0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <domain type='qemu'/>
Nov 17 02:55:17 user nova-compute[74898]:     </arch>
Nov 17 02:55:17 user nova-compute[74898]:     <features>
Nov 17 02:55:17 user nova-compute[74898]:       <cpuselection/>
Nov 17 02:55:17 user nova-compute[74898]:       <deviceboot/>
Nov 17 02:55:17 user nova-compute[74898]:       <disksnapshot default='on' toggle='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     </features>
Nov 17 02:55:17 user nova-compute[74898]:   </guest>
Nov 17 02:55:17 user nova-compute[74898]:   <guest>
Nov 17 02:55:17 user nova-compute[74898]:     <os_type>hvm</os_type>
Nov 17 02:55:17 user nova-compute[74898]:     <arch name='armv7l'>
Nov 17 02:55:17 user nova-compute[74898]:       <wordsize>32</wordsize>
Nov 17 02:55:17 user nova-compute[74898]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>integratorcp</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>borzoi</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>spitz</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>nuri</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>musca-b1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>versatileab</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>kzm</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>musca-a</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>smdkc210</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>sx1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>z2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>tosa</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>sabrelite</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>realview-eb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>n810</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>n800</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>versatilepb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>terrier</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mainstone</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>midway</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>musicpal</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>microbit</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>cubieboard</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>verdex</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>netduino2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>raspi2b</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>cheetah</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>highbank</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>akita</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>connex</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>collie</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>raspi0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <domain type='qemu'/>
Nov 17 02:55:17 user nova-compute[74898]:     </arch>
Nov 17 02:55:17 user nova-compute[74898]:     <features>
Nov 17 02:55:17 user nova-compute[74898]:       <cpuselection/>
Nov 17 02:55:17 user nova-compute[74898]:       <deviceboot/>
Nov 17 02:55:17 user nova-compute[74898]:       <disksnapshot default='on' toggle='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     </features>
Nov 17 02:55:17 user nova-compute[74898]:   </guest>
Nov 17 02:55:17 user nova-compute[74898]:   <guest>
Nov 17 02:55:17 user nova-compute[74898]:     <os_type>hvm</os_type>
Nov 17 02:55:17 user nova-compute[74898]:     <arch name='aarch64'>
Nov 17 02:55:17 user nova-compute[74898]:       <wordsize>64</wordsize>
Nov 17 02:55:17 user nova-compute[74898]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>integratorcp</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>borzoi</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>spitz</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>nuri</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>musca-b1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>versatileab</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>kzm</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>musca-a</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>smdkc210</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>sx1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>z2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>tosa</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>sabrelite</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>realview-eb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>n810</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>n800</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>versatilepb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>terrier</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mainstone</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>midway</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>musicpal</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>microbit</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>cubieboard</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>verdex</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>netduino2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>raspi3b</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>raspi2b</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>cheetah</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>highbank</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>akita</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>connex</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>collie</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>raspi0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <domain type='qemu'/>
Nov 17 02:55:17 user nova-compute[74898]:     </arch>
Nov 17 02:55:17 user nova-compute[74898]:     <features>
Nov 17 02:55:17 user nova-compute[74898]:       <acpi default='on' toggle='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:       <cpuselection/>
Nov 17 02:55:17 user nova-compute[74898]:       <deviceboot/>
Nov 17 02:55:17 user nova-compute[74898]:       <disksnapshot default='on' toggle='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     </features>
Nov 17 02:55:17 user nova-compute[74898]:   </guest>
Nov 17 02:55:17 user nova-compute[74898]:   <guest>
Nov 17 02:55:17 user nova-compute[74898]:     <os_type>hvm</os_type>
Nov 17 02:55:17 user nova-compute[74898]:     <arch name='cris'>
Nov 17 02:55:17 user nova-compute[74898]:       <wordsize>32</wordsize>
Nov 17 02:55:17 user nova-compute[74898]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <domain type='qemu'/>
Nov 17 02:55:17 user nova-compute[74898]:     </arch>
Nov 17 02:55:17 user nova-compute[74898]:     <features>
Nov 17 02:55:17 user nova-compute[74898]:       <cpuselection/>
Nov 17 02:55:17 user nova-compute[74898]:       <deviceboot/>
Nov 17 02:55:17 user nova-compute[74898]:       <disksnapshot default='on' toggle='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     </features>
Nov 17 02:55:17 user nova-compute[74898]:   </guest>
Nov 17 02:55:17 user nova-compute[74898]:   <guest>
Nov 17 02:55:17 user nova-compute[74898]:     <os_type>hvm</os_type>
Nov 17 02:55:17 user nova-compute[74898]:     <arch name='i686'>
Nov 17 02:55:17 user nova-compute[74898]:       <wordsize>32</wordsize>
Nov 17 02:55:17 user nova-compute[74898]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>x-remote</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>isapc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>microvm</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <domain type='qemu'/>
Nov 17 02:55:17 user nova-compute[74898]:       <domain type='kvm'/>
Nov 17 02:55:17 user nova-compute[74898]:     </arch>
Nov 17 02:55:17 user nova-compute[74898]:     <features>
Nov 17 02:55:17 user nova-compute[74898]:       <pae/>
Nov 17 02:55:17 user nova-compute[74898]:       <nonpae/>
Nov 17 02:55:17 user nova-compute[74898]:       <acpi default='on' toggle='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:       <apic default='on' toggle='no'/>
Nov 17 02:55:17 user nova-compute[74898]:       <cpuselection/>
Nov 17 02:55:17 user nova-compute[74898]:       <deviceboot/>
Nov 17 02:55:17 user nova-compute[74898]:       <disksnapshot default='on' toggle='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     </features>
Nov 17 02:55:17 user nova-compute[74898]:   </guest>
Nov 17 02:55:17 user nova-compute[74898]:   <guest>
Nov 17 02:55:17 user nova-compute[74898]:     <os_type>hvm</os_type>
Nov 17 02:55:17 user nova-compute[74898]:     <arch name='m68k'>
Nov 17 02:55:17 user nova-compute[74898]:       <wordsize>32</wordsize>
Nov 17 02:55:17 user nova-compute[74898]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>an5206</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>q800</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>next-cube</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <domain type='qemu'/>
Nov 17 02:55:17 user nova-compute[74898]:     </arch>
Nov 17 02:55:17 user nova-compute[74898]:     <features>
Nov 17 02:55:17 user nova-compute[74898]:       <cpuselection/>
Nov 17 02:55:17 user nova-compute[74898]:       <deviceboot/>
Nov 17 02:55:17 user nova-compute[74898]:       <disksnapshot default='on' toggle='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     </features>
Nov 17 02:55:17 user nova-compute[74898]:   </guest>
Nov 17 02:55:17 user nova-compute[74898]:   <guest>
Nov 17 02:55:17 user nova-compute[74898]:     <os_type>hvm</os_type>
Nov 17 02:55:17 user nova-compute[74898]:     <arch name='microblaze'>
Nov 17 02:55:17 user nova-compute[74898]:       <wordsize>32</wordsize>
Nov 17 02:55:17 user nova-compute[74898]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <domain type='qemu'/>
Nov 17 02:55:17 user nova-compute[74898]:     </arch>
Nov 17 02:55:17 user nova-compute[74898]:     <features>
Nov 17 02:55:17 user nova-compute[74898]:       <cpuselection/>
Nov 17 02:55:17 user nova-compute[74898]:       <deviceboot/>
Nov 17 02:55:17 user nova-compute[74898]:       <disksnapshot default='on' toggle='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     </features>
Nov 17 02:55:17 user nova-compute[74898]:   </guest>
Nov 17 02:55:17 user nova-compute[74898]:   <guest>
Nov 17 02:55:17 user nova-compute[74898]:     <os_type>hvm</os_type>
Nov 17 02:55:17 user nova-compute[74898]:     <arch name='microblazeel'>
Nov 17 02:55:17 user nova-compute[74898]:       <wordsize>32</wordsize>
Nov 17 02:55:17 user nova-compute[74898]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <domain type='qemu'/>
Nov 17 02:55:17 user nova-compute[74898]:     </arch>
Nov 17 02:55:17 user nova-compute[74898]:     <features>
Nov 17 02:55:17 user nova-compute[74898]:       <cpuselection/>
Nov 17 02:55:17 user nova-compute[74898]:       <deviceboot/>
Nov 17 02:55:17 user nova-compute[74898]:       <disksnapshot default='on' toggle='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     </features>
Nov 17 02:55:17 user nova-compute[74898]:   </guest>
Nov 17 02:55:17 user nova-compute[74898]:   <guest>
Nov 17 02:55:17 user nova-compute[74898]:     <os_type>hvm</os_type>
Nov 17 02:55:17 user nova-compute[74898]:     <arch name='mips'>
Nov 17 02:55:17 user nova-compute[74898]:       <wordsize>32</wordsize>
Nov 17 02:55:17 user nova-compute[74898]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='16'>malta</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mipssim</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <domain type='qemu'/>
Nov 17 02:55:17 user nova-compute[74898]:     </arch>
Nov 17 02:55:17 user nova-compute[74898]:     <features>
Nov 17 02:55:17 user nova-compute[74898]:       <cpuselection/>
Nov 17 02:55:17 user nova-compute[74898]:       <deviceboot/>
Nov 17 02:55:17 user nova-compute[74898]:       <disksnapshot default='on' toggle='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     </features>
Nov 17 02:55:17 user nova-compute[74898]:   </guest>
Nov 17 02:55:17 user nova-compute[74898]:   <guest>
Nov 17 02:55:17 user nova-compute[74898]:     <os_type>hvm</os_type>
Nov 17 02:55:17 user nova-compute[74898]:     <arch name='mipsel'>
Nov 17 02:55:17 user nova-compute[74898]:       <wordsize>32</wordsize>
Nov 17 02:55:17 user nova-compute[74898]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='16'>malta</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mipssim</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <domain type='qemu'/>
Nov 17 02:55:17 user nova-compute[74898]:     </arch>
Nov 17 02:55:17 user nova-compute[74898]:     <features>
Nov 17 02:55:17 user nova-compute[74898]:       <cpuselection/>
Nov 17 02:55:17 user nova-compute[74898]:       <deviceboot/>
Nov 17 02:55:17 user nova-compute[74898]:       <disksnapshot default='on' toggle='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     </features>
Nov 17 02:55:17 user nova-compute[74898]:   </guest>
Nov 17 02:55:17 user nova-compute[74898]:   <guest>
Nov 17 02:55:17 user nova-compute[74898]:     <os_type>hvm</os_type>
Nov 17 02:55:17 user nova-compute[74898]:     <arch name='mips64'>
Nov 17 02:55:17 user nova-compute[74898]:       <wordsize>64</wordsize>
Nov 17 02:55:17 user nova-compute[74898]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='16'>malta</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mipssim</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>pica61</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>magnum</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <domain type='qemu'/>
Nov 17 02:55:17 user nova-compute[74898]:     </arch>
Nov 17 02:55:17 user nova-compute[74898]:     <features>
Nov 17 02:55:17 user nova-compute[74898]:       <cpuselection/>
Nov 17 02:55:17 user nova-compute[74898]:       <deviceboot/>
Nov 17 02:55:17 user nova-compute[74898]:       <disksnapshot default='on' toggle='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     </features>
Nov 17 02:55:17 user nova-compute[74898]:   </guest>
Nov 17 02:55:17 user nova-compute[74898]:   <guest>
Nov 17 02:55:17 user nova-compute[74898]:     <os_type>hvm</os_type>
Nov 17 02:55:17 user nova-compute[74898]:     <arch name='mips64el'>
Nov 17 02:55:17 user nova-compute[74898]:       <wordsize>64</wordsize>
Nov 17 02:55:17 user nova-compute[74898]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='16'>malta</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mipssim</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>pica61</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>magnum</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='16'>boston</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <domain type='qemu'/>
Nov 17 02:55:17 user nova-compute[74898]:     </arch>
Nov 17 02:55:17 user nova-compute[74898]:     <features>
Nov 17 02:55:17 user nova-compute[74898]:       <cpuselection/>
Nov 17 02:55:17 user nova-compute[74898]:       <deviceboot/>
Nov 17 02:55:17 user nova-compute[74898]:       <disksnapshot default='on' toggle='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     </features>
Nov 17 02:55:17 user nova-compute[74898]:   </guest>
Nov 17 02:55:17 user nova-compute[74898]:   <guest>
Nov 17 02:55:17 user nova-compute[74898]:     <os_type>hvm</os_type>
Nov 17 02:55:17 user nova-compute[74898]:     <arch name='ppc'>
Nov 17 02:55:17 user nova-compute[74898]:       <wordsize>32</wordsize>
Nov 17 02:55:17 user nova-compute[74898]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>g3beige</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mac99</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='32'>ppce500</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>pegasos2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>sam460ex</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>bamboo</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>40p</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>ref405ep</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>taihu</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <domain type='qemu'/>
Nov 17 02:55:17 user nova-compute[74898]:     </arch>
Nov 17 02:55:17 user nova-compute[74898]:     <features>
Nov 17 02:55:17 user nova-compute[74898]:       <cpuselection/>
Nov 17 02:55:17 user nova-compute[74898]:       <deviceboot/>
Nov 17 02:55:17 user nova-compute[74898]:       <disksnapshot default='on' toggle='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     </features>
Nov 17 02:55:17 user nova-compute[74898]:   </guest>
Nov 17 02:55:17 user nova-compute[74898]:   <guest>
Nov 17 02:55:17 user nova-compute[74898]:     <os_type>hvm</os_type>
Nov 17 02:55:17 user nova-compute[74898]:     <arch name='ppc64'>
Nov 17 02:55:17 user nova-compute[74898]:       <wordsize>64</wordsize>
Nov 17 02:55:17 user nova-compute[74898]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2048'>powernv9</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>taihu</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2048'>powernv10</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='32'>ppce500</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>40p</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>pegasos2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>bamboo</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>g3beige</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mac99</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>sam460ex</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>ref405ep</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2048'>powernv8</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <domain type='qemu'/>
Nov 17 02:55:17 user nova-compute[74898]:     </arch>
Nov 17 02:55:17 user nova-compute[74898]:     <features>
Nov 17 02:55:17 user nova-compute[74898]:       <cpuselection/>
Nov 17 02:55:17 user nova-compute[74898]:       <deviceboot/>
Nov 17 02:55:17 user nova-compute[74898]:       <disksnapshot default='on' toggle='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     </features>
Nov 17 02:55:17 user nova-compute[74898]:   </guest>
Nov 17 02:55:17 user nova-compute[74898]:   <guest>
Nov 17 02:55:17 user nova-compute[74898]:     <os_type>hvm</os_type>
Nov 17 02:55:17 user nova-compute[74898]:     <arch name='ppc64le'>
Nov 17 02:55:17 user nova-compute[74898]:       <wordsize>64</wordsize>
Nov 17 02:55:17 user nova-compute[74898]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2048'>powernv9</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>taihu</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2048'>powernv10</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='32'>ppce500</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>40p</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>pegasos2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>bamboo</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>g3beige</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>mac99</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>sam460ex</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>ref405ep</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2048'>powernv8</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <domain type='qemu'/>
Nov 17 02:55:17 user nova-compute[74898]:     </arch>
Nov 17 02:55:17 user nova-compute[74898]:     <features>
Nov 17 02:55:17 user nova-compute[74898]:       <cpuselection/>
Nov 17 02:55:17 user nova-compute[74898]:       <deviceboot/>
Nov 17 02:55:17 user nova-compute[74898]:       <disksnapshot default='on' toggle='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     </features>
Nov 17 02:55:17 user nova-compute[74898]:   </guest>
Nov 17 02:55:17 user nova-compute[74898]:   <guest>
Nov 17 02:55:17 user nova-compute[74898]:     <os_type>hvm</os_type>
Nov 17 02:55:17 user nova-compute[74898]:     <arch name='riscv32'>
Nov 17 02:55:17 user nova-compute[74898]:       <wordsize>32</wordsize>
Nov 17 02:55:17 user nova-compute[74898]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='8'>spike</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>opentitan</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='5'>sifive_u</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>sifive_e</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='8'>virt</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <domain type='qemu'/>
Nov 17 02:55:17 user nova-compute[74898]:     </arch>
Nov 17 02:55:17 user nova-compute[74898]:     <features>
Nov 17 02:55:17 user nova-compute[74898]:       <cpuselection/>
Nov 17 02:55:17 user nova-compute[74898]:       <deviceboot/>
Nov 17 02:55:17 user nova-compute[74898]:       <disksnapshot default='on' toggle='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     </features>
Nov 17 02:55:17 user nova-compute[74898]:   </guest>
Nov 17 02:55:17 user nova-compute[74898]:   <guest>
Nov 17 02:55:17 user nova-compute[74898]:     <os_type>hvm</os_type>
Nov 17 02:55:17 user nova-compute[74898]:     <arch name='riscv64'>
Nov 17 02:55:17 user nova-compute[74898]:       <wordsize>64</wordsize>
Nov 17 02:55:17 user nova-compute[74898]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='8'>spike</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='5'>sifive_u</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>shakti_c</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>sifive_e</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='8'>virt</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <domain type='qemu'/>
Nov 17 02:55:17 user nova-compute[74898]:     </arch>
Nov 17 02:55:17 user nova-compute[74898]:     <features>
Nov 17 02:55:17 user nova-compute[74898]:       <cpuselection/>
Nov 17 02:55:17 user nova-compute[74898]:       <deviceboot/>
Nov 17 02:55:17 user nova-compute[74898]:       <disksnapshot default='on' toggle='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     </features>
Nov 17 02:55:17 user nova-compute[74898]:   </guest>
Nov 17 02:55:17 user nova-compute[74898]:   <guest>
Nov 17 02:55:17 user nova-compute[74898]:     <os_type>hvm</os_type>
Nov 17 02:55:17 user nova-compute[74898]:     <arch name='s390x'>
Nov 17 02:55:17 user nova-compute[74898]:       <wordsize>64</wordsize>
Nov 17 02:55:17 user nova-compute[74898]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <domain type='qemu'/>
Nov 17 02:55:17 user nova-compute[74898]:     </arch>
Nov 17 02:55:17 user nova-compute[74898]:     <features>
Nov 17 02:55:17 user nova-compute[74898]:       <cpuselection/>
Nov 17 02:55:17 user nova-compute[74898]:       <deviceboot/>
Nov 17 02:55:17 user nova-compute[74898]:       <disksnapshot default='on' toggle='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     </features>
Nov 17 02:55:17 user nova-compute[74898]:   </guest>
Nov 17 02:55:17 user nova-compute[74898]:   <guest>
Nov 17 02:55:17 user nova-compute[74898]:     <os_type>hvm</os_type>
Nov 17 02:55:17 user nova-compute[74898]:     <arch name='sh4'>
Nov 17 02:55:17 user nova-compute[74898]:       <wordsize>32</wordsize>
Nov 17 02:55:17 user nova-compute[74898]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>shix</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>r2d</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <domain type='qemu'/>
Nov 17 02:55:17 user nova-compute[74898]:     </arch>
Nov 17 02:55:17 user nova-compute[74898]:     <features>
Nov 17 02:55:17 user nova-compute[74898]:       <cpuselection/>
Nov 17 02:55:17 user nova-compute[74898]:       <deviceboot/>
Nov 17 02:55:17 user nova-compute[74898]:       <disksnapshot default='on' toggle='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     </features>
Nov 17 02:55:17 user nova-compute[74898]:   </guest>
Nov 17 02:55:17 user nova-compute[74898]:   <guest>
Nov 17 02:55:17 user nova-compute[74898]:     <os_type>hvm</os_type>
Nov 17 02:55:17 user nova-compute[74898]:     <arch name='sh4eb'>
Nov 17 02:55:17 user nova-compute[74898]:       <wordsize>64</wordsize>
Nov 17 02:55:17 user nova-compute[74898]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>shix</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>r2d</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <domain type='qemu'/>
Nov 17 02:55:17 user nova-compute[74898]:     </arch>
Nov 17 02:55:17 user nova-compute[74898]:     <features>
Nov 17 02:55:17 user nova-compute[74898]:       <cpuselection/>
Nov 17 02:55:17 user nova-compute[74898]:       <deviceboot/>
Nov 17 02:55:17 user nova-compute[74898]:       <disksnapshot default='on' toggle='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     </features>
Nov 17 02:55:17 user nova-compute[74898]:   </guest>
Nov 17 02:55:17 user nova-compute[74898]:   <guest>
Nov 17 02:55:17 user nova-compute[74898]:     <os_type>hvm</os_type>
Nov 17 02:55:17 user nova-compute[74898]:     <arch name='sparc'>
Nov 17 02:55:17 user nova-compute[74898]:       <wordsize>32</wordsize>
Nov 17 02:55:17 user nova-compute[74898]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>SS-5</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>SS-20</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>LX</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>SS-4</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>SS-10</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>Voyager</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <domain type='qemu'/>
Nov 17 02:55:17 user nova-compute[74898]:     </arch>
Nov 17 02:55:17 user nova-compute[74898]:     <features>
Nov 17 02:55:17 user nova-compute[74898]:       <cpuselection/>
Nov 17 02:55:17 user nova-compute[74898]:       <deviceboot/>
Nov 17 02:55:17 user nova-compute[74898]:       <disksnapshot default='on' toggle='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     </features>
Nov 17 02:55:17 user nova-compute[74898]:   </guest>
Nov 17 02:55:17 user nova-compute[74898]:   <guest>
Nov 17 02:55:17 user nova-compute[74898]:     <os_type>hvm</os_type>
Nov 17 02:55:17 user nova-compute[74898]:     <arch name='sparc64'>
Nov 17 02:55:17 user nova-compute[74898]:       <wordsize>64</wordsize>
Nov 17 02:55:17 user nova-compute[74898]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>sun4u</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>niagara</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>sun4v</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <domain type='qemu'/>
Nov 17 02:55:17 user nova-compute[74898]:     </arch>
Nov 17 02:55:17 user nova-compute[74898]:     <features>
Nov 17 02:55:17 user nova-compute[74898]:       <cpuselection/>
Nov 17 02:55:17 user nova-compute[74898]:       <deviceboot/>
Nov 17 02:55:17 user nova-compute[74898]:       <disksnapshot default='on' toggle='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     </features>
Nov 17 02:55:17 user nova-compute[74898]:   </guest>
Nov 17 02:55:17 user nova-compute[74898]:   <guest>
Nov 17 02:55:17 user nova-compute[74898]:     <os_type>hvm</os_type>
Nov 17 02:55:17 user nova-compute[74898]:     <arch name='x86_64'>
Nov 17 02:55:17 user nova-compute[74898]:       <wordsize>64</wordsize>
Nov 17 02:55:17 user nova-compute[74898]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>x-remote</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='1'>isapc</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>microvm</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <domain type='qemu'/>
Nov 17 02:55:17 user nova-compute[74898]:       <domain type='kvm'/>
Nov 17 02:55:17 user nova-compute[74898]:     </arch>
Nov 17 02:55:17 user nova-compute[74898]:     <features>
Nov 17 02:55:17 user nova-compute[74898]:       <acpi default='on' toggle='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:       <apic default='on' toggle='no'/>
Nov 17 02:55:17 user nova-compute[74898]:       <cpuselection/>
Nov 17 02:55:17 user nova-compute[74898]:       <deviceboot/>
Nov 17 02:55:17 user nova-compute[74898]:       <disksnapshot default='on' toggle='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     </features>
Nov 17 02:55:17 user nova-compute[74898]:   </guest>
Nov 17 02:55:17 user nova-compute[74898]:   <guest>
Nov 17 02:55:17 user nova-compute[74898]:     <os_type>hvm</os_type>
Nov 17 02:55:17 user nova-compute[74898]:     <arch name='xtensa'>
Nov 17 02:55:17 user nova-compute[74898]:       <wordsize>32</wordsize>
Nov 17 02:55:17 user nova-compute[74898]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>sim</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='32'>kc705</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='32'>ml605</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='32'>virt</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='32'>lx200</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='32'>lx60</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <domain type='qemu'/>
Nov 17 02:55:17 user nova-compute[74898]:     </arch>
Nov 17 02:55:17 user nova-compute[74898]:     <features>
Nov 17 02:55:17 user nova-compute[74898]:       <cpuselection/>
Nov 17 02:55:17 user nova-compute[74898]:       <deviceboot/>
Nov 17 02:55:17 user nova-compute[74898]:       <disksnapshot default='on' toggle='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     </features>
Nov 17 02:55:17 user nova-compute[74898]:   </guest>
Nov 17 02:55:17 user nova-compute[74898]:   <guest>
Nov 17 02:55:17 user nova-compute[74898]:     <os_type>hvm</os_type>
Nov 17 02:55:17 user nova-compute[74898]:     <arch name='xtensaeb'>
Nov 17 02:55:17 user nova-compute[74898]:       <wordsize>32</wordsize>
Nov 17 02:55:17 user nova-compute[74898]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='4'>sim</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='32'>kc705</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='32'>ml605</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='32'>virt</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='32'>lx200</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='32'>lx60</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 17 02:55:17 user nova-compute[74898]:       <domain type='qemu'/>
Nov 17 02:55:17 user nova-compute[74898]:     </arch>
Nov 17 02:55:17 user nova-compute[74898]:     <features>
Nov 17 02:55:17 user nova-compute[74898]:       <cpuselection/>
Nov 17 02:55:17 user nova-compute[74898]:       <deviceboot/>
Nov 17 02:55:17 user nova-compute[74898]:       <disksnapshot default='on' toggle='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     </features>
Nov 17 02:55:17 user nova-compute[74898]:   </guest>
Nov 17 02:55:17 user nova-compute[74898]: </capabilities>
Nov 17 02:55:17 user nova-compute[74898]: 
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74898) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74898) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74898) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74898) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74898) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74898) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74898) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74898) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74898) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74898) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74898) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu-q35', 'ubuntu', 'q35'} {{(pid=74898) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 17 02:55:17 user nova-compute[74898]: <domainCapabilities>
Nov 17 02:55:17 user nova-compute[74898]:   <path>/usr/bin/qemu-system-i386</path>
Nov 17 02:55:17 user nova-compute[74898]:   <domain>kvm</domain>
Nov 17 02:55:17 user nova-compute[74898]:   <machine>pc-i440fx-6.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:   <arch>i686</arch>
Nov 17 02:55:17 user nova-compute[74898]:   <vcpu max='255'/>
Nov 17 02:55:17 user nova-compute[74898]:   <iothreads supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:   <os supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:     <enum name='firmware'/>
Nov 17 02:55:17 user nova-compute[74898]:     <loader supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='type'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>rom</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>pflash</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='readonly'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>yes</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>no</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='secure'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>no</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </loader>
Nov 17 02:55:17 user nova-compute[74898]:   </os>
Nov 17 02:55:17 user nova-compute[74898]:   <cpu>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='host-passthrough' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='hostPassthroughMigratable'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>off</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='maximum' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='maximumMigratable'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>on</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>off</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='host-model' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <vendor>Intel</vendor>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ss'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='vmx'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='pcid'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='hypervisor'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='arat'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='tsc_adjust'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='umip'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='md-clear'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='stibp'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='arch-capabilities'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ssbd'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ibpb'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ibrs'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='amd-stibp'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='amd-ssbd'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='disable' name='erms'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='disable' name='xsaveopt'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='disable' name='lm'/>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='custom' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>qemu64</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>qemu32</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>phenom</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>pentium3</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>pentium2</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>pentium</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>n270</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>kvm64</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>kvm32</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>coreduo</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>core2duo</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>athlon</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Westmere-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Westmere</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Snowridge</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Server</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Client</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>SandyBridge</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Penryn</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G5</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G4</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G3</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G2</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G1</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Nehalem-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Nehalem</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>IvyBridge</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Icelake-Server</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC-Rome</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC-Milan</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC-IBPB</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Dhyana</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Cooperlake</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Conroe</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Cascadelake-Server</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>486</model>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:   </cpu>
Nov 17 02:55:17 user nova-compute[74898]:   <memoryBacking supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:     <enum name='sourceType'>
Nov 17 02:55:17 user nova-compute[74898]:       <value>file</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>anonymous</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>memfd</value>
Nov 17 02:55:17 user nova-compute[74898]:     </enum>
Nov 17 02:55:17 user nova-compute[74898]:   </memoryBacking>
Nov 17 02:55:17 user nova-compute[74898]:   <devices>
Nov 17 02:55:17 user nova-compute[74898]:     <disk supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='diskDevice'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>disk</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>cdrom</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>floppy</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>lun</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='bus'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>ide</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>fdc</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>scsi</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>usb</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>sata</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='model'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-non-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </disk>
Nov 17 02:55:17 user nova-compute[74898]:     <graphics supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='type'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>sdl</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>vnc</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>spice</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>egl-headless</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </graphics>
Nov 17 02:55:17 user nova-compute[74898]:     <video supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='modelType'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>vga</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>cirrus</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>vmvga</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>qxl</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>none</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>bochs</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>ramfb</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </video>
Nov 17 02:55:17 user nova-compute[74898]:     <hostdev supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='mode'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>subsystem</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='startupPolicy'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>default</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>mandatory</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>requisite</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>optional</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='subsysType'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>usb</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>pci</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>scsi</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='capsType'/>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='pciBackend'/>
Nov 17 02:55:17 user nova-compute[74898]:     </hostdev>
Nov 17 02:55:17 user nova-compute[74898]:     <rng supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='model'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-non-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='backendModel'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>random</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>egd</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>builtin</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </rng>
Nov 17 02:55:17 user nova-compute[74898]:     <filesystem supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='driverType'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>path</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>handle</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtiofs</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </filesystem>
Nov 17 02:55:17 user nova-compute[74898]:     <tpm supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='model'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>tpm-tis</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>tpm-crb</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='backendModel'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>passthrough</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>emulator</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </tpm>
Nov 17 02:55:17 user nova-compute[74898]:   </devices>
Nov 17 02:55:17 user nova-compute[74898]:   <features>
Nov 17 02:55:17 user nova-compute[74898]:     <gic supported='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     <vmcoreinfo supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <genid supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <backingStoreInput supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <backup supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <sev supported='no'/>
Nov 17 02:55:17 user nova-compute[74898]:   </features>
Nov 17 02:55:17 user nova-compute[74898]: </domainCapabilities>
Nov 17 02:55:17 user nova-compute[74898]:  {{(pid=74898) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 17 02:55:17 user nova-compute[74898]: <domainCapabilities>
Nov 17 02:55:17 user nova-compute[74898]:   <path>/usr/bin/qemu-system-i386</path>
Nov 17 02:55:17 user nova-compute[74898]:   <domain>kvm</domain>
Nov 17 02:55:17 user nova-compute[74898]:   <machine>pc-q35-jammy</machine>
Nov 17 02:55:17 user nova-compute[74898]:   <arch>i686</arch>
Nov 17 02:55:17 user nova-compute[74898]:   <vcpu max='288'/>
Nov 17 02:55:17 user nova-compute[74898]:   <iothreads supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:   <os supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:     <enum name='firmware'/>
Nov 17 02:55:17 user nova-compute[74898]:     <loader supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='type'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>rom</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>pflash</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='readonly'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>yes</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>no</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='secure'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>no</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </loader>
Nov 17 02:55:17 user nova-compute[74898]:   </os>
Nov 17 02:55:17 user nova-compute[74898]:   <cpu>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='host-passthrough' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='hostPassthroughMigratable'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>off</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='maximum' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='maximumMigratable'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>on</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>off</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='host-model' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <vendor>Intel</vendor>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ss'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='vmx'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='pcid'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='hypervisor'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='arat'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='tsc_adjust'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='umip'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='md-clear'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='stibp'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='arch-capabilities'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ssbd'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ibpb'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ibrs'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='amd-stibp'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='amd-ssbd'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='disable' name='erms'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='disable' name='xsaveopt'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='disable' name='lm'/>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='custom' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>qemu64</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>qemu32</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>phenom</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>pentium3</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>pentium2</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>pentium</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>n270</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>kvm64</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>kvm32</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>coreduo</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>core2duo</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>athlon</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Westmere-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Westmere</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Snowridge</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Server</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Client</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>SandyBridge</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Penryn</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G5</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G4</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G3</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G2</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G1</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Nehalem-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Nehalem</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>IvyBridge</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Icelake-Server</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC-Rome</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC-Milan</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC-IBPB</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Dhyana</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Cooperlake</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Conroe</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Cascadelake-Server</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>486</model>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:   </cpu>
Nov 17 02:55:17 user nova-compute[74898]:   <memoryBacking supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:     <enum name='sourceType'>
Nov 17 02:55:17 user nova-compute[74898]:       <value>file</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>anonymous</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>memfd</value>
Nov 17 02:55:17 user nova-compute[74898]:     </enum>
Nov 17 02:55:17 user nova-compute[74898]:   </memoryBacking>
Nov 17 02:55:17 user nova-compute[74898]:   <devices>
Nov 17 02:55:17 user nova-compute[74898]:     <disk supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='diskDevice'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>disk</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>cdrom</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>floppy</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>lun</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='bus'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>fdc</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>scsi</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>usb</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>sata</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='model'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-non-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </disk>
Nov 17 02:55:17 user nova-compute[74898]:     <graphics supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='type'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>sdl</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>vnc</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>spice</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>egl-headless</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </graphics>
Nov 17 02:55:17 user nova-compute[74898]:     <video supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='modelType'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>vga</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>cirrus</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>vmvga</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>qxl</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>none</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>bochs</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>ramfb</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </video>
Nov 17 02:55:17 user nova-compute[74898]:     <hostdev supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='mode'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>subsystem</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='startupPolicy'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>default</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>mandatory</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>requisite</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>optional</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='subsysType'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>usb</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>pci</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>scsi</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='capsType'/>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='pciBackend'/>
Nov 17 02:55:17 user nova-compute[74898]:     </hostdev>
Nov 17 02:55:17 user nova-compute[74898]:     <rng supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='model'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-non-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='backendModel'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>random</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>egd</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>builtin</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </rng>
Nov 17 02:55:17 user nova-compute[74898]:     <filesystem supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='driverType'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>path</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>handle</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtiofs</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </filesystem>
Nov 17 02:55:17 user nova-compute[74898]:     <tpm supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='model'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>tpm-tis</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>tpm-crb</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='backendModel'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>passthrough</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>emulator</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </tpm>
Nov 17 02:55:17 user nova-compute[74898]:   </devices>
Nov 17 02:55:17 user nova-compute[74898]:   <features>
Nov 17 02:55:17 user nova-compute[74898]:     <gic supported='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     <vmcoreinfo supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <genid supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <backingStoreInput supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <backup supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <sev supported='no'/>
Nov 17 02:55:17 user nova-compute[74898]:   </features>
Nov 17 02:55:17 user nova-compute[74898]: </domainCapabilities>
Nov 17 02:55:17 user nova-compute[74898]:  {{(pid=74898) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 17 02:55:17 user nova-compute[74898]: <domainCapabilities>
Nov 17 02:55:17 user nova-compute[74898]:   <path>/usr/bin/qemu-system-i386</path>
Nov 17 02:55:17 user nova-compute[74898]:   <domain>kvm</domain>
Nov 17 02:55:17 user nova-compute[74898]:   <machine>pc-i440fx-jammy</machine>
Nov 17 02:55:17 user nova-compute[74898]:   <arch>i686</arch>
Nov 17 02:55:17 user nova-compute[74898]:   <vcpu max='255'/>
Nov 17 02:55:17 user nova-compute[74898]:   <iothreads supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:   <os supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:     <enum name='firmware'/>
Nov 17 02:55:17 user nova-compute[74898]:     <loader supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='type'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>rom</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>pflash</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='readonly'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>yes</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>no</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='secure'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>no</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </loader>
Nov 17 02:55:17 user nova-compute[74898]:   </os>
Nov 17 02:55:17 user nova-compute[74898]:   <cpu>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='host-passthrough' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='hostPassthroughMigratable'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>off</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='maximum' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='maximumMigratable'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>on</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>off</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='host-model' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <vendor>Intel</vendor>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ss'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='vmx'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='pcid'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='hypervisor'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='arat'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='tsc_adjust'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='umip'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='md-clear'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='stibp'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='arch-capabilities'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ssbd'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ibpb'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ibrs'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='amd-stibp'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='amd-ssbd'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='disable' name='erms'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='disable' name='xsaveopt'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='disable' name='lm'/>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='custom' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>qemu64</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>qemu32</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>phenom</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>pentium3</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>pentium2</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>pentium</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>n270</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>kvm64</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>kvm32</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>coreduo</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>core2duo</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>athlon</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Westmere-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Westmere</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Snowridge</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Server</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Client</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>SandyBridge</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Penryn</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G5</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G4</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G3</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G2</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G1</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Nehalem-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Nehalem</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>IvyBridge</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Icelake-Server</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC-Rome</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC-Milan</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC-IBPB</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Dhyana</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Cooperlake</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Conroe</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Cascadelake-Server</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>486</model>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:   </cpu>
Nov 17 02:55:17 user nova-compute[74898]:   <memoryBacking supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:     <enum name='sourceType'>
Nov 17 02:55:17 user nova-compute[74898]:       <value>file</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>anonymous</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>memfd</value>
Nov 17 02:55:17 user nova-compute[74898]:     </enum>
Nov 17 02:55:17 user nova-compute[74898]:   </memoryBacking>
Nov 17 02:55:17 user nova-compute[74898]:   <devices>
Nov 17 02:55:17 user nova-compute[74898]:     <disk supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='diskDevice'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>disk</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>cdrom</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>floppy</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>lun</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='bus'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>ide</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>fdc</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>scsi</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>usb</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>sata</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='model'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-non-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </disk>
Nov 17 02:55:17 user nova-compute[74898]:     <graphics supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='type'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>sdl</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>vnc</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>spice</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>egl-headless</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </graphics>
Nov 17 02:55:17 user nova-compute[74898]:     <video supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='modelType'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>vga</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>cirrus</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>vmvga</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>qxl</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>none</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>bochs</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>ramfb</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </video>
Nov 17 02:55:17 user nova-compute[74898]:     <hostdev supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='mode'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>subsystem</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='startupPolicy'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>default</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>mandatory</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>requisite</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>optional</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='subsysType'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>usb</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>pci</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>scsi</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='capsType'/>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='pciBackend'/>
Nov 17 02:55:17 user nova-compute[74898]:     </hostdev>
Nov 17 02:55:17 user nova-compute[74898]:     <rng supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='model'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-non-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='backendModel'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>random</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>egd</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>builtin</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </rng>
Nov 17 02:55:17 user nova-compute[74898]:     <filesystem supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='driverType'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>path</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>handle</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtiofs</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </filesystem>
Nov 17 02:55:17 user nova-compute[74898]:     <tpm supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='model'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>tpm-tis</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>tpm-crb</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='backendModel'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>passthrough</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>emulator</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </tpm>
Nov 17 02:55:17 user nova-compute[74898]:   </devices>
Nov 17 02:55:17 user nova-compute[74898]:   <features>
Nov 17 02:55:17 user nova-compute[74898]:     <gic supported='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     <vmcoreinfo supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <genid supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <backingStoreInput supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <backup supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <sev supported='no'/>
Nov 17 02:55:17 user nova-compute[74898]:   </features>
Nov 17 02:55:17 user nova-compute[74898]: </domainCapabilities>
Nov 17 02:55:17 user nova-compute[74898]:  {{(pid=74898) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 17 02:55:17 user nova-compute[74898]: <domainCapabilities>
Nov 17 02:55:17 user nova-compute[74898]:   <path>/usr/bin/qemu-system-i386</path>
Nov 17 02:55:17 user nova-compute[74898]:   <domain>kvm</domain>
Nov 17 02:55:17 user nova-compute[74898]:   <machine>pc-q35-6.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:   <arch>i686</arch>
Nov 17 02:55:17 user nova-compute[74898]:   <vcpu max='288'/>
Nov 17 02:55:17 user nova-compute[74898]:   <iothreads supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:   <os supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:     <enum name='firmware'/>
Nov 17 02:55:17 user nova-compute[74898]:     <loader supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='type'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>rom</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>pflash</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='readonly'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>yes</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>no</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='secure'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>no</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </loader>
Nov 17 02:55:17 user nova-compute[74898]:   </os>
Nov 17 02:55:17 user nova-compute[74898]:   <cpu>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='host-passthrough' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='hostPassthroughMigratable'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>off</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='maximum' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='maximumMigratable'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>on</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>off</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='host-model' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <vendor>Intel</vendor>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ss'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='vmx'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='pcid'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='hypervisor'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='arat'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='tsc_adjust'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='umip'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='md-clear'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='stibp'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='arch-capabilities'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ssbd'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ibpb'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ibrs'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='amd-stibp'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='amd-ssbd'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='disable' name='erms'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='disable' name='xsaveopt'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='disable' name='lm'/>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='custom' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>qemu64</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>qemu32</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>phenom</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>pentium3</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>pentium2</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>pentium</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>n270</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>kvm64</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>kvm32</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>coreduo</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>core2duo</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>athlon</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Westmere-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Westmere</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Snowridge</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Server</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Client</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>SandyBridge</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Penryn</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G5</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G4</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G3</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G2</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G1</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Nehalem-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Nehalem</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>IvyBridge</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Icelake-Server</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC-Rome</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC-Milan</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC-IBPB</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Dhyana</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Cooperlake</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Conroe</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Cascadelake-Server</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>486</model>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:   </cpu>
Nov 17 02:55:17 user nova-compute[74898]:   <memoryBacking supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:     <enum name='sourceType'>
Nov 17 02:55:17 user nova-compute[74898]:       <value>file</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>anonymous</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>memfd</value>
Nov 17 02:55:17 user nova-compute[74898]:     </enum>
Nov 17 02:55:17 user nova-compute[74898]:   </memoryBacking>
Nov 17 02:55:17 user nova-compute[74898]:   <devices>
Nov 17 02:55:17 user nova-compute[74898]:     <disk supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='diskDevice'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>disk</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>cdrom</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>floppy</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>lun</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='bus'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>fdc</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>scsi</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>usb</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>sata</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='model'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-non-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </disk>
Nov 17 02:55:17 user nova-compute[74898]:     <graphics supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='type'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>sdl</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>vnc</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>spice</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>egl-headless</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </graphics>
Nov 17 02:55:17 user nova-compute[74898]:     <video supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='modelType'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>vga</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>cirrus</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>vmvga</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>qxl</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>none</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>bochs</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>ramfb</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </video>
Nov 17 02:55:17 user nova-compute[74898]:     <hostdev supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='mode'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>subsystem</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='startupPolicy'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>default</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>mandatory</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>requisite</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>optional</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='subsysType'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>usb</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>pci</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>scsi</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='capsType'/>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='pciBackend'/>
Nov 17 02:55:17 user nova-compute[74898]:     </hostdev>
Nov 17 02:55:17 user nova-compute[74898]:     <rng supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='model'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-non-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='backendModel'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>random</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>egd</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>builtin</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </rng>
Nov 17 02:55:17 user nova-compute[74898]:     <filesystem supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='driverType'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>path</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>handle</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtiofs</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </filesystem>
Nov 17 02:55:17 user nova-compute[74898]:     <tpm supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='model'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>tpm-tis</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>tpm-crb</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='backendModel'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>passthrough</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>emulator</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </tpm>
Nov 17 02:55:17 user nova-compute[74898]:   </devices>
Nov 17 02:55:17 user nova-compute[74898]:   <features>
Nov 17 02:55:17 user nova-compute[74898]:     <gic supported='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     <vmcoreinfo supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <genid supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <backingStoreInput supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <backup supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <sev supported='no'/>
Nov 17 02:55:17 user nova-compute[74898]:   </features>
Nov 17 02:55:17 user nova-compute[74898]: </domainCapabilities>
Nov 17 02:55:17 user nova-compute[74898]:  {{(pid=74898) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74898) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74898) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74898) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74898) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74898) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74898) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74898) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74898) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74898) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74898) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74898) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74898) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74898) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74898) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74898) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74898) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74898) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=74898) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74898) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74898) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74898) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74898) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74898) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74898) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74898) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74898) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74898) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74898) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74898) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74898) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74898) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74898) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74898) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74898) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74898) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74898) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74898) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74898) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu-q35', 'ubuntu', 'q35'} {{(pid=74898) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 17 02:55:17 user nova-compute[74898]: <domainCapabilities>
Nov 17 02:55:17 user nova-compute[74898]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 17 02:55:17 user nova-compute[74898]:   <domain>kvm</domain>
Nov 17 02:55:17 user nova-compute[74898]:   <machine>pc-i440fx-6.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:   <arch>x86_64</arch>
Nov 17 02:55:17 user nova-compute[74898]:   <vcpu max='255'/>
Nov 17 02:55:17 user nova-compute[74898]:   <iothreads supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:   <os supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:     <enum name='firmware'>
Nov 17 02:55:17 user nova-compute[74898]:       <value>efi</value>
Nov 17 02:55:17 user nova-compute[74898]:     </enum>
Nov 17 02:55:17 user nova-compute[74898]:     <loader supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='type'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>rom</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>pflash</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='readonly'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>yes</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>no</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='secure'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>no</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </loader>
Nov 17 02:55:17 user nova-compute[74898]:   </os>
Nov 17 02:55:17 user nova-compute[74898]:   <cpu>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='host-passthrough' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='hostPassthroughMigratable'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>on</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>off</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='maximum' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='maximumMigratable'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>on</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>off</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='host-model' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <vendor>Intel</vendor>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ss'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='vmx'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='pcid'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='hypervisor'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='arat'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='tsc_adjust'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='umip'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='md-clear'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='stibp'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='arch-capabilities'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ssbd'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='invtsc'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ibpb'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ibrs'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='amd-stibp'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='amd-ssbd'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='rsba'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='pschange-mc-no'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='disable' name='erms'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='disable' name='xsaveopt'/>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='custom' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>qemu64</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>qemu32</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>phenom</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>pentium3</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>pentium2</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>pentium</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>n270</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>kvm64</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>kvm32</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>coreduo</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>core2duo</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>athlon</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>Westmere-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>Westmere</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Snowridge</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Server</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Client</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>SandyBridge</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>Penryn</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G5</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G4</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G3</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G2</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>Opteron_G1</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>Nehalem</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>IvyBridge</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Icelake-Server</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC-Rome</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC-Milan</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC-IBPB</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Dhyana</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Cooperlake</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>Conroe</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Cascadelake-Server</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>486</model>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:   </cpu>
Nov 17 02:55:17 user nova-compute[74898]:   <memoryBacking supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:     <enum name='sourceType'>
Nov 17 02:55:17 user nova-compute[74898]:       <value>file</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>anonymous</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>memfd</value>
Nov 17 02:55:17 user nova-compute[74898]:     </enum>
Nov 17 02:55:17 user nova-compute[74898]:   </memoryBacking>
Nov 17 02:55:17 user nova-compute[74898]:   <devices>
Nov 17 02:55:17 user nova-compute[74898]:     <disk supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='diskDevice'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>disk</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>cdrom</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>floppy</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>lun</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='bus'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>ide</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>fdc</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>scsi</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>usb</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>sata</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='model'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-non-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </disk>
Nov 17 02:55:17 user nova-compute[74898]:     <graphics supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='type'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>sdl</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>vnc</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>spice</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>egl-headless</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </graphics>
Nov 17 02:55:17 user nova-compute[74898]:     <video supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='modelType'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>vga</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>cirrus</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>vmvga</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>qxl</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>none</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>bochs</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>ramfb</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </video>
Nov 17 02:55:17 user nova-compute[74898]:     <hostdev supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='mode'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>subsystem</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='startupPolicy'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>default</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>mandatory</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>requisite</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>optional</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='subsysType'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>usb</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>pci</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>scsi</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='capsType'/>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='pciBackend'/>
Nov 17 02:55:17 user nova-compute[74898]:     </hostdev>
Nov 17 02:55:17 user nova-compute[74898]:     <rng supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='model'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-non-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='backendModel'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>random</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>egd</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>builtin</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </rng>
Nov 17 02:55:17 user nova-compute[74898]:     <filesystem supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='driverType'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>path</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>handle</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtiofs</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </filesystem>
Nov 17 02:55:17 user nova-compute[74898]:     <tpm supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='model'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>tpm-tis</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>tpm-crb</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='backendModel'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>passthrough</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>emulator</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </tpm>
Nov 17 02:55:17 user nova-compute[74898]:   </devices>
Nov 17 02:55:17 user nova-compute[74898]:   <features>
Nov 17 02:55:17 user nova-compute[74898]:     <gic supported='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     <vmcoreinfo supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <genid supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <backingStoreInput supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <backup supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <sev supported='no'/>
Nov 17 02:55:17 user nova-compute[74898]:   </features>
Nov 17 02:55:17 user nova-compute[74898]: </domainCapabilities>
Nov 17 02:55:17 user nova-compute[74898]:  {{(pid=74898) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 17 02:55:17 user nova-compute[74898]: <domainCapabilities>
Nov 17 02:55:17 user nova-compute[74898]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 17 02:55:17 user nova-compute[74898]:   <domain>kvm</domain>
Nov 17 02:55:17 user nova-compute[74898]:   <machine>pc-q35-jammy</machine>
Nov 17 02:55:17 user nova-compute[74898]:   <arch>x86_64</arch>
Nov 17 02:55:17 user nova-compute[74898]:   <vcpu max='288'/>
Nov 17 02:55:17 user nova-compute[74898]:   <iothreads supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:   <os supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:     <enum name='firmware'>
Nov 17 02:55:17 user nova-compute[74898]:       <value>efi</value>
Nov 17 02:55:17 user nova-compute[74898]:     </enum>
Nov 17 02:55:17 user nova-compute[74898]:     <loader supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='type'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>rom</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>pflash</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='readonly'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>yes</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>no</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='secure'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>yes</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>no</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </loader>
Nov 17 02:55:17 user nova-compute[74898]:   </os>
Nov 17 02:55:17 user nova-compute[74898]:   <cpu>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='host-passthrough' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='hostPassthroughMigratable'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>on</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>off</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='maximum' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='maximumMigratable'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>on</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>off</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='host-model' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <vendor>Intel</vendor>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ss'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='vmx'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='pcid'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='hypervisor'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='arat'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='tsc_adjust'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='umip'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='md-clear'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='stibp'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='arch-capabilities'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ssbd'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='invtsc'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ibpb'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ibrs'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='amd-stibp'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='amd-ssbd'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='rsba'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='pschange-mc-no'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='disable' name='erms'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='disable' name='xsaveopt'/>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='custom' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>qemu64</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>qemu32</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>phenom</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>pentium3</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>pentium2</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>pentium</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>n270</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>kvm64</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>kvm32</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>coreduo</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>core2duo</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>athlon</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>Westmere-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>Westmere</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Snowridge</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Server</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Client</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>SandyBridge</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>Penryn</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G5</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G4</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G3</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G2</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>Opteron_G1</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>Nehalem</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>IvyBridge</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Icelake-Server</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC-Rome</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC-Milan</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC-IBPB</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Dhyana</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Cooperlake</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>Conroe</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Cascadelake-Server</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>486</model>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:   </cpu>
Nov 17 02:55:17 user nova-compute[74898]:   <memoryBacking supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:     <enum name='sourceType'>
Nov 17 02:55:17 user nova-compute[74898]:       <value>file</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>anonymous</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>memfd</value>
Nov 17 02:55:17 user nova-compute[74898]:     </enum>
Nov 17 02:55:17 user nova-compute[74898]:   </memoryBacking>
Nov 17 02:55:17 user nova-compute[74898]:   <devices>
Nov 17 02:55:17 user nova-compute[74898]:     <disk supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='diskDevice'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>disk</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>cdrom</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>floppy</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>lun</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='bus'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>fdc</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>scsi</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>usb</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>sata</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='model'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-non-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </disk>
Nov 17 02:55:17 user nova-compute[74898]:     <graphics supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='type'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>sdl</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>vnc</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>spice</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>egl-headless</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </graphics>
Nov 17 02:55:17 user nova-compute[74898]:     <video supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='modelType'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>vga</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>cirrus</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>vmvga</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>qxl</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>none</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>bochs</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>ramfb</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </video>
Nov 17 02:55:17 user nova-compute[74898]:     <hostdev supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='mode'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>subsystem</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='startupPolicy'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>default</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>mandatory</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>requisite</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>optional</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='subsysType'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>usb</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>pci</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>scsi</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='capsType'/>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='pciBackend'/>
Nov 17 02:55:17 user nova-compute[74898]:     </hostdev>
Nov 17 02:55:17 user nova-compute[74898]:     <rng supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='model'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-non-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='backendModel'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>random</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>egd</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>builtin</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </rng>
Nov 17 02:55:17 user nova-compute[74898]:     <filesystem supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='driverType'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>path</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>handle</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtiofs</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </filesystem>
Nov 17 02:55:17 user nova-compute[74898]:     <tpm supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='model'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>tpm-tis</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>tpm-crb</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='backendModel'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>passthrough</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>emulator</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </tpm>
Nov 17 02:55:17 user nova-compute[74898]:   </devices>
Nov 17 02:55:17 user nova-compute[74898]:   <features>
Nov 17 02:55:17 user nova-compute[74898]:     <gic supported='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     <vmcoreinfo supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <genid supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <backingStoreInput supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <backup supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <sev supported='no'/>
Nov 17 02:55:17 user nova-compute[74898]:   </features>
Nov 17 02:55:17 user nova-compute[74898]: </domainCapabilities>
Nov 17 02:55:17 user nova-compute[74898]:  {{(pid=74898) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 17 02:55:17 user nova-compute[74898]: <domainCapabilities>
Nov 17 02:55:17 user nova-compute[74898]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 17 02:55:17 user nova-compute[74898]:   <domain>kvm</domain>
Nov 17 02:55:17 user nova-compute[74898]:   <machine>pc-i440fx-jammy</machine>
Nov 17 02:55:17 user nova-compute[74898]:   <arch>x86_64</arch>
Nov 17 02:55:17 user nova-compute[74898]:   <vcpu max='255'/>
Nov 17 02:55:17 user nova-compute[74898]:   <iothreads supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:   <os supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:     <enum name='firmware'>
Nov 17 02:55:17 user nova-compute[74898]:       <value>efi</value>
Nov 17 02:55:17 user nova-compute[74898]:     </enum>
Nov 17 02:55:17 user nova-compute[74898]:     <loader supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='type'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>rom</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>pflash</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='readonly'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>yes</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>no</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='secure'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>no</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </loader>
Nov 17 02:55:17 user nova-compute[74898]:   </os>
Nov 17 02:55:17 user nova-compute[74898]:   <cpu>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='host-passthrough' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='hostPassthroughMigratable'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>on</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>off</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='maximum' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='maximumMigratable'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>on</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>off</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='host-model' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <vendor>Intel</vendor>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ss'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='vmx'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='pcid'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='hypervisor'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='arat'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='tsc_adjust'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='umip'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='md-clear'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='stibp'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='arch-capabilities'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ssbd'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='invtsc'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ibpb'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ibrs'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='amd-stibp'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='amd-ssbd'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='rsba'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='pschange-mc-no'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='disable' name='erms'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='disable' name='xsaveopt'/>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='custom' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>qemu64</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>qemu32</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>phenom</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>pentium3</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>pentium2</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>pentium</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>n270</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>kvm64</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>kvm32</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>coreduo</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>core2duo</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>athlon</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>Westmere-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>Westmere</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Snowridge</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Server</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Client</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>SandyBridge</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>Penryn</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G5</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G4</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G3</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G2</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>Opteron_G1</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>Nehalem</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>IvyBridge</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Icelake-Server</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC-Rome</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC-Milan</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC-IBPB</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Dhyana</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Cooperlake</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>Conroe</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Cascadelake-Server</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>486</model>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:   </cpu>
Nov 17 02:55:17 user nova-compute[74898]:   <memoryBacking supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:     <enum name='sourceType'>
Nov 17 02:55:17 user nova-compute[74898]:       <value>file</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>anonymous</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>memfd</value>
Nov 17 02:55:17 user nova-compute[74898]:     </enum>
Nov 17 02:55:17 user nova-compute[74898]:   </memoryBacking>
Nov 17 02:55:17 user nova-compute[74898]:   <devices>
Nov 17 02:55:17 user nova-compute[74898]:     <disk supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='diskDevice'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>disk</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>cdrom</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>floppy</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>lun</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='bus'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>ide</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>fdc</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>scsi</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>usb</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>sata</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='model'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-non-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </disk>
Nov 17 02:55:17 user nova-compute[74898]:     <graphics supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='type'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>sdl</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>vnc</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>spice</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>egl-headless</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </graphics>
Nov 17 02:55:17 user nova-compute[74898]:     <video supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='modelType'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>vga</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>cirrus</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>vmvga</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>qxl</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>none</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>bochs</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>ramfb</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </video>
Nov 17 02:55:17 user nova-compute[74898]:     <hostdev supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='mode'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>subsystem</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='startupPolicy'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>default</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>mandatory</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>requisite</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>optional</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='subsysType'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>usb</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>pci</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>scsi</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='capsType'/>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='pciBackend'/>
Nov 17 02:55:17 user nova-compute[74898]:     </hostdev>
Nov 17 02:55:17 user nova-compute[74898]:     <rng supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='model'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-non-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='backendModel'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>random</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>egd</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>builtin</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </rng>
Nov 17 02:55:17 user nova-compute[74898]:     <filesystem supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='driverType'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>path</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>handle</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtiofs</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </filesystem>
Nov 17 02:55:17 user nova-compute[74898]:     <tpm supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='model'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>tpm-tis</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>tpm-crb</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='backendModel'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>passthrough</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>emulator</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </tpm>
Nov 17 02:55:17 user nova-compute[74898]:   </devices>
Nov 17 02:55:17 user nova-compute[74898]:   <features>
Nov 17 02:55:17 user nova-compute[74898]:     <gic supported='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     <vmcoreinfo supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <genid supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <backingStoreInput supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <backup supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <sev supported='no'/>
Nov 17 02:55:17 user nova-compute[74898]:   </features>
Nov 17 02:55:17 user nova-compute[74898]: </domainCapabilities>
Nov 17 02:55:17 user nova-compute[74898]:  {{(pid=74898) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 17 02:55:17 user nova-compute[74898]: <domainCapabilities>
Nov 17 02:55:17 user nova-compute[74898]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 17 02:55:17 user nova-compute[74898]:   <domain>kvm</domain>
Nov 17 02:55:17 user nova-compute[74898]:   <machine>pc-q35-6.2</machine>
Nov 17 02:55:17 user nova-compute[74898]:   <arch>x86_64</arch>
Nov 17 02:55:17 user nova-compute[74898]:   <vcpu max='288'/>
Nov 17 02:55:17 user nova-compute[74898]:   <iothreads supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:   <os supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:     <enum name='firmware'>
Nov 17 02:55:17 user nova-compute[74898]:       <value>efi</value>
Nov 17 02:55:17 user nova-compute[74898]:     </enum>
Nov 17 02:55:17 user nova-compute[74898]:     <loader supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='type'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>rom</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>pflash</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='readonly'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>yes</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>no</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='secure'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>yes</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>no</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </loader>
Nov 17 02:55:17 user nova-compute[74898]:   </os>
Nov 17 02:55:17 user nova-compute[74898]:   <cpu>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='host-passthrough' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='hostPassthroughMigratable'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>on</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>off</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='maximum' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='maximumMigratable'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>on</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>off</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='host-model' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <vendor>Intel</vendor>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ss'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='vmx'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='pcid'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='hypervisor'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='arat'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='tsc_adjust'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='umip'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='md-clear'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='stibp'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='arch-capabilities'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ssbd'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='invtsc'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ibpb'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='ibrs'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='amd-stibp'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='amd-ssbd'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='rsba'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='require' name='pschange-mc-no'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='disable' name='erms'/>
Nov 17 02:55:17 user nova-compute[74898]:       <feature policy='disable' name='xsaveopt'/>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:     <mode name='custom' supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>qemu64</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>qemu32</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>phenom</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>pentium3</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>pentium2</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>pentium</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>n270</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>kvm64</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>kvm32</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>coreduo</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>core2duo</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>athlon</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>Westmere-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>Westmere</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Snowridge</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Server</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Skylake-Client</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>SandyBridge</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>Penryn</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G5</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G4</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G3</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Opteron_G2</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>Opteron_G1</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>Nehalem</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>IvyBridge</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Icelake-Server</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Haswell</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC-Rome</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC-Milan</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC-IBPB</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>EPYC</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Dhyana</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Cooperlake</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>Conroe</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Cascadelake-Server</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell-noTSX</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell-IBRS</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='no'>Broadwell</model>
Nov 17 02:55:17 user nova-compute[74898]:       <model usable='yes'>486</model>
Nov 17 02:55:17 user nova-compute[74898]:     </mode>
Nov 17 02:55:17 user nova-compute[74898]:   </cpu>
Nov 17 02:55:17 user nova-compute[74898]:   <memoryBacking supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:     <enum name='sourceType'>
Nov 17 02:55:17 user nova-compute[74898]:       <value>file</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>anonymous</value>
Nov 17 02:55:17 user nova-compute[74898]:       <value>memfd</value>
Nov 17 02:55:17 user nova-compute[74898]:     </enum>
Nov 17 02:55:17 user nova-compute[74898]:   </memoryBacking>
Nov 17 02:55:17 user nova-compute[74898]:   <devices>
Nov 17 02:55:17 user nova-compute[74898]:     <disk supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='diskDevice'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>disk</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>cdrom</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>floppy</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>lun</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='bus'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>fdc</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>scsi</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>usb</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>sata</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='model'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-non-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </disk>
Nov 17 02:55:17 user nova-compute[74898]:     <graphics supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='type'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>sdl</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>vnc</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>spice</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>egl-headless</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </graphics>
Nov 17 02:55:17 user nova-compute[74898]:     <video supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='modelType'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>vga</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>cirrus</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>vmvga</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>qxl</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>none</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>bochs</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>ramfb</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </video>
Nov 17 02:55:17 user nova-compute[74898]:     <hostdev supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='mode'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>subsystem</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='startupPolicy'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>default</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>mandatory</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>requisite</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>optional</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='subsysType'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>usb</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>pci</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>scsi</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='capsType'/>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='pciBackend'/>
Nov 17 02:55:17 user nova-compute[74898]:     </hostdev>
Nov 17 02:55:17 user nova-compute[74898]:     <rng supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='model'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtio-non-transitional</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='backendModel'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>random</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>egd</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>builtin</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </rng>
Nov 17 02:55:17 user nova-compute[74898]:     <filesystem supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='driverType'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>path</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>handle</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>virtiofs</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </filesystem>
Nov 17 02:55:17 user nova-compute[74898]:     <tpm supported='yes'>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='model'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>tpm-tis</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>tpm-crb</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:       <enum name='backendModel'>
Nov 17 02:55:17 user nova-compute[74898]:         <value>passthrough</value>
Nov 17 02:55:17 user nova-compute[74898]:         <value>emulator</value>
Nov 17 02:55:17 user nova-compute[74898]:       </enum>
Nov 17 02:55:17 user nova-compute[74898]:     </tpm>
Nov 17 02:55:17 user nova-compute[74898]:   </devices>
Nov 17 02:55:17 user nova-compute[74898]:   <features>
Nov 17 02:55:17 user nova-compute[74898]:     <gic supported='no'/>
Nov 17 02:55:17 user nova-compute[74898]:     <vmcoreinfo supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <genid supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <backingStoreInput supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <backup supported='yes'/>
Nov 17 02:55:17 user nova-compute[74898]:     <sev supported='no'/>
Nov 17 02:55:17 user nova-compute[74898]:   </features>
Nov 17 02:55:17 user nova-compute[74898]: </domainCapabilities>
Nov 17 02:55:17 user nova-compute[74898]:  {{(pid=74898) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74898) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74898) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74898) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74898) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Checking secure boot support for host arch (x86_64) {{(pid=74898) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Checking secure boot support for host arch (x86_64) {{(pid=74898) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Checking secure boot support for host arch (x86_64) {{(pid=74898) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 17 02:55:17 user nova-compute[74898]: INFO nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Secure Boot support detected
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] cpu compare xml: <cpu match="exact">
Nov 17 02:55:17 user nova-compute[74898]:   <model>Nehalem</model>
Nov 17 02:55:17 user nova-compute[74898]: </cpu>
Nov 17 02:55:17 user nova-compute[74898]:  {{(pid=74898) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 17 02:55:17 user nova-compute[74898]: INFO nova.virt.node [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Generated node identity b743bdc9-a8bb-467c-98c8-06f1954f87df
Nov 17 02:55:17 user nova-compute[74898]: INFO nova.virt.node [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Wrote node identity b743bdc9-a8bb-467c-98c8-06f1954f87df to /opt/stack/data/nova/compute_id
Nov 17 02:55:17 user nova-compute[74898]: WARNING nova.compute.manager [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Compute nodes ['b743bdc9-a8bb-467c-98c8-06f1954f87df'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 17 02:55:17 user nova-compute[74898]: INFO nova.compute.manager [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 17 02:55:17 user nova-compute[74898]: WARNING nova.compute.manager [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 17 02:55:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 02:55:17 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:55:17 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:55:17 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Hypervisor/Node resource view: name=user free_ram=10995MB free_disk=26.330181121826172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:55:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:55:17 user nova-compute[74898]: WARNING nova.compute.resource_tracker [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] No compute node record for user:b743bdc9-a8bb-467c-98c8-06f1954f87df: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host b743bdc9-a8bb-467c-98c8-06f1954f87df could not be found.
Nov 17 02:55:18 user nova-compute[74898]: INFO nova.compute.resource_tracker [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Compute node record created for user:user with uuid: b743bdc9-a8bb-467c-98c8-06f1954f87df
Nov 17 02:55:18 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 02:55:18 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 02:55:18 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] [req-201d31df-d6f2-4eda-bdca-43266470d008] Created resource provider record via placement API for resource provider with UUID b743bdc9-a8bb-467c-98c8-06f1954f87df and name user.
Nov 17 02:55:18 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74898) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 17 02:55:18 user nova-compute[74898]: INFO nova.virt.libvirt.host [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] kernel doesn't support AMD SEV
Nov 17 02:55:18 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Updating inventory in ProviderTree for provider b743bdc9-a8bb-467c-98c8-06f1954f87df with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 17 02:55:18 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 02:55:18 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Libvirt baseline CPU <cpu>
Nov 17 02:55:18 user nova-compute[74898]:   <arch>x86_64</arch>
Nov 17 02:55:18 user nova-compute[74898]:   <model>Nehalem</model>
Nov 17 02:55:18 user nova-compute[74898]:   <vendor>Intel</vendor>
Nov 17 02:55:18 user nova-compute[74898]:   <topology sockets="6" cores="1" threads="1"/>
Nov 17 02:55:18 user nova-compute[74898]: </cpu>
Nov 17 02:55:18 user nova-compute[74898]:  {{(pid=74898) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 17 02:55:18 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Updated inventory for provider b743bdc9-a8bb-467c-98c8-06f1954f87df with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 17 02:55:18 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Updating resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df generation from 0 to 1 during operation: update_inventory {{(pid=74898) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 17 02:55:18 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Updating inventory in ProviderTree for provider b743bdc9-a8bb-467c-98c8-06f1954f87df with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 17 02:55:18 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Updating resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df generation from 1 to 2 during operation: update_traits {{(pid=74898) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 17 02:55:18 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 02:55:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.785s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:55:18 user nova-compute[74898]: DEBUG nova.service [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Creating RPC server for service compute {{(pid=74898) start /opt/stack/nova/nova/service.py:182}}
Nov 17 02:55:18 user nova-compute[74898]: DEBUG nova.service [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] Join ServiceGroup membership for this service compute {{(pid=74898) start /opt/stack/nova/nova/service.py:199}}
Nov 17 02:55:18 user nova-compute[74898]: DEBUG nova.servicegroup.drivers.db [None req-6b6f3b9a-760d-4bee-9769-c7c83fd123ec None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74898) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 17 02:56:00 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._sync_power_states {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:56:00 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:56:09 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:56:09 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:56:09 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 02:56:09 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Rebuilding the list of instances to heal {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 02:56:09 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Didn't find any instances for network info cache update. {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 17 02:56:09 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:56:09 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:56:09 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:56:09 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:56:09 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:56:09 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:56:09 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 02:56:09 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:56:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:56:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:56:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:56:09 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 02:56:10 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:56:10 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:56:10 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=10406MB free_disk=26.23389434814453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 02:56:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:56:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:56:10 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 02:56:10 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 02:56:10 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 02:56:10 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 02:56:10 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 02:56:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:57:10 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:57:10 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:57:10 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 02:57:10 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Rebuilding the list of instances to heal {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 02:57:10 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Didn't find any instances for network info cache update. {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 17 02:57:10 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:57:10 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:57:10 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:57:10 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:57:10 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:57:10 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:57:10 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 02:57:10 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:57:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:57:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:57:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:57:10 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 02:57:11 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:57:11 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:57:11 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=10351MB free_disk=26.298458099365234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 02:57:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:57:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:57:11 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 02:57:11 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 02:57:11 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 02:57:11 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 02:57:11 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 02:57:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.104s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:57:12 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:58:09 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:58:10 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:58:10 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 02:58:10 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:58:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:58:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:58:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:58:10 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 02:58:11 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:58:11 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:58:11 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=10361MB free_disk=26.05071258544922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 02:58:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:58:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:58:11 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 02:58:11 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 02:58:11 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 02:58:11 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 02:58:11 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 02:58:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.369s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:58:12 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:58:12 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 02:58:12 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Rebuilding the list of instances to heal {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 02:58:12 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Didn't find any instances for network info cache update. {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 17 02:58:12 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:58:12 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:58:12 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:58:12 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:58:12 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:59:10 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:59:10 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 02:59:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Acquiring lock "33dd1cff-39dc-4eba-ab39-c9239632cccc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lock "33dd1cff-39dc-4eba-ab39-c9239632cccc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:10 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 02:59:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:11 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 02:59:11 user nova-compute[74898]: INFO nova.compute.claims [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Claim successful on node user
Nov 17 02:59:11 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 02:59:11 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 02:59:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.269s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:11 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 02:59:11 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 02:59:11 user nova-compute[74898]: DEBUG nova.network.neutron [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 02:59:11 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 02:59:11 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 02:59:11 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 02:59:11 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 02:59:11 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Creating image(s)
Nov 17 02:59:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Acquiring lock "/opt/stack/data/nova/instances/33dd1cff-39dc-4eba-ab39-c9239632cccc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lock "/opt/stack/data/nova/instances/33dd1cff-39dc-4eba-ab39-c9239632cccc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lock "/opt/stack/data/nova/instances/33dd1cff-39dc-4eba-ab39-c9239632cccc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:11 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:59:11 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:59:11 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 02:59:11 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Rebuilding the list of instances to heal {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 02:59:11 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Skipping network cache update for instance because it is Building. {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 17 02:59:11 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Didn't find any instances for network info cache update. {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 17 02:59:11 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:59:11 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:59:12 user nova-compute[74898]: DEBUG nova.policy [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e0ef219cb36d4d68b589243315a4dc61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74586ad5235f439d8873accc42469cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 02:59:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372.part --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:12 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:59:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372.part --force-share --output=json" returned: 0 in 0.175s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:12 user nova-compute[74898]: DEBUG nova.virt.images [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] 50e5d43b-62d6-4f28-a52e-a1c6b84eb51f was qcow2, converting to raw {{(pid=74898) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 17 02:59:12 user nova-compute[74898]: DEBUG nova.privsep.utils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74898) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 02:59:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372.part /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372.converted {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:12 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 02:59:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372.part /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372.converted" returned: 0 in 0.496s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372.converted --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:13 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:59:13 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:59:13 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=9546MB free_disk=26.030635833740234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 02:59:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372.converted --force-share --output=json" returned: 0 in 0.234s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.912s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:13 user nova-compute[74898]: INFO oslo.privsep.daemon [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpbc2xqdhe/privsep.sock']
Nov 17 02:59:13 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 33dd1cff-39dc-4eba-ab39-c9239632cccc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 02:59:13 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 02:59:13 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 02:59:13 user sudo[84225]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpbc2xqdhe/privsep.sock
Nov 17 02:59:13 user sudo[84225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 17 02:59:13 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 02:59:13 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 02:59:13 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 02:59:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.430s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:14 user nova-compute[74898]: DEBUG nova.network.neutron [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Successfully created port: f42f6852-a6ae-44cd-8ece-8d0d752c714c {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 02:59:14 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:59:14 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:59:14 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:59:14 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:59:15 user sudo[84225]: pam_unix(sudo:session): session closed for user root
Nov 17 02:59:15 user nova-compute[74898]: INFO oslo.privsep.daemon [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Spawned new privsep daemon via rootwrap
Nov 17 02:59:15 user nova-compute[74898]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 17 02:59:15 user nova-compute[74898]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 17 02:59:15 user nova-compute[74898]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 17 02:59:15 user nova-compute[74898]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84228
Nov 17 02:59:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.215s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.196s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/33dd1cff-39dc-4eba-ab39-c9239632cccc/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/33dd1cff-39dc-4eba-ab39-c9239632cccc/disk 1073741824" returned: 0 in 0.050s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.186s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:16 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33dd1cff-39dc-4eba-ab39-c9239632cccc/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 02:59:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33dd1cff-39dc-4eba-ab39-c9239632cccc/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33dd1cff-39dc-4eba-ab39-c9239632cccc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:16 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Cannot resize image /opt/stack/data/nova/instances/33dd1cff-39dc-4eba-ab39-c9239632cccc/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 02:59:16 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 02:59:16 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Ensure instance console log exists: /opt/stack/data/nova/instances/33dd1cff-39dc-4eba-ab39-c9239632cccc/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 02:59:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:16 user nova-compute[74898]: DEBUG nova.network.neutron [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Successfully updated port: f42f6852-a6ae-44cd-8ece-8d0d752c714c {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 02:59:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Acquiring lock "refresh_cache-33dd1cff-39dc-4eba-ab39-c9239632cccc" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 02:59:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Acquired lock "refresh_cache-33dd1cff-39dc-4eba-ab39-c9239632cccc" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 02:59:17 user nova-compute[74898]: DEBUG nova.network.neutron [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 02:59:17 user nova-compute[74898]: DEBUG nova.network.neutron [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 02:59:17 user nova-compute[74898]: DEBUG nova.compute.manager [req-952069ed-6cce-41c6-9f5b-a51597bb7736 req-484f8f85-99f6-4521-b88e-1601fc2d36e9 service nova] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Received event network-changed-f42f6852-a6ae-44cd-8ece-8d0d752c714c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 02:59:17 user nova-compute[74898]: DEBUG nova.compute.manager [req-952069ed-6cce-41c6-9f5b-a51597bb7736 req-484f8f85-99f6-4521-b88e-1601fc2d36e9 service nova] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Refreshing instance network info cache due to event network-changed-f42f6852-a6ae-44cd-8ece-8d0d752c714c. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 02:59:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-952069ed-6cce-41c6-9f5b-a51597bb7736 req-484f8f85-99f6-4521-b88e-1601fc2d36e9 service nova] Acquiring lock "refresh_cache-33dd1cff-39dc-4eba-ab39-c9239632cccc" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 02:59:17 user nova-compute[74898]: DEBUG nova.network.neutron [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Updating instance_info_cache with network_info: [{"id": "f42f6852-a6ae-44cd-8ece-8d0d752c714c", "address": "fa:16:3e:f3:93:7f", "network": {"id": "b4d0cc21-8655-4c40-b432-138148a77dd1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1477483123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74586ad5235f439d8873accc42469cba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf42f6852-a6", "ovs_interfaceid": "f42f6852-a6ae-44cd-8ece-8d0d752c714c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Releasing lock "refresh_cache-33dd1cff-39dc-4eba-ab39-c9239632cccc" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Instance network_info: |[{"id": "f42f6852-a6ae-44cd-8ece-8d0d752c714c", "address": "fa:16:3e:f3:93:7f", "network": {"id": "b4d0cc21-8655-4c40-b432-138148a77dd1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1477483123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74586ad5235f439d8873accc42469cba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf42f6852-a6", "ovs_interfaceid": "f42f6852-a6ae-44cd-8ece-8d0d752c714c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-952069ed-6cce-41c6-9f5b-a51597bb7736 req-484f8f85-99f6-4521-b88e-1601fc2d36e9 service nova] Acquired lock "refresh_cache-33dd1cff-39dc-4eba-ab39-c9239632cccc" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG nova.network.neutron [req-952069ed-6cce-41c6-9f5b-a51597bb7736 req-484f8f85-99f6-4521-b88e-1601fc2d36e9 service nova] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Refreshing network info cache for port f42f6852-a6ae-44cd-8ece-8d0d752c714c {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Start _get_guest_xml network_info=[{"id": "f42f6852-a6ae-44cd-8ece-8d0d752c714c", "address": "fa:16:3e:f3:93:7f", "network": {"id": "b4d0cc21-8655-4c40-b432-138148a77dd1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1477483123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74586ad5235f439d8873accc42469cba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf42f6852-a6", "ovs_interfaceid": "f42f6852-a6ae-44cd-8ece-8d0d752c714c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 02:59:18 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:59:18 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:59:18 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG nova.privsep.utils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74898) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:59:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1612996313',display_name='tempest-DeleteServersTestJSON-server-1612996313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1612996313',id=1,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74586ad5235f439d8873accc42469cba',ramdisk_id='',reservation_id='r-4yd3k1dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1376179717',owner_user_name='tempest-DeleteServersTestJSON-1376179717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T02:59:12Z,user_data=None,user_id='e0ef219cb36d4d68b589243315a4dc61',uuid=33dd1cff-39dc-4eba-ab39-c9239632cccc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f42f6852-a6ae-44cd-8ece-8d0d752c714c", "address": "fa:16:3e:f3:93:7f", "network": {"id": "b4d0cc21-8655-4c40-b432-138148a77dd1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1477483123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74586ad5235f439d8873accc42469cba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf42f6852-a6", "ovs_interfaceid": "f42f6852-a6ae-44cd-8ece-8d0d752c714c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Converting VIF {"id": "f42f6852-a6ae-44cd-8ece-8d0d752c714c", "address": "fa:16:3e:f3:93:7f", "network": {"id": "b4d0cc21-8655-4c40-b432-138148a77dd1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1477483123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74586ad5235f439d8873accc42469cba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf42f6852-a6", "ovs_interfaceid": "f42f6852-a6ae-44cd-8ece-8d0d752c714c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:93:7f,bridge_name='br-int',has_traffic_filtering=True,id=f42f6852-a6ae-44cd-8ece-8d0d752c714c,network=Network(b4d0cc21-8655-4c40-b432-138148a77dd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf42f6852-a6') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG nova.objects.instance [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lazy-loading 'pci_devices' on Instance uuid 33dd1cff-39dc-4eba-ab39-c9239632cccc {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] End _get_guest_xml xml=<domain type="kvm">
Nov 17 02:59:18 user nova-compute[74898]:   <uuid>33dd1cff-39dc-4eba-ab39-c9239632cccc</uuid>
Nov 17 02:59:18 user nova-compute[74898]:   <name>instance-00000001</name>
Nov 17 02:59:18 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 02:59:18 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 02:59:18 user nova-compute[74898]:   <metadata>
Nov 17 02:59:18 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 02:59:18 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 02:59:18 user nova-compute[74898]:       <nova:name>tempest-DeleteServersTestJSON-server-1612996313</nova:name>
Nov 17 02:59:18 user nova-compute[74898]:       <nova:creationTime>2023-11-17 02:59:18</nova:creationTime>
Nov 17 02:59:18 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 02:59:18 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 02:59:18 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 02:59:18 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 02:59:18 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 02:59:18 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 02:59:18 user nova-compute[74898]:       </nova:flavor>
Nov 17 02:59:18 user nova-compute[74898]:       <nova:owner>
Nov 17 02:59:18 user nova-compute[74898]:         <nova:user uuid="e0ef219cb36d4d68b589243315a4dc61">tempest-DeleteServersTestJSON-1376179717-project-member</nova:user>
Nov 17 02:59:18 user nova-compute[74898]:         <nova:project uuid="74586ad5235f439d8873accc42469cba">tempest-DeleteServersTestJSON-1376179717</nova:project>
Nov 17 02:59:18 user nova-compute[74898]:       </nova:owner>
Nov 17 02:59:18 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 02:59:18 user nova-compute[74898]:       <nova:ports>
Nov 17 02:59:18 user nova-compute[74898]:         <nova:port uuid="f42f6852-a6ae-44cd-8ece-8d0d752c714c">
Nov 17 02:59:18 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 17 02:59:18 user nova-compute[74898]:         </nova:port>
Nov 17 02:59:18 user nova-compute[74898]:       </nova:ports>
Nov 17 02:59:18 user nova-compute[74898]:     </nova:instance>
Nov 17 02:59:18 user nova-compute[74898]:   </metadata>
Nov 17 02:59:18 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 02:59:18 user nova-compute[74898]:     <system>
Nov 17 02:59:18 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 02:59:18 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 02:59:18 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 02:59:18 user nova-compute[74898]:       <entry name="serial">33dd1cff-39dc-4eba-ab39-c9239632cccc</entry>
Nov 17 02:59:18 user nova-compute[74898]:       <entry name="uuid">33dd1cff-39dc-4eba-ab39-c9239632cccc</entry>
Nov 17 02:59:18 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 02:59:18 user nova-compute[74898]:     </system>
Nov 17 02:59:18 user nova-compute[74898]:   </sysinfo>
Nov 17 02:59:18 user nova-compute[74898]:   <os>
Nov 17 02:59:18 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 02:59:18 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 02:59:18 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 02:59:18 user nova-compute[74898]:   </os>
Nov 17 02:59:18 user nova-compute[74898]:   <features>
Nov 17 02:59:18 user nova-compute[74898]:     <acpi/>
Nov 17 02:59:18 user nova-compute[74898]:     <apic/>
Nov 17 02:59:18 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 02:59:18 user nova-compute[74898]:   </features>
Nov 17 02:59:18 user nova-compute[74898]:   <clock offset="utc">
Nov 17 02:59:18 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 02:59:18 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 02:59:18 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 02:59:18 user nova-compute[74898]:   </clock>
Nov 17 02:59:18 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 02:59:18 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 02:59:18 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 02:59:18 user nova-compute[74898]:   </cpu>
Nov 17 02:59:18 user nova-compute[74898]:   <devices>
Nov 17 02:59:18 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 02:59:18 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 02:59:18 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/33dd1cff-39dc-4eba-ab39-c9239632cccc/disk"/>
Nov 17 02:59:18 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 02:59:18 user nova-compute[74898]:     </disk>
Nov 17 02:59:18 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 02:59:18 user nova-compute[74898]:       <mac address="fa:16:3e:f3:93:7f"/>
Nov 17 02:59:18 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 02:59:18 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 02:59:18 user nova-compute[74898]:       <target dev="tapf42f6852-a6"/>
Nov 17 02:59:18 user nova-compute[74898]:     </interface>
Nov 17 02:59:18 user nova-compute[74898]:     <serial type="pty">
Nov 17 02:59:18 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/33dd1cff-39dc-4eba-ab39-c9239632cccc/console.log" append="off"/>
Nov 17 02:59:18 user nova-compute[74898]:     </serial>
Nov 17 02:59:18 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 02:59:18 user nova-compute[74898]:     <video>
Nov 17 02:59:18 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 02:59:18 user nova-compute[74898]:     </video>
Nov 17 02:59:18 user nova-compute[74898]:     <rng model="virtio">
Nov 17 02:59:18 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 02:59:18 user nova-compute[74898]:     </rng>
Nov 17 02:59:18 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 02:59:18 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 02:59:18 user nova-compute[74898]:       <stats period="10"/>
Nov 17 02:59:18 user nova-compute[74898]:     </memballoon>
Nov 17 02:59:18 user nova-compute[74898]:   </devices>
Nov 17 02:59:18 user nova-compute[74898]: </domain>
Nov 17 02:59:18 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:59:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1612996313',display_name='tempest-DeleteServersTestJSON-server-1612996313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1612996313',id=1,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74586ad5235f439d8873accc42469cba',ramdisk_id='',reservation_id='r-4yd3k1dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1376179717',owner_user_name='tempest-DeleteServersTestJSON-1376179717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T02:59:12Z,user_data=None,user_id='e0ef219cb36d4d68b589243315a4dc61',uuid=33dd1cff-39dc-4eba-ab39-c9239632cccc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f42f6852-a6ae-44cd-8ece-8d0d752c714c", "address": "fa:16:3e:f3:93:7f", "network": {"id": "b4d0cc21-8655-4c40-b432-138148a77dd1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1477483123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74586ad5235f439d8873accc42469cba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf42f6852-a6", "ovs_interfaceid": "f42f6852-a6ae-44cd-8ece-8d0d752c714c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Converting VIF {"id": "f42f6852-a6ae-44cd-8ece-8d0d752c714c", "address": "fa:16:3e:f3:93:7f", "network": {"id": "b4d0cc21-8655-4c40-b432-138148a77dd1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1477483123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74586ad5235f439d8873accc42469cba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf42f6852-a6", "ovs_interfaceid": "f42f6852-a6ae-44cd-8ece-8d0d752c714c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:93:7f,bridge_name='br-int',has_traffic_filtering=True,id=f42f6852-a6ae-44cd-8ece-8d0d752c714c,network=Network(b4d0cc21-8655-4c40-b432-138148a77dd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf42f6852-a6') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG os_vif [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:93:7f,bridge_name='br-int',has_traffic_filtering=True,id=f42f6852-a6ae-44cd-8ece-8d0d752c714c,network=Network(b4d0cc21-8655-4c40-b432-138148a77dd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf42f6852-a6') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Created schema index Interface.name {{(pid=74898) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Created schema index Port.name {{(pid=74898) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Created schema index Bridge.name {{(pid=74898) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [POLLOUT] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b3b5248e-c30b-51ba-8151-c3e335347e82', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:59:18 user nova-compute[74898]: INFO oslo.privsep.daemon [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmprpqq1jbz/privsep.sock']
Nov 17 02:59:18 user sudo[84247]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmprpqq1jbz/privsep.sock
Nov 17 02:59:18 user sudo[84247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 17 02:59:19 user nova-compute[74898]: DEBUG nova.network.neutron [req-952069ed-6cce-41c6-9f5b-a51597bb7736 req-484f8f85-99f6-4521-b88e-1601fc2d36e9 service nova] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Updated VIF entry in instance network info cache for port f42f6852-a6ae-44cd-8ece-8d0d752c714c. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 02:59:19 user nova-compute[74898]: DEBUG nova.network.neutron [req-952069ed-6cce-41c6-9f5b-a51597bb7736 req-484f8f85-99f6-4521-b88e-1601fc2d36e9 service nova] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Updating instance_info_cache with network_info: [{"id": "f42f6852-a6ae-44cd-8ece-8d0d752c714c", "address": "fa:16:3e:f3:93:7f", "network": {"id": "b4d0cc21-8655-4c40-b432-138148a77dd1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1477483123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74586ad5235f439d8873accc42469cba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf42f6852-a6", "ovs_interfaceid": "f42f6852-a6ae-44cd-8ece-8d0d752c714c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 02:59:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-952069ed-6cce-41c6-9f5b-a51597bb7736 req-484f8f85-99f6-4521-b88e-1601fc2d36e9 service nova] Releasing lock "refresh_cache-33dd1cff-39dc-4eba-ab39-c9239632cccc" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 02:59:19 user sudo[84247]: pam_unix(sudo:session): session closed for user root
Nov 17 02:59:19 user nova-compute[74898]: INFO oslo.privsep.daemon [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Spawned new privsep daemon via rootwrap
Nov 17 02:59:19 user nova-compute[74898]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 17 02:59:19 user nova-compute[74898]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 17 02:59:19 user nova-compute[74898]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 17 02:59:19 user nova-compute[74898]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84250
Nov 17 02:59:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf42f6852-a6, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf42f6852-a6, col_values=(('qos', UUID('eafaa5af-c83e-4b64-94dc-599ef3025455')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf42f6852-a6, col_values=(('external_ids', {'iface-id': 'f42f6852-a6ae-44cd-8ece-8d0d752c714c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:93:7f', 'vm-uuid': '33dd1cff-39dc-4eba-ab39-c9239632cccc'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:59:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:20 user nova-compute[74898]: INFO os_vif [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:93:7f,bridge_name='br-int',has_traffic_filtering=True,id=f42f6852-a6ae-44cd-8ece-8d0d752c714c,network=Network(b4d0cc21-8655-4c40-b432-138148a77dd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf42f6852-a6')
Nov 17 02:59:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 02:59:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] No VIF found with MAC fa:16:3e:f3:93:7f, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 02:59:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:21 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 02:59:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:21 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 02:59:21 user nova-compute[74898]: INFO nova.compute.claims [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Claim successful on node user
Nov 17 02:59:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:21 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 02:59:21 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 02:59:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:21 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 02:59:21 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 02:59:21 user nova-compute[74898]: DEBUG nova.network.neutron [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 02:59:22 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 02:59:22 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 02:59:22 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 02:59:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 02:59:22 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Creating image(s)
Nov 17 02:59:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "/opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "/opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:22 user nova-compute[74898]: DEBUG nova.policy [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '303dca207b5f4da297e8ab1fc41ff466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ccd434df9e458f80e5524c5c4c7a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 02:59:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.181s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.165s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk 1073741824" returned: 0 in 0.053s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquiring lock "11704034-7afe-475c-ae43-1324b40f0d92" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "11704034-7afe-475c-ae43-1324b40f0d92" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:22 user nova-compute[74898]: DEBUG nova.compute.manager [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 02:59:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.167s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:22 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 02:59:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "e733574a-56ba-4e24-babd-855bcb5bda61" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "e733574a-56ba-4e24-babd-855bcb5bda61" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:22 user nova-compute[74898]: DEBUG nova.compute.manager [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 02:59:22 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 02:59:22 user nova-compute[74898]: INFO nova.compute.claims [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Claim successful on node user
Nov 17 02:59:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Cannot resize image /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Ensure instance console log exists: /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG nova.compute.manager [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.228s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 02:59:23 user nova-compute[74898]: INFO nova.compute.claims [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Claim successful on node user
Nov 17 02:59:23 user nova-compute[74898]: DEBUG nova.compute.manager [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG nova.network.neutron [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 02:59:23 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 02:59:23 user nova-compute[74898]: DEBUG nova.compute.manager [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG nova.compute.manager [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 02:59:23 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Creating image(s)
Nov 17 02:59:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquiring lock "/opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "/opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "/opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG nova.compute.manager [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.195s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG nova.policy [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '92e234cf0f444581b2fa827b116959aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79304b161b748c4b105640273979318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG nova.compute.manager [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG nova.network.neutron [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 02:59:23 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Instance spawned successfully.
Nov 17 02:59:23 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 02:59:23 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 02:59:23 user nova-compute[74898]: DEBUG nova.compute.manager [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:23 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.222s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:24 user nova-compute[74898]: INFO nova.compute.manager [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Took 12.47 seconds to spawn the instance on the hypervisor.
Nov 17 02:59:24 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG nova.compute.manager [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 02:59:24 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Creating image(s)
Nov 17 02:59:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "/opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "/opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "/opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG nova.policy [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '303dca207b5f4da297e8ab1fc41ff466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ccd434df9e458f80e5524c5c4c7a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG nova.network.neutron [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Successfully created port: 78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk 1073741824" returned: 0 in 0.105s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.366s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.208s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:24 user nova-compute[74898]: INFO nova.compute.manager [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Took 13.42 seconds to build instance.
Nov 17 02:59:24 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a26968fe-45b9-451a-96d3-08354f0d6cf0 tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lock "33dd1cff-39dc-4eba-ab39-c9239632cccc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.642s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.303s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Cannot resize image /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Ensure instance console log exists: /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.207s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk 1073741824" returned: 0 in 0.055s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.213s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 02:59:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:25 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Cannot resize image /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 02:59:25 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 02:59:25 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Ensure instance console log exists: /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 02:59:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:26 user nova-compute[74898]: DEBUG nova.network.neutron [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Successfully created port: f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 02:59:26 user nova-compute[74898]: DEBUG nova.network.neutron [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Successfully updated port: 78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 02:59:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "refresh_cache-5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 02:59:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquired lock "refresh_cache-5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 02:59:26 user nova-compute[74898]: DEBUG nova.network.neutron [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 02:59:26 user nova-compute[74898]: DEBUG nova.network.neutron [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Successfully created port: 7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 02:59:26 user nova-compute[74898]: DEBUG nova.compute.manager [req-123637b9-11a2-468a-8639-1d1a3d7d405c req-f2a7623e-9b26-4e12-986e-150bddaa7c52 service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received event network-changed-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 02:59:26 user nova-compute[74898]: DEBUG nova.compute.manager [req-123637b9-11a2-468a-8639-1d1a3d7d405c req-f2a7623e-9b26-4e12-986e-150bddaa7c52 service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Refreshing instance network info cache due to event network-changed-78bdfbfa-3578-4ef5-b499-decd609cba62. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 02:59:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-123637b9-11a2-468a-8639-1d1a3d7d405c req-f2a7623e-9b26-4e12-986e-150bddaa7c52 service nova] Acquiring lock "refresh_cache-5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 02:59:26 user nova-compute[74898]: DEBUG nova.network.neutron [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 02:59:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Acquiring lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:27 user nova-compute[74898]: DEBUG nova.compute.manager [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 02:59:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:27 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 02:59:27 user nova-compute[74898]: INFO nova.compute.claims [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Claim successful on node user
Nov 17 02:59:27 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 02:59:27 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 02:59:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:27 user nova-compute[74898]: DEBUG nova.compute.manager [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 02:59:27 user nova-compute[74898]: DEBUG nova.compute.manager [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 02:59:27 user nova-compute[74898]: DEBUG nova.network.neutron [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 02:59:27 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 02:59:27 user nova-compute[74898]: DEBUG nova.compute.manager [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 02:59:27 user nova-compute[74898]: DEBUG nova.network.neutron [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Updating instance_info_cache with network_info: [{"id": "78bdfbfa-3578-4ef5-b499-decd609cba62", "address": "fa:16:3e:b1:55:61", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78bdfbfa-35", "ovs_interfaceid": "78bdfbfa-3578-4ef5-b499-decd609cba62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 02:59:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Releasing lock "refresh_cache-5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 02:59:27 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Instance network_info: |[{"id": "78bdfbfa-3578-4ef5-b499-decd609cba62", "address": "fa:16:3e:b1:55:61", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78bdfbfa-35", "ovs_interfaceid": "78bdfbfa-3578-4ef5-b499-decd609cba62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 02:59:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-123637b9-11a2-468a-8639-1d1a3d7d405c req-f2a7623e-9b26-4e12-986e-150bddaa7c52 service nova] Acquired lock "refresh_cache-5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 02:59:27 user nova-compute[74898]: DEBUG nova.network.neutron [req-123637b9-11a2-468a-8639-1d1a3d7d405c req-f2a7623e-9b26-4e12-986e-150bddaa7c52 service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Refreshing network info cache for port 78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 02:59:27 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Start _get_guest_xml network_info=[{"id": "78bdfbfa-3578-4ef5-b499-decd609cba62", "address": "fa:16:3e:b1:55:61", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78bdfbfa-35", "ovs_interfaceid": "78bdfbfa-3578-4ef5-b499-decd609cba62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 02:59:27 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:59:27 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:59:27 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 02:59:27 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 02:59:27 user nova-compute[74898]: DEBUG nova.compute.manager [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 02:59:27 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 02:59:27 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Creating image(s)
Nov 17 02:59:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Acquiring lock "/opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "/opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "/opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG nova.policy [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14311a1fee1548f8a3dc603cebaf42dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74014d7708574848bee4da7056ab1f09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:59:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-575888772',display_name='tempest-ServerRescueNegativeTestJSON-server-575888772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-575888772',id=2,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9ccd434df9e458f80e5524c5c4c7a1f',ramdisk_id='',reservation_id='r-cyrur8za',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1788589536',owner_user_name='tempest-ServerRescueNegativeTestJSON-1788589536-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T02:59:22Z,user_data=None,user_id='303dca207b5f4da297e8ab1fc41ff466',uuid=5b5d13c5-5d82-440a-9346-6a4c9ee63bfb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78bdfbfa-3578-4ef5-b499-decd609cba62", "address": "fa:16:3e:b1:55:61", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78bdfbfa-35", "ovs_interfaceid": "78bdfbfa-3578-4ef5-b499-decd609cba62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Converting VIF {"id": "78bdfbfa-3578-4ef5-b499-decd609cba62", "address": "fa:16:3e:b1:55:61", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78bdfbfa-35", "ovs_interfaceid": "78bdfbfa-3578-4ef5-b499-decd609cba62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:55:61,bridge_name='br-int',has_traffic_filtering=True,id=78bdfbfa-3578-4ef5-b499-decd609cba62,network=Network(c153042b-16a0-4676-b024-f4583be62f74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78bdfbfa-35') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG nova.objects.instance [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] End _get_guest_xml xml=<domain type="kvm">
Nov 17 02:59:28 user nova-compute[74898]:   <uuid>5b5d13c5-5d82-440a-9346-6a4c9ee63bfb</uuid>
Nov 17 02:59:28 user nova-compute[74898]:   <name>instance-00000002</name>
Nov 17 02:59:28 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 02:59:28 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 02:59:28 user nova-compute[74898]:   <metadata>
Nov 17 02:59:28 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 02:59:28 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 02:59:28 user nova-compute[74898]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-575888772</nova:name>
Nov 17 02:59:28 user nova-compute[74898]:       <nova:creationTime>2023-11-17 02:59:27</nova:creationTime>
Nov 17 02:59:28 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 02:59:28 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 02:59:28 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 02:59:28 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 02:59:28 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 02:59:28 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 02:59:28 user nova-compute[74898]:       </nova:flavor>
Nov 17 02:59:28 user nova-compute[74898]:       <nova:owner>
Nov 17 02:59:28 user nova-compute[74898]:         <nova:user uuid="303dca207b5f4da297e8ab1fc41ff466">tempest-ServerRescueNegativeTestJSON-1788589536-project-member</nova:user>
Nov 17 02:59:28 user nova-compute[74898]:         <nova:project uuid="f9ccd434df9e458f80e5524c5c4c7a1f">tempest-ServerRescueNegativeTestJSON-1788589536</nova:project>
Nov 17 02:59:28 user nova-compute[74898]:       </nova:owner>
Nov 17 02:59:28 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 02:59:28 user nova-compute[74898]:       <nova:ports>
Nov 17 02:59:28 user nova-compute[74898]:         <nova:port uuid="78bdfbfa-3578-4ef5-b499-decd609cba62">
Nov 17 02:59:28 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 17 02:59:28 user nova-compute[74898]:         </nova:port>
Nov 17 02:59:28 user nova-compute[74898]:       </nova:ports>
Nov 17 02:59:28 user nova-compute[74898]:     </nova:instance>
Nov 17 02:59:28 user nova-compute[74898]:   </metadata>
Nov 17 02:59:28 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 02:59:28 user nova-compute[74898]:     <system>
Nov 17 02:59:28 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 02:59:28 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 02:59:28 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 02:59:28 user nova-compute[74898]:       <entry name="serial">5b5d13c5-5d82-440a-9346-6a4c9ee63bfb</entry>
Nov 17 02:59:28 user nova-compute[74898]:       <entry name="uuid">5b5d13c5-5d82-440a-9346-6a4c9ee63bfb</entry>
Nov 17 02:59:28 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 02:59:28 user nova-compute[74898]:     </system>
Nov 17 02:59:28 user nova-compute[74898]:   </sysinfo>
Nov 17 02:59:28 user nova-compute[74898]:   <os>
Nov 17 02:59:28 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 02:59:28 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 02:59:28 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 02:59:28 user nova-compute[74898]:   </os>
Nov 17 02:59:28 user nova-compute[74898]:   <features>
Nov 17 02:59:28 user nova-compute[74898]:     <acpi/>
Nov 17 02:59:28 user nova-compute[74898]:     <apic/>
Nov 17 02:59:28 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 02:59:28 user nova-compute[74898]:   </features>
Nov 17 02:59:28 user nova-compute[74898]:   <clock offset="utc">
Nov 17 02:59:28 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 02:59:28 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 02:59:28 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 02:59:28 user nova-compute[74898]:   </clock>
Nov 17 02:59:28 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 02:59:28 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 02:59:28 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 02:59:28 user nova-compute[74898]:   </cpu>
Nov 17 02:59:28 user nova-compute[74898]:   <devices>
Nov 17 02:59:28 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 02:59:28 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 02:59:28 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk"/>
Nov 17 02:59:28 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 02:59:28 user nova-compute[74898]:     </disk>
Nov 17 02:59:28 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 02:59:28 user nova-compute[74898]:       <mac address="fa:16:3e:b1:55:61"/>
Nov 17 02:59:28 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 02:59:28 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 02:59:28 user nova-compute[74898]:       <target dev="tap78bdfbfa-35"/>
Nov 17 02:59:28 user nova-compute[74898]:     </interface>
Nov 17 02:59:28 user nova-compute[74898]:     <serial type="pty">
Nov 17 02:59:28 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/console.log" append="off"/>
Nov 17 02:59:28 user nova-compute[74898]:     </serial>
Nov 17 02:59:28 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 02:59:28 user nova-compute[74898]:     <video>
Nov 17 02:59:28 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 02:59:28 user nova-compute[74898]:     </video>
Nov 17 02:59:28 user nova-compute[74898]:     <rng model="virtio">
Nov 17 02:59:28 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 02:59:28 user nova-compute[74898]:     </rng>
Nov 17 02:59:28 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 02:59:28 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 02:59:28 user nova-compute[74898]:       <stats period="10"/>
Nov 17 02:59:28 user nova-compute[74898]:     </memballoon>
Nov 17 02:59:28 user nova-compute[74898]:   </devices>
Nov 17 02:59:28 user nova-compute[74898]: </domain>
Nov 17 02:59:28 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:59:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-575888772',display_name='tempest-ServerRescueNegativeTestJSON-server-575888772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-575888772',id=2,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9ccd434df9e458f80e5524c5c4c7a1f',ramdisk_id='',reservation_id='r-cyrur8za',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1788589536',owner_user_name='tempest-ServerRescueNegativeTestJSON-1788589536-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T02:59:22Z,user_data=None,user_id='303dca207b5f4da297e8ab1fc41ff466',uuid=5b5d13c5-5d82-440a-9346-6a4c9ee63bfb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78bdfbfa-3578-4ef5-b499-decd609cba62", "address": "fa:16:3e:b1:55:61", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78bdfbfa-35", "ovs_interfaceid": "78bdfbfa-3578-4ef5-b499-decd609cba62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Converting VIF {"id": "78bdfbfa-3578-4ef5-b499-decd609cba62", "address": "fa:16:3e:b1:55:61", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78bdfbfa-35", "ovs_interfaceid": "78bdfbfa-3578-4ef5-b499-decd609cba62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:55:61,bridge_name='br-int',has_traffic_filtering=True,id=78bdfbfa-3578-4ef5-b499-decd609cba62,network=Network(c153042b-16a0-4676-b024-f4583be62f74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78bdfbfa-35') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG os_vif [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:55:61,bridge_name='br-int',has_traffic_filtering=True,id=78bdfbfa-3578-4ef5-b499-decd609cba62,network=Network(c153042b-16a0-4676-b024-f4583be62f74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78bdfbfa-35') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '33110ea7-ca20-5f15-bc62-f893445f31be', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78bdfbfa-35, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78bdfbfa-35, col_values=(('qos', UUID('170457fc-c7ff-4026-a886-24393736dd63')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78bdfbfa-35, col_values=(('external_ids', {'iface-id': '78bdfbfa-3578-4ef5-b499-decd609cba62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:55:61', 'vm-uuid': '5b5d13c5-5d82-440a-9346-6a4c9ee63bfb'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:28 user nova-compute[74898]: INFO os_vif [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:55:61,bridge_name='br-int',has_traffic_filtering=True,id=78bdfbfa-3578-4ef5-b499-decd609cba62,network=Network(c153042b-16a0-4676-b024-f4583be62f74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78bdfbfa-35')
Nov 17 02:59:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.215s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] No VIF found with MAC fa:16:3e:b1:55:61, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.191s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk 1073741824" returned: 0 in 0.070s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.229s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Checking if we can resize image /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Cannot resize image /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Ensure instance console log exists: /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:29 user nova-compute[74898]: DEBUG nova.network.neutron [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Successfully updated port: f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 02:59:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "refresh_cache-e733574a-56ba-4e24-babd-855bcb5bda61" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 02:59:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquired lock "refresh_cache-e733574a-56ba-4e24-babd-855bcb5bda61" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 02:59:29 user nova-compute[74898]: DEBUG nova.network.neutron [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 02:59:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:29 user nova-compute[74898]: DEBUG nova.compute.manager [req-5d08702c-ed97-4e09-ad8e-7e068cc899dc req-ff325f89-43a6-47b1-9fdb-d78250945766 service nova] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Received event network-changed-f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 02:59:29 user nova-compute[74898]: DEBUG nova.compute.manager [req-5d08702c-ed97-4e09-ad8e-7e068cc899dc req-ff325f89-43a6-47b1-9fdb-d78250945766 service nova] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Refreshing instance network info cache due to event network-changed-f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 02:59:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5d08702c-ed97-4e09-ad8e-7e068cc899dc req-ff325f89-43a6-47b1-9fdb-d78250945766 service nova] Acquiring lock "refresh_cache-e733574a-56ba-4e24-babd-855bcb5bda61" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 02:59:29 user nova-compute[74898]: DEBUG nova.network.neutron [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 02:59:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:30 user nova-compute[74898]: DEBUG nova.network.neutron [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Successfully updated port: 7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 02:59:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquiring lock "refresh_cache-11704034-7afe-475c-ae43-1324b40f0d92" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 02:59:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquired lock "refresh_cache-11704034-7afe-475c-ae43-1324b40f0d92" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 02:59:30 user nova-compute[74898]: DEBUG nova.network.neutron [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 02:59:30 user nova-compute[74898]: DEBUG nova.network.neutron [req-123637b9-11a2-468a-8639-1d1a3d7d405c req-f2a7623e-9b26-4e12-986e-150bddaa7c52 service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Updated VIF entry in instance network info cache for port 78bdfbfa-3578-4ef5-b499-decd609cba62. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 02:59:30 user nova-compute[74898]: DEBUG nova.network.neutron [req-123637b9-11a2-468a-8639-1d1a3d7d405c req-f2a7623e-9b26-4e12-986e-150bddaa7c52 service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Updating instance_info_cache with network_info: [{"id": "78bdfbfa-3578-4ef5-b499-decd609cba62", "address": "fa:16:3e:b1:55:61", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78bdfbfa-35", "ovs_interfaceid": "78bdfbfa-3578-4ef5-b499-decd609cba62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 02:59:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-123637b9-11a2-468a-8639-1d1a3d7d405c req-f2a7623e-9b26-4e12-986e-150bddaa7c52 service nova] Releasing lock "refresh_cache-5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 02:59:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:30 user nova-compute[74898]: DEBUG nova.network.neutron [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 02:59:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:30 user nova-compute[74898]: DEBUG nova.compute.manager [req-ec71c715-f8ee-46e5-a989-09d38dcd3780 req-2030a13c-00d4-4a25-babb-27cfefe0824c service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received event network-changed-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 02:59:30 user nova-compute[74898]: DEBUG nova.compute.manager [req-ec71c715-f8ee-46e5-a989-09d38dcd3780 req-2030a13c-00d4-4a25-babb-27cfefe0824c service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Refreshing instance network info cache due to event network-changed-7f2d1282-0400-4c1e-890d-46a51040a8b5. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 02:59:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ec71c715-f8ee-46e5-a989-09d38dcd3780 req-2030a13c-00d4-4a25-babb-27cfefe0824c service nova] Acquiring lock "refresh_cache-11704034-7afe-475c-ae43-1324b40f0d92" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 02:59:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:30 user nova-compute[74898]: DEBUG nova.network.neutron [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Successfully created port: 9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 02:59:30 user nova-compute[74898]: DEBUG nova.network.neutron [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Updating instance_info_cache with network_info: [{"id": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "address": "fa:16:3e:8c:c0:06", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8bd92de-8e", "ovs_interfaceid": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 02:59:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Releasing lock "refresh_cache-e733574a-56ba-4e24-babd-855bcb5bda61" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 02:59:30 user nova-compute[74898]: DEBUG nova.compute.manager [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Instance network_info: |[{"id": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "address": "fa:16:3e:8c:c0:06", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8bd92de-8e", "ovs_interfaceid": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 02:59:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5d08702c-ed97-4e09-ad8e-7e068cc899dc req-ff325f89-43a6-47b1-9fdb-d78250945766 service nova] Acquired lock "refresh_cache-e733574a-56ba-4e24-babd-855bcb5bda61" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 02:59:30 user nova-compute[74898]: DEBUG nova.network.neutron [req-5d08702c-ed97-4e09-ad8e-7e068cc899dc req-ff325f89-43a6-47b1-9fdb-d78250945766 service nova] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Refreshing network info cache for port f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 02:59:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Start _get_guest_xml network_info=[{"id": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "address": "fa:16:3e:8c:c0:06", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8bd92de-8e", "ovs_interfaceid": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 02:59:31 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:59:31 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1355402387',display_name='tempest-ServerRescueNegativeTestJSON-server-1355402387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1355402387',id=3,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9ccd434df9e458f80e5524c5c4c7a1f',ramdisk_id='',reservation_id='r-pqa7cvtw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1788589536',owner_user_name='tempest-ServerRescueNegativeTestJSON-1788589536-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T02:59:24Z,user_data=None,user_id='303dca207b5f4da297e8ab1fc41ff466',uuid=e733574a-56ba-4e24-babd-855bcb5bda61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "address": "fa:16:3e:8c:c0:06", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8bd92de-8e", "ovs_interfaceid": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Converting VIF {"id": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "address": "fa:16:3e:8c:c0:06", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8bd92de-8e", "ovs_interfaceid": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:c0:06,bridge_name='br-int',has_traffic_filtering=True,id=f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75,network=Network(c153042b-16a0-4676-b024-f4583be62f74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8bd92de-8e') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.objects.instance [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lazy-loading 'pci_devices' on Instance uuid e733574a-56ba-4e24-babd-855bcb5bda61 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.network.neutron [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Updating instance_info_cache with network_info: [{"id": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "address": "fa:16:3e:98:61:d2", "network": {"id": "ff76f13f-ae63-4dd0-a219-894c6ae65c00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1502020482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b79304b161b748c4b105640273979318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d1282-04", "ovs_interfaceid": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] End _get_guest_xml xml=<domain type="kvm">
Nov 17 02:59:31 user nova-compute[74898]:   <uuid>e733574a-56ba-4e24-babd-855bcb5bda61</uuid>
Nov 17 02:59:31 user nova-compute[74898]:   <name>instance-00000003</name>
Nov 17 02:59:31 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 02:59:31 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 02:59:31 user nova-compute[74898]:   <metadata>
Nov 17 02:59:31 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 02:59:31 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 02:59:31 user nova-compute[74898]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1355402387</nova:name>
Nov 17 02:59:31 user nova-compute[74898]:       <nova:creationTime>2023-11-17 02:59:31</nova:creationTime>
Nov 17 02:59:31 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 02:59:31 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 02:59:31 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 02:59:31 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 02:59:31 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 02:59:31 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 02:59:31 user nova-compute[74898]:       </nova:flavor>
Nov 17 02:59:31 user nova-compute[74898]:       <nova:owner>
Nov 17 02:59:31 user nova-compute[74898]:         <nova:user uuid="303dca207b5f4da297e8ab1fc41ff466">tempest-ServerRescueNegativeTestJSON-1788589536-project-member</nova:user>
Nov 17 02:59:31 user nova-compute[74898]:         <nova:project uuid="f9ccd434df9e458f80e5524c5c4c7a1f">tempest-ServerRescueNegativeTestJSON-1788589536</nova:project>
Nov 17 02:59:31 user nova-compute[74898]:       </nova:owner>
Nov 17 02:59:31 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 02:59:31 user nova-compute[74898]:       <nova:ports>
Nov 17 02:59:31 user nova-compute[74898]:         <nova:port uuid="f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75">
Nov 17 02:59:31 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 17 02:59:31 user nova-compute[74898]:         </nova:port>
Nov 17 02:59:31 user nova-compute[74898]:       </nova:ports>
Nov 17 02:59:31 user nova-compute[74898]:     </nova:instance>
Nov 17 02:59:31 user nova-compute[74898]:   </metadata>
Nov 17 02:59:31 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 02:59:31 user nova-compute[74898]:     <system>
Nov 17 02:59:31 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 02:59:31 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 02:59:31 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 02:59:31 user nova-compute[74898]:       <entry name="serial">e733574a-56ba-4e24-babd-855bcb5bda61</entry>
Nov 17 02:59:31 user nova-compute[74898]:       <entry name="uuid">e733574a-56ba-4e24-babd-855bcb5bda61</entry>
Nov 17 02:59:31 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 02:59:31 user nova-compute[74898]:     </system>
Nov 17 02:59:31 user nova-compute[74898]:   </sysinfo>
Nov 17 02:59:31 user nova-compute[74898]:   <os>
Nov 17 02:59:31 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 02:59:31 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 02:59:31 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 02:59:31 user nova-compute[74898]:   </os>
Nov 17 02:59:31 user nova-compute[74898]:   <features>
Nov 17 02:59:31 user nova-compute[74898]:     <acpi/>
Nov 17 02:59:31 user nova-compute[74898]:     <apic/>
Nov 17 02:59:31 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 02:59:31 user nova-compute[74898]:   </features>
Nov 17 02:59:31 user nova-compute[74898]:   <clock offset="utc">
Nov 17 02:59:31 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 02:59:31 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 02:59:31 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 02:59:31 user nova-compute[74898]:   </clock>
Nov 17 02:59:31 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 02:59:31 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 02:59:31 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 02:59:31 user nova-compute[74898]:   </cpu>
Nov 17 02:59:31 user nova-compute[74898]:   <devices>
Nov 17 02:59:31 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 02:59:31 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 02:59:31 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk"/>
Nov 17 02:59:31 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 02:59:31 user nova-compute[74898]:     </disk>
Nov 17 02:59:31 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 02:59:31 user nova-compute[74898]:       <mac address="fa:16:3e:8c:c0:06"/>
Nov 17 02:59:31 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 02:59:31 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 02:59:31 user nova-compute[74898]:       <target dev="tapf8bd92de-8e"/>
Nov 17 02:59:31 user nova-compute[74898]:     </interface>
Nov 17 02:59:31 user nova-compute[74898]:     <serial type="pty">
Nov 17 02:59:31 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/console.log" append="off"/>
Nov 17 02:59:31 user nova-compute[74898]:     </serial>
Nov 17 02:59:31 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 02:59:31 user nova-compute[74898]:     <video>
Nov 17 02:59:31 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 02:59:31 user nova-compute[74898]:     </video>
Nov 17 02:59:31 user nova-compute[74898]:     <rng model="virtio">
Nov 17 02:59:31 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 02:59:31 user nova-compute[74898]:     </rng>
Nov 17 02:59:31 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 02:59:31 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 02:59:31 user nova-compute[74898]:       <stats period="10"/>
Nov 17 02:59:31 user nova-compute[74898]:     </memballoon>
Nov 17 02:59:31 user nova-compute[74898]:   </devices>
Nov 17 02:59:31 user nova-compute[74898]: </domain>
Nov 17 02:59:31 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1355402387',display_name='tempest-ServerRescueNegativeTestJSON-server-1355402387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1355402387',id=3,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9ccd434df9e458f80e5524c5c4c7a1f',ramdisk_id='',reservation_id='r-pqa7cvtw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1788589536',owner_user_name='tempest-ServerRescueNegativeTestJSON-1788589536-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T02:59:24Z,user_data=None,user_id='303dca207b5f4da297e8ab1fc41ff466',uuid=e733574a-56ba-4e24-babd-855bcb5bda61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "address": "fa:16:3e:8c:c0:06", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8bd92de-8e", "ovs_interfaceid": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Converting VIF {"id": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "address": "fa:16:3e:8c:c0:06", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8bd92de-8e", "ovs_interfaceid": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:c0:06,bridge_name='br-int',has_traffic_filtering=True,id=f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75,network=Network(c153042b-16a0-4676-b024-f4583be62f74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8bd92de-8e') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG os_vif [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:c0:06,bridge_name='br-int',has_traffic_filtering=True,id=f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75,network=Network(c153042b-16a0-4676-b024-f4583be62f74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8bd92de-8e') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Releasing lock "refresh_cache-11704034-7afe-475c-ae43-1324b40f0d92" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.compute.manager [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Instance network_info: |[{"id": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "address": "fa:16:3e:98:61:d2", "network": {"id": "ff76f13f-ae63-4dd0-a219-894c6ae65c00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1502020482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b79304b161b748c4b105640273979318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d1282-04", "ovs_interfaceid": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '17b768b6-81b8-5601-b708-6422c4ae6c1b', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ec71c715-f8ee-46e5-a989-09d38dcd3780 req-2030a13c-00d4-4a25-babb-27cfefe0824c service nova] Acquired lock "refresh_cache-11704034-7afe-475c-ae43-1324b40f0d92" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.network.neutron [req-ec71c715-f8ee-46e5-a989-09d38dcd3780 req-2030a13c-00d4-4a25-babb-27cfefe0824c service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Refreshing network info cache for port 7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Start _get_guest_xml network_info=[{"id": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "address": "fa:16:3e:98:61:d2", "network": {"id": "ff76f13f-ae63-4dd0-a219-894c6ae65c00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1502020482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b79304b161b748c4b105640273979318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d1282-04", "ovs_interfaceid": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8bd92de-8e, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8bd92de-8e, col_values=(('qos', UUID('99acbf7e-d268-4209-8264-b1a51cf87026')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8bd92de-8e, col_values=(('external_ids', {'iface-id': 'f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:c0:06', 'vm-uuid': 'e733574a-56ba-4e24-babd-855bcb5bda61'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:59:31 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:59:31 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:59:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:31 user nova-compute[74898]: INFO os_vif [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:c0:06,bridge_name='br-int',has_traffic_filtering=True,id=f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75,network=Network(c153042b-16a0-4676-b024-f4583be62f74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8bd92de-8e')
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2234992',display_name='tempest-ServerActionsTestOtherB-server-2234992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2234992',id=4,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDa4qtus/f7IjtzuxUsFF91hKDL1YzX3TcJUCEJl5/APKTelpFkHRN746k1MAjDCvCv80GeN8KM6dto88zEniSlfqFbxPMUk2N38IhkUm1HO5g3tqYF+QbpzM60KAg8lAA==',key_name='tempest-keypair-562322790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b79304b161b748c4b105640273979318',ramdisk_id='',reservation_id='r-p8pu7pmp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1831504115',owner_user_name='tempest-ServerActionsTestOtherB-1831504115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T02:59:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92e234cf0f444581b2fa827b116959aa',uuid=11704034-7afe-475c-ae43-1324b40f0d92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "address": "fa:16:3e:98:61:d2", "network": {"id": "ff76f13f-ae63-4dd0-a219-894c6ae65c00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1502020482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b79304b161b748c4b105640273979318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d1282-04", "ovs_interfaceid": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Converting VIF {"id": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "address": "fa:16:3e:98:61:d2", "network": {"id": "ff76f13f-ae63-4dd0-a219-894c6ae65c00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1502020482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b79304b161b748c4b105640273979318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d1282-04", "ovs_interfaceid": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:61:d2,bridge_name='br-int',has_traffic_filtering=True,id=7f2d1282-0400-4c1e-890d-46a51040a8b5,network=Network(ff76f13f-ae63-4dd0-a219-894c6ae65c00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d1282-04') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.objects.instance [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lazy-loading 'pci_devices' on Instance uuid 11704034-7afe-475c-ae43-1324b40f0d92 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] End _get_guest_xml xml=<domain type="kvm">
Nov 17 02:59:31 user nova-compute[74898]:   <uuid>11704034-7afe-475c-ae43-1324b40f0d92</uuid>
Nov 17 02:59:31 user nova-compute[74898]:   <name>instance-00000004</name>
Nov 17 02:59:31 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 02:59:31 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 02:59:31 user nova-compute[74898]:   <metadata>
Nov 17 02:59:31 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 02:59:31 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 02:59:31 user nova-compute[74898]:       <nova:name>tempest-ServerActionsTestOtherB-server-2234992</nova:name>
Nov 17 02:59:31 user nova-compute[74898]:       <nova:creationTime>2023-11-17 02:59:31</nova:creationTime>
Nov 17 02:59:31 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 02:59:31 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 02:59:31 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 02:59:31 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 02:59:31 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 02:59:31 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 02:59:31 user nova-compute[74898]:       </nova:flavor>
Nov 17 02:59:31 user nova-compute[74898]:       <nova:owner>
Nov 17 02:59:31 user nova-compute[74898]:         <nova:user uuid="92e234cf0f444581b2fa827b116959aa">tempest-ServerActionsTestOtherB-1831504115-project-member</nova:user>
Nov 17 02:59:31 user nova-compute[74898]:         <nova:project uuid="b79304b161b748c4b105640273979318">tempest-ServerActionsTestOtherB-1831504115</nova:project>
Nov 17 02:59:31 user nova-compute[74898]:       </nova:owner>
Nov 17 02:59:31 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 02:59:31 user nova-compute[74898]:       <nova:ports>
Nov 17 02:59:31 user nova-compute[74898]:         <nova:port uuid="7f2d1282-0400-4c1e-890d-46a51040a8b5">
Nov 17 02:59:31 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 17 02:59:31 user nova-compute[74898]:         </nova:port>
Nov 17 02:59:31 user nova-compute[74898]:       </nova:ports>
Nov 17 02:59:31 user nova-compute[74898]:     </nova:instance>
Nov 17 02:59:31 user nova-compute[74898]:   </metadata>
Nov 17 02:59:31 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 02:59:31 user nova-compute[74898]:     <system>
Nov 17 02:59:31 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 02:59:31 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 02:59:31 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 02:59:31 user nova-compute[74898]:       <entry name="serial">11704034-7afe-475c-ae43-1324b40f0d92</entry>
Nov 17 02:59:31 user nova-compute[74898]:       <entry name="uuid">11704034-7afe-475c-ae43-1324b40f0d92</entry>
Nov 17 02:59:31 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 02:59:31 user nova-compute[74898]:     </system>
Nov 17 02:59:31 user nova-compute[74898]:   </sysinfo>
Nov 17 02:59:31 user nova-compute[74898]:   <os>
Nov 17 02:59:31 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 02:59:31 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 02:59:31 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 02:59:31 user nova-compute[74898]:   </os>
Nov 17 02:59:31 user nova-compute[74898]:   <features>
Nov 17 02:59:31 user nova-compute[74898]:     <acpi/>
Nov 17 02:59:31 user nova-compute[74898]:     <apic/>
Nov 17 02:59:31 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 02:59:31 user nova-compute[74898]:   </features>
Nov 17 02:59:31 user nova-compute[74898]:   <clock offset="utc">
Nov 17 02:59:31 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 02:59:31 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 02:59:31 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 02:59:31 user nova-compute[74898]:   </clock>
Nov 17 02:59:31 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 02:59:31 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 02:59:31 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 02:59:31 user nova-compute[74898]:   </cpu>
Nov 17 02:59:31 user nova-compute[74898]:   <devices>
Nov 17 02:59:31 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 02:59:31 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 02:59:31 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk"/>
Nov 17 02:59:31 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 02:59:31 user nova-compute[74898]:     </disk>
Nov 17 02:59:31 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 02:59:31 user nova-compute[74898]:       <mac address="fa:16:3e:98:61:d2"/>
Nov 17 02:59:31 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 02:59:31 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 02:59:31 user nova-compute[74898]:       <target dev="tap7f2d1282-04"/>
Nov 17 02:59:31 user nova-compute[74898]:     </interface>
Nov 17 02:59:31 user nova-compute[74898]:     <serial type="pty">
Nov 17 02:59:31 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/console.log" append="off"/>
Nov 17 02:59:31 user nova-compute[74898]:     </serial>
Nov 17 02:59:31 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 02:59:31 user nova-compute[74898]:     <video>
Nov 17 02:59:31 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 02:59:31 user nova-compute[74898]:     </video>
Nov 17 02:59:31 user nova-compute[74898]:     <rng model="virtio">
Nov 17 02:59:31 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 02:59:31 user nova-compute[74898]:     </rng>
Nov 17 02:59:31 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 02:59:31 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 02:59:31 user nova-compute[74898]:       <stats period="10"/>
Nov 17 02:59:31 user nova-compute[74898]:     </memballoon>
Nov 17 02:59:31 user nova-compute[74898]:   </devices>
Nov 17 02:59:31 user nova-compute[74898]: </domain>
Nov 17 02:59:31 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2234992',display_name='tempest-ServerActionsTestOtherB-server-2234992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2234992',id=4,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDa4qtus/f7IjtzuxUsFF91hKDL1YzX3TcJUCEJl5/APKTelpFkHRN746k1MAjDCvCv80GeN8KM6dto88zEniSlfqFbxPMUk2N38IhkUm1HO5g3tqYF+QbpzM60KAg8lAA==',key_name='tempest-keypair-562322790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b79304b161b748c4b105640273979318',ramdisk_id='',reservation_id='r-p8pu7pmp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1831504115',owner_user_name='tempest-ServerActionsTestOtherB-1831504115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T02:59:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92e234cf0f444581b2fa827b116959aa',uuid=11704034-7afe-475c-ae43-1324b40f0d92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "address": "fa:16:3e:98:61:d2", "network": {"id": "ff76f13f-ae63-4dd0-a219-894c6ae65c00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1502020482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b79304b161b748c4b105640273979318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d1282-04", "ovs_interfaceid": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Converting VIF {"id": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "address": "fa:16:3e:98:61:d2", "network": {"id": "ff76f13f-ae63-4dd0-a219-894c6ae65c00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1502020482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b79304b161b748c4b105640273979318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d1282-04", "ovs_interfaceid": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:61:d2,bridge_name='br-int',has_traffic_filtering=True,id=7f2d1282-0400-4c1e-890d-46a51040a8b5,network=Network(ff76f13f-ae63-4dd0-a219-894c6ae65c00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d1282-04') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG os_vif [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:61:d2,bridge_name='br-int',has_traffic_filtering=True,id=7f2d1282-0400-4c1e-890d-46a51040a8b5,network=Network(ff76f13f-ae63-4dd0-a219-894c6ae65c00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d1282-04') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '457151b7-1d1f-509b-b2a3-45e9b9ae8a65', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f2d1282-04, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f2d1282-04, col_values=(('qos', UUID('8fdbbd17-0064-4fc4-93ac-d5280688763c')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f2d1282-04, col_values=(('external_ids', {'iface-id': '7f2d1282-0400-4c1e-890d-46a51040a8b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:61:d2', 'vm-uuid': '11704034-7afe-475c-ae43-1324b40f0d92'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] No VIF found with MAC fa:16:3e:8c:c0:06, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:31 user nova-compute[74898]: INFO os_vif [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:61:d2,bridge_name='br-int',has_traffic_filtering=True,id=7f2d1282-0400-4c1e-890d-46a51040a8b5,network=Network(ff76f13f-ae63-4dd0-a219-894c6ae65c00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d1282-04')
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 02:59:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] No VIF found with MAC fa:16:3e:98:61:d2, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 02:59:32 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 02:59:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 02:59:32 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Instance spawned successfully.
Nov 17 02:59:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 02:59:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:32 user nova-compute[74898]: INFO nova.compute.manager [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Took 10.03 seconds to spawn the instance on the hypervisor.
Nov 17 02:59:32 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 02:59:32 user nova-compute[74898]: INFO nova.compute.manager [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Took 10.99 seconds to build instance.
Nov 17 02:59:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c7913d7f-9654-4ec4-a11e-b90c8eecedb8 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.115s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:32 user nova-compute[74898]: DEBUG nova.network.neutron [req-5d08702c-ed97-4e09-ad8e-7e068cc899dc req-ff325f89-43a6-47b1-9fdb-d78250945766 service nova] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Updated VIF entry in instance network info cache for port f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 02:59:32 user nova-compute[74898]: DEBUG nova.network.neutron [req-5d08702c-ed97-4e09-ad8e-7e068cc899dc req-ff325f89-43a6-47b1-9fdb-d78250945766 service nova] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Updating instance_info_cache with network_info: [{"id": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "address": "fa:16:3e:8c:c0:06", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8bd92de-8e", "ovs_interfaceid": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 02:59:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5d08702c-ed97-4e09-ad8e-7e068cc899dc req-ff325f89-43a6-47b1-9fdb-d78250945766 service nova] Releasing lock "refresh_cache-e733574a-56ba-4e24-babd-855bcb5bda61" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 02:59:32 user nova-compute[74898]: DEBUG nova.network.neutron [req-ec71c715-f8ee-46e5-a989-09d38dcd3780 req-2030a13c-00d4-4a25-babb-27cfefe0824c service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Updated VIF entry in instance network info cache for port 7f2d1282-0400-4c1e-890d-46a51040a8b5. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 02:59:32 user nova-compute[74898]: DEBUG nova.network.neutron [req-ec71c715-f8ee-46e5-a989-09d38dcd3780 req-2030a13c-00d4-4a25-babb-27cfefe0824c service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Updating instance_info_cache with network_info: [{"id": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "address": "fa:16:3e:98:61:d2", "network": {"id": "ff76f13f-ae63-4dd0-a219-894c6ae65c00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1502020482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b79304b161b748c4b105640273979318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d1282-04", "ovs_interfaceid": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 02:59:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ec71c715-f8ee-46e5-a989-09d38dcd3780 req-2030a13c-00d4-4a25-babb-27cfefe0824c service nova] Releasing lock "refresh_cache-11704034-7afe-475c-ae43-1324b40f0d92" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 02:59:32 user nova-compute[74898]: DEBUG nova.network.neutron [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Successfully updated port: 9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 02:59:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Acquiring lock "refresh_cache-015ff42a-4d69-4f60-b86c-c6bd68d23c99" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 02:59:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Acquired lock "refresh_cache-015ff42a-4d69-4f60-b86c-c6bd68d23c99" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 02:59:32 user nova-compute[74898]: DEBUG nova.network.neutron [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.compute.manager [req-e839416e-a62b-4398-9cf0-c5263beb494d req-f2baaa32-7384-4ccf-93a9-01eea8cea14c service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Received event network-changed-9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.compute.manager [req-e839416e-a62b-4398-9cf0-c5263beb494d req-f2baaa32-7384-4ccf-93a9-01eea8cea14c service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Refreshing instance network info cache due to event network-changed-9d80c52a-1fc2-43ca-bed1-126c6b8e204f. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e839416e-a62b-4398-9cf0-c5263beb494d req-f2baaa32-7384-4ccf-93a9-01eea8cea14c service nova] Acquiring lock "refresh_cache-015ff42a-4d69-4f60-b86c-c6bd68d23c99" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.network.neutron [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.network.neutron [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Updating instance_info_cache with network_info: [{"id": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "address": "fa:16:3e:88:21:6c", "network": {"id": "bf964a06-b5fd-41c4-9dfe-5d485019bbdd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-848964430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74014d7708574848bee4da7056ab1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d80c52a-1f", "ovs_interfaceid": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Releasing lock "refresh_cache-015ff42a-4d69-4f60-b86c-c6bd68d23c99" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.compute.manager [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Instance network_info: |[{"id": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "address": "fa:16:3e:88:21:6c", "network": {"id": "bf964a06-b5fd-41c4-9dfe-5d485019bbdd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-848964430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74014d7708574848bee4da7056ab1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d80c52a-1f", "ovs_interfaceid": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e839416e-a62b-4398-9cf0-c5263beb494d req-f2baaa32-7384-4ccf-93a9-01eea8cea14c service nova] Acquired lock "refresh_cache-015ff42a-4d69-4f60-b86c-c6bd68d23c99" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.network.neutron [req-e839416e-a62b-4398-9cf0-c5263beb494d req-f2baaa32-7384-4ccf-93a9-01eea8cea14c service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Refreshing network info cache for port 9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Start _get_guest_xml network_info=[{"id": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "address": "fa:16:3e:88:21:6c", "network": {"id": "bf964a06-b5fd-41c4-9dfe-5d485019bbdd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-848964430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74014d7708574848bee4da7056ab1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d80c52a-1f", "ovs_interfaceid": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 02:59:33 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:59:33 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:59:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-79461071',display_name='tempest-ServerStableDeviceRescueTest-server-79461071',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-79461071',id=5,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3ScoMcY64cOmhLR5MRqP3FGji32oeJktiJUi4U3NwH7+yAWoEgDSQgmx/yQzS0wVqsxpjUYQDyGQwbr5p0i4LUVJlGd/b4gDnj3xIHz2RcTwm9n6DLaujAEe7PSgJ6+A==',key_name='tempest-keypair-1704675523',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74014d7708574848bee4da7056ab1f09',ramdisk_id='',reservation_id='r-75bj56av',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1390708223',owner_user_name='tempest-ServerStableDeviceRescueTest-1390708223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T02:59:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14311a1fee1548f8a3dc603cebaf42dd',uuid=015ff42a-4d69-4f60-b86c-c6bd68d23c99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "address": "fa:16:3e:88:21:6c", "network": {"id": "bf964a06-b5fd-41c4-9dfe-5d485019bbdd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-848964430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74014d7708574848bee4da7056ab1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d80c52a-1f", "ovs_interfaceid": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Converting VIF {"id": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "address": "fa:16:3e:88:21:6c", "network": {"id": "bf964a06-b5fd-41c4-9dfe-5d485019bbdd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-848964430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74014d7708574848bee4da7056ab1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d80c52a-1f", "ovs_interfaceid": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:21:6c,bridge_name='br-int',has_traffic_filtering=True,id=9d80c52a-1fc2-43ca-bed1-126c6b8e204f,network=Network(bf964a06-b5fd-41c4-9dfe-5d485019bbdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d80c52a-1f') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.objects.instance [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lazy-loading 'pci_devices' on Instance uuid 015ff42a-4d69-4f60-b86c-c6bd68d23c99 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] End _get_guest_xml xml=<domain type="kvm">
Nov 17 02:59:33 user nova-compute[74898]:   <uuid>015ff42a-4d69-4f60-b86c-c6bd68d23c99</uuid>
Nov 17 02:59:33 user nova-compute[74898]:   <name>instance-00000005</name>
Nov 17 02:59:33 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 02:59:33 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 02:59:33 user nova-compute[74898]:   <metadata>
Nov 17 02:59:33 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 02:59:33 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 02:59:33 user nova-compute[74898]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-79461071</nova:name>
Nov 17 02:59:33 user nova-compute[74898]:       <nova:creationTime>2023-11-17 02:59:33</nova:creationTime>
Nov 17 02:59:33 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 02:59:33 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 02:59:33 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 02:59:33 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 02:59:33 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 02:59:33 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 02:59:33 user nova-compute[74898]:       </nova:flavor>
Nov 17 02:59:33 user nova-compute[74898]:       <nova:owner>
Nov 17 02:59:33 user nova-compute[74898]:         <nova:user uuid="14311a1fee1548f8a3dc603cebaf42dd">tempest-ServerStableDeviceRescueTest-1390708223-project-member</nova:user>
Nov 17 02:59:33 user nova-compute[74898]:         <nova:project uuid="74014d7708574848bee4da7056ab1f09">tempest-ServerStableDeviceRescueTest-1390708223</nova:project>
Nov 17 02:59:33 user nova-compute[74898]:       </nova:owner>
Nov 17 02:59:33 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 02:59:33 user nova-compute[74898]:       <nova:ports>
Nov 17 02:59:33 user nova-compute[74898]:         <nova:port uuid="9d80c52a-1fc2-43ca-bed1-126c6b8e204f">
Nov 17 02:59:33 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 17 02:59:33 user nova-compute[74898]:         </nova:port>
Nov 17 02:59:33 user nova-compute[74898]:       </nova:ports>
Nov 17 02:59:33 user nova-compute[74898]:     </nova:instance>
Nov 17 02:59:33 user nova-compute[74898]:   </metadata>
Nov 17 02:59:33 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 02:59:33 user nova-compute[74898]:     <system>
Nov 17 02:59:33 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 02:59:33 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 02:59:33 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 02:59:33 user nova-compute[74898]:       <entry name="serial">015ff42a-4d69-4f60-b86c-c6bd68d23c99</entry>
Nov 17 02:59:33 user nova-compute[74898]:       <entry name="uuid">015ff42a-4d69-4f60-b86c-c6bd68d23c99</entry>
Nov 17 02:59:33 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 02:59:33 user nova-compute[74898]:     </system>
Nov 17 02:59:33 user nova-compute[74898]:   </sysinfo>
Nov 17 02:59:33 user nova-compute[74898]:   <os>
Nov 17 02:59:33 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 02:59:33 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 02:59:33 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 02:59:33 user nova-compute[74898]:   </os>
Nov 17 02:59:33 user nova-compute[74898]:   <features>
Nov 17 02:59:33 user nova-compute[74898]:     <acpi/>
Nov 17 02:59:33 user nova-compute[74898]:     <apic/>
Nov 17 02:59:33 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 02:59:33 user nova-compute[74898]:   </features>
Nov 17 02:59:33 user nova-compute[74898]:   <clock offset="utc">
Nov 17 02:59:33 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 02:59:33 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 02:59:33 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 02:59:33 user nova-compute[74898]:   </clock>
Nov 17 02:59:33 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 02:59:33 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 02:59:33 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 02:59:33 user nova-compute[74898]:   </cpu>
Nov 17 02:59:33 user nova-compute[74898]:   <devices>
Nov 17 02:59:33 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 02:59:33 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 02:59:33 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk"/>
Nov 17 02:59:33 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 02:59:33 user nova-compute[74898]:     </disk>
Nov 17 02:59:33 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 02:59:33 user nova-compute[74898]:       <mac address="fa:16:3e:88:21:6c"/>
Nov 17 02:59:33 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 02:59:33 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 02:59:33 user nova-compute[74898]:       <target dev="tap9d80c52a-1f"/>
Nov 17 02:59:33 user nova-compute[74898]:     </interface>
Nov 17 02:59:33 user nova-compute[74898]:     <serial type="pty">
Nov 17 02:59:33 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/console.log" append="off"/>
Nov 17 02:59:33 user nova-compute[74898]:     </serial>
Nov 17 02:59:33 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 02:59:33 user nova-compute[74898]:     <video>
Nov 17 02:59:33 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 02:59:33 user nova-compute[74898]:     </video>
Nov 17 02:59:33 user nova-compute[74898]:     <rng model="virtio">
Nov 17 02:59:33 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 02:59:33 user nova-compute[74898]:     </rng>
Nov 17 02:59:33 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 02:59:33 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 02:59:33 user nova-compute[74898]:       <stats period="10"/>
Nov 17 02:59:33 user nova-compute[74898]:     </memballoon>
Nov 17 02:59:33 user nova-compute[74898]:   </devices>
Nov 17 02:59:33 user nova-compute[74898]: </domain>
Nov 17 02:59:33 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:59:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-79461071',display_name='tempest-ServerStableDeviceRescueTest-server-79461071',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-79461071',id=5,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3ScoMcY64cOmhLR5MRqP3FGji32oeJktiJUi4U3NwH7+yAWoEgDSQgmx/yQzS0wVqsxpjUYQDyGQwbr5p0i4LUVJlGd/b4gDnj3xIHz2RcTwm9n6DLaujAEe7PSgJ6+A==',key_name='tempest-keypair-1704675523',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74014d7708574848bee4da7056ab1f09',ramdisk_id='',reservation_id='r-75bj56av',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1390708223',owner_user_name='tempest-ServerStableDeviceRescueTest-1390708223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T02:59:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14311a1fee1548f8a3dc603cebaf42dd',uuid=015ff42a-4d69-4f60-b86c-c6bd68d23c99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "address": "fa:16:3e:88:21:6c", "network": {"id": "bf964a06-b5fd-41c4-9dfe-5d485019bbdd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-848964430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74014d7708574848bee4da7056ab1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d80c52a-1f", "ovs_interfaceid": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Converting VIF {"id": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "address": "fa:16:3e:88:21:6c", "network": {"id": "bf964a06-b5fd-41c4-9dfe-5d485019bbdd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-848964430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74014d7708574848bee4da7056ab1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d80c52a-1f", "ovs_interfaceid": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:21:6c,bridge_name='br-int',has_traffic_filtering=True,id=9d80c52a-1fc2-43ca-bed1-126c6b8e204f,network=Network(bf964a06-b5fd-41c4-9dfe-5d485019bbdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d80c52a-1f') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG os_vif [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:21:6c,bridge_name='br-int',has_traffic_filtering=True,id=9d80c52a-1fc2-43ca-bed1-126c6b8e204f,network=Network(bf964a06-b5fd-41c4-9dfe-5d485019bbdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d80c52a-1f') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '950426a6-ef89-5df3-a252-e8b238164649', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d80c52a-1f, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9d80c52a-1f, col_values=(('qos', UUID('274ebe1e-8404-4236-9aff-cba67a7ae748')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9d80c52a-1f, col_values=(('external_ids', {'iface-id': '9d80c52a-1fc2-43ca-bed1-126c6b8e204f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:21:6c', 'vm-uuid': '015ff42a-4d69-4f60-b86c-c6bd68d23c99'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:33 user nova-compute[74898]: INFO os_vif [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:21:6c,bridge_name='br-int',has_traffic_filtering=True,id=9d80c52a-1fc2-43ca-bed1-126c6b8e204f,network=Network(bf964a06-b5fd-41c4-9dfe-5d485019bbdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d80c52a-1f')
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 02:59:33 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] No VIF found with MAC fa:16:3e:88:21:6c, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 02:59:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:34 user nova-compute[74898]: DEBUG nova.network.neutron [req-e839416e-a62b-4398-9cf0-c5263beb494d req-f2baaa32-7384-4ccf-93a9-01eea8cea14c service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Updated VIF entry in instance network info cache for port 9d80c52a-1fc2-43ca-bed1-126c6b8e204f. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 02:59:34 user nova-compute[74898]: DEBUG nova.network.neutron [req-e839416e-a62b-4398-9cf0-c5263beb494d req-f2baaa32-7384-4ccf-93a9-01eea8cea14c service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Updating instance_info_cache with network_info: [{"id": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "address": "fa:16:3e:88:21:6c", "network": {"id": "bf964a06-b5fd-41c4-9dfe-5d485019bbdd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-848964430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74014d7708574848bee4da7056ab1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d80c52a-1f", "ovs_interfaceid": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 02:59:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e839416e-a62b-4398-9cf0-c5263beb494d req-f2baaa32-7384-4ccf-93a9-01eea8cea14c service nova] Releasing lock "refresh_cache-015ff42a-4d69-4f60-b86c-c6bd68d23c99" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 02:59:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:39 user nova-compute[74898]: DEBUG nova.compute.manager [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 02:59:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 02:59:39 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Instance spawned successfully.
Nov 17 02:59:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 02:59:39 user nova-compute[74898]: DEBUG nova.compute.manager [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 02:59:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 02:59:39 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Instance spawned successfully.
Nov 17 02:59:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 02:59:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:39 user nova-compute[74898]: INFO nova.compute.manager [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Took 15.68 seconds to spawn the instance on the hypervisor.
Nov 17 02:59:39 user nova-compute[74898]: DEBUG nova.compute.manager [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 02:59:39 user nova-compute[74898]: INFO nova.compute.manager [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Took 15.24 seconds to spawn the instance on the hypervisor.
Nov 17 02:59:39 user nova-compute[74898]: DEBUG nova.compute.manager [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 02:59:39 user nova-compute[74898]: INFO nova.compute.manager [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Took 16.58 seconds to build instance.
Nov 17 02:59:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-beae8af0-4e63-47dc-bec5-648bbba1d39e tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "11704034-7afe-475c-ae43-1324b40f0d92" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.751s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:39 user nova-compute[74898]: INFO nova.compute.manager [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Took 16.70 seconds to build instance.
Nov 17 02:59:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-068ef3cc-a13f-4245-a09f-a6f4eebed6a3 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "e733574a-56ba-4e24-babd-855bcb5bda61" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.964s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:39 user nova-compute[74898]: DEBUG nova.compute.manager [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 02:59:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 02:59:39 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Instance spawned successfully.
Nov 17 02:59:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 02:59:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:40 user nova-compute[74898]: INFO nova.compute.manager [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Took 12.14 seconds to spawn the instance on the hypervisor.
Nov 17 02:59:40 user nova-compute[74898]: DEBUG nova.compute.manager [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 02:59:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Acquiring lock "9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:40 user nova-compute[74898]: DEBUG nova.compute.manager [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 02:59:40 user nova-compute[74898]: INFO nova.compute.manager [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Took 13.13 seconds to build instance.
Nov 17 02:59:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-eefe2adc-73c3-4d2c-8977-d7a1eec024a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.255s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:40 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 02:59:40 user nova-compute[74898]: INFO nova.compute.claims [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Claim successful on node user
Nov 17 02:59:40 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 02:59:41 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 02:59:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.742s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:41 user nova-compute[74898]: DEBUG nova.compute.manager [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 02:59:41 user nova-compute[74898]: DEBUG nova.compute.manager [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 02:59:41 user nova-compute[74898]: DEBUG nova.network.neutron [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 02:59:41 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 02:59:41 user nova-compute[74898]: DEBUG nova.compute.manager [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 02:59:41 user nova-compute[74898]: DEBUG nova.policy [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a8202cbeb204cd38b3f8daa90578dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29dfc5e055942b4af680a17e5b1de13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 02:59:41 user nova-compute[74898]: DEBUG nova.compute.manager [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 02:59:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 02:59:41 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Creating image(s)
Nov 17 02:59:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Acquiring lock "/opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "/opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "/opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.361s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Acquiring lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:42 user nova-compute[74898]: DEBUG nova.compute.manager [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 02:59:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.504s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:42 user nova-compute[74898]: DEBUG nova.compute.manager [req-d0e47029-4825-4bdc-9bf5-a060138eb3b1 req-ba0f5dcb-0077-4ea7-a5ec-4c426599847a service nova] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Received event network-vif-plugged-f42f6852-a6ae-44cd-8ece-8d0d752c714c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 02:59:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d0e47029-4825-4bdc-9bf5-a060138eb3b1 req-ba0f5dcb-0077-4ea7-a5ec-4c426599847a service nova] Acquiring lock "33dd1cff-39dc-4eba-ab39-c9239632cccc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d0e47029-4825-4bdc-9bf5-a060138eb3b1 req-ba0f5dcb-0077-4ea7-a5ec-4c426599847a service nova] Lock "33dd1cff-39dc-4eba-ab39-c9239632cccc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d0e47029-4825-4bdc-9bf5-a060138eb3b1 req-ba0f5dcb-0077-4ea7-a5ec-4c426599847a service nova] Lock "33dd1cff-39dc-4eba-ab39-c9239632cccc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:42 user nova-compute[74898]: DEBUG nova.compute.manager [req-d0e47029-4825-4bdc-9bf5-a060138eb3b1 req-ba0f5dcb-0077-4ea7-a5ec-4c426599847a service nova] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] No waiting events found dispatching network-vif-plugged-f42f6852-a6ae-44cd-8ece-8d0d752c714c {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 02:59:42 user nova-compute[74898]: WARNING nova.compute.manager [req-d0e47029-4825-4bdc-9bf5-a060138eb3b1 req-ba0f5dcb-0077-4ea7-a5ec-4c426599847a service nova] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Received unexpected event network-vif-plugged-f42f6852-a6ae-44cd-8ece-8d0d752c714c for instance with vm_state active and task_state None.
Nov 17 02:59:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk 1073741824" returned: 0 in 0.178s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.688s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:42 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 02:59:42 user nova-compute[74898]: INFO nova.compute.claims [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Claim successful on node user
Nov 17 02:59:42 user nova-compute[74898]: DEBUG nova.network.neutron [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Successfully created port: ba899c72-f082-46fe-9a32-b548a4d653e2 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 02:59:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.307s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:42 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 02:59:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:43 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 02:59:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk --force-share --output=json" returned: 0 in 0.483s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:43 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Cannot resize image /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 02:59:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 02:59:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Ensure instance console log exists: /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 02:59:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:43 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 02:59:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.692s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:43 user nova-compute[74898]: DEBUG nova.compute.manager [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 02:59:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:43 user nova-compute[74898]: DEBUG nova.compute.manager [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 02:59:43 user nova-compute[74898]: DEBUG nova.network.neutron [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 02:59:43 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 02:59:43 user nova-compute[74898]: DEBUG nova.compute.manager [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 02:59:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:43 user nova-compute[74898]: DEBUG nova.compute.manager [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 02:59:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 02:59:43 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Creating image(s)
Nov 17 02:59:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Acquiring lock "/opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "/opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "/opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:43 user nova-compute[74898]: DEBUG nova.policy [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f7c4ed2ec81a411c95b2be4dcfb9859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c45541cf5bd44c2a34d5a31f04e2a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 02:59:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.404s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:44 user nova-compute[74898]: DEBUG nova.compute.manager [req-e540a175-2462-4bae-aa5b-3d8fb182cc4f req-ffb744c3-6298-4294-a6e6-464cbad4ad3d service nova] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Received event network-vif-plugged-f42f6852-a6ae-44cd-8ece-8d0d752c714c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 02:59:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e540a175-2462-4bae-aa5b-3d8fb182cc4f req-ffb744c3-6298-4294-a6e6-464cbad4ad3d service nova] Acquiring lock "33dd1cff-39dc-4eba-ab39-c9239632cccc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e540a175-2462-4bae-aa5b-3d8fb182cc4f req-ffb744c3-6298-4294-a6e6-464cbad4ad3d service nova] Lock "33dd1cff-39dc-4eba-ab39-c9239632cccc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e540a175-2462-4bae-aa5b-3d8fb182cc4f req-ffb744c3-6298-4294-a6e6-464cbad4ad3d service nova] Lock "33dd1cff-39dc-4eba-ab39-c9239632cccc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:44 user nova-compute[74898]: DEBUG nova.compute.manager [req-e540a175-2462-4bae-aa5b-3d8fb182cc4f req-ffb744c3-6298-4294-a6e6-464cbad4ad3d service nova] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] No waiting events found dispatching network-vif-plugged-f42f6852-a6ae-44cd-8ece-8d0d752c714c {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 02:59:44 user nova-compute[74898]: WARNING nova.compute.manager [req-e540a175-2462-4bae-aa5b-3d8fb182cc4f req-ffb744c3-6298-4294-a6e6-464cbad4ad3d service nova] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Received unexpected event network-vif-plugged-f42f6852-a6ae-44cd-8ece-8d0d752c714c for instance with vm_state active and task_state None.
Nov 17 02:59:44 user nova-compute[74898]: DEBUG nova.compute.manager [req-e540a175-2462-4bae-aa5b-3d8fb182cc4f req-ffb744c3-6298-4294-a6e6-464cbad4ad3d service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received event network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 02:59:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e540a175-2462-4bae-aa5b-3d8fb182cc4f req-ffb744c3-6298-4294-a6e6-464cbad4ad3d service nova] Acquiring lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e540a175-2462-4bae-aa5b-3d8fb182cc4f req-ffb744c3-6298-4294-a6e6-464cbad4ad3d service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e540a175-2462-4bae-aa5b-3d8fb182cc4f req-ffb744c3-6298-4294-a6e6-464cbad4ad3d service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:44 user nova-compute[74898]: DEBUG nova.compute.manager [req-e540a175-2462-4bae-aa5b-3d8fb182cc4f req-ffb744c3-6298-4294-a6e6-464cbad4ad3d service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] No waiting events found dispatching network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 02:59:44 user nova-compute[74898]: WARNING nova.compute.manager [req-e540a175-2462-4bae-aa5b-3d8fb182cc4f req-ffb744c3-6298-4294-a6e6-464cbad4ad3d service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received unexpected event network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 for instance with vm_state active and task_state None.
Nov 17 02:59:44 user nova-compute[74898]: DEBUG nova.compute.manager [req-e540a175-2462-4bae-aa5b-3d8fb182cc4f req-ffb744c3-6298-4294-a6e6-464cbad4ad3d service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received event network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 02:59:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e540a175-2462-4bae-aa5b-3d8fb182cc4f req-ffb744c3-6298-4294-a6e6-464cbad4ad3d service nova] Acquiring lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e540a175-2462-4bae-aa5b-3d8fb182cc4f req-ffb744c3-6298-4294-a6e6-464cbad4ad3d service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e540a175-2462-4bae-aa5b-3d8fb182cc4f req-ffb744c3-6298-4294-a6e6-464cbad4ad3d service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:44 user nova-compute[74898]: DEBUG nova.compute.manager [req-e540a175-2462-4bae-aa5b-3d8fb182cc4f req-ffb744c3-6298-4294-a6e6-464cbad4ad3d service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] No waiting events found dispatching network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 02:59:44 user nova-compute[74898]: WARNING nova.compute.manager [req-e540a175-2462-4bae-aa5b-3d8fb182cc4f req-ffb744c3-6298-4294-a6e6-464cbad4ad3d service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received unexpected event network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 for instance with vm_state active and task_state None.
Nov 17 02:59:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.279s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk 1073741824" returned: 0 in 0.080s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.367s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.284s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:45 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 02:59:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:45 user nova-compute[74898]: DEBUG nova.network.neutron [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Successfully updated port: ba899c72-f082-46fe-9a32-b548a4d653e2 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 02:59:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk --force-share --output=json" returned: 0 in 0.303s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:45 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Cannot resize image /opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 02:59:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 02:59:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Ensure instance console log exists: /opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 02:59:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Acquiring lock "refresh_cache-9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 02:59:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Acquired lock "refresh_cache-9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 02:59:45 user nova-compute[74898]: DEBUG nova.network.neutron [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 02:59:45 user nova-compute[74898]: DEBUG nova.compute.manager [req-115fd159-1eeb-4604-8b08-12ee27bace3a req-35318c64-d70c-4e24-8724-67f4208edd0d service nova] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Received event network-changed-ba899c72-f082-46fe-9a32-b548a4d653e2 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 02:59:45 user nova-compute[74898]: DEBUG nova.compute.manager [req-115fd159-1eeb-4604-8b08-12ee27bace3a req-35318c64-d70c-4e24-8724-67f4208edd0d service nova] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Refreshing instance network info cache due to event network-changed-ba899c72-f082-46fe-9a32-b548a4d653e2. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 02:59:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-115fd159-1eeb-4604-8b08-12ee27bace3a req-35318c64-d70c-4e24-8724-67f4208edd0d service nova] Acquiring lock "refresh_cache-9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 02:59:45 user nova-compute[74898]: DEBUG nova.network.neutron [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 02:59:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.network.neutron [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Successfully created port: bd3b73ca-0068-42f4-8cf3-f84932dee960 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.network.neutron [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Updating instance_info_cache with network_info: [{"id": "ba899c72-f082-46fe-9a32-b548a4d653e2", "address": "fa:16:3e:95:22:a1", "network": {"id": "7ed585ab-8901-4ced-a881-2dd15371baa7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-738644687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d29dfc5e055942b4af680a17e5b1de13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba899c72-f0", "ovs_interfaceid": "ba899c72-f082-46fe-9a32-b548a4d653e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Releasing lock "refresh_cache-9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.compute.manager [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Instance network_info: |[{"id": "ba899c72-f082-46fe-9a32-b548a4d653e2", "address": "fa:16:3e:95:22:a1", "network": {"id": "7ed585ab-8901-4ced-a881-2dd15371baa7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-738644687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d29dfc5e055942b4af680a17e5b1de13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba899c72-f0", "ovs_interfaceid": "ba899c72-f082-46fe-9a32-b548a4d653e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-115fd159-1eeb-4604-8b08-12ee27bace3a req-35318c64-d70c-4e24-8724-67f4208edd0d service nova] Acquired lock "refresh_cache-9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.network.neutron [req-115fd159-1eeb-4604-8b08-12ee27bace3a req-35318c64-d70c-4e24-8724-67f4208edd0d service nova] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Refreshing network info cache for port ba899c72-f082-46fe-9a32-b548a4d653e2 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Start _get_guest_xml network_info=[{"id": "ba899c72-f082-46fe-9a32-b548a4d653e2", "address": "fa:16:3e:95:22:a1", "network": {"id": "7ed585ab-8901-4ced-a881-2dd15371baa7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-738644687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d29dfc5e055942b4af680a17e5b1de13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba899c72-f0", "ovs_interfaceid": "ba899c72-f082-46fe-9a32-b548a4d653e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 02:59:47 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:59:47 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:59:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-726055417',display_name='tempest-VolumesAdminNegativeTest-server-726055417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-726055417',id=6,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC30BrfPqQJDfgorM4ZQwReNDojCk1D3CWtwBgzqiFO5igPwDfPE9xhJE1EdMhEjyqP3+A5AjzF+qtbW94MQ9WK/XN91KuFz/V8SFGJQqwdTqlIiD72gHluqQ7pz+yWrvA==',key_name='tempest-keypair-1435574687',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d29dfc5e055942b4af680a17e5b1de13',ramdisk_id='',reservation_id='r-x8ga30py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1538245231',owner_user_name='tempest-VolumesAdminNegativeTest-1538245231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T02:59:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a8202cbeb204cd38b3f8daa90578dbf',uuid=9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba899c72-f082-46fe-9a32-b548a4d653e2", "address": "fa:16:3e:95:22:a1", "network": {"id": "7ed585ab-8901-4ced-a881-2dd15371baa7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-738644687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d29dfc5e055942b4af680a17e5b1de13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba899c72-f0", "ovs_interfaceid": "ba899c72-f082-46fe-9a32-b548a4d653e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Converting VIF {"id": "ba899c72-f082-46fe-9a32-b548a4d653e2", "address": "fa:16:3e:95:22:a1", "network": {"id": "7ed585ab-8901-4ced-a881-2dd15371baa7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-738644687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d29dfc5e055942b4af680a17e5b1de13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba899c72-f0", "ovs_interfaceid": "ba899c72-f082-46fe-9a32-b548a4d653e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:22:a1,bridge_name='br-int',has_traffic_filtering=True,id=ba899c72-f082-46fe-9a32-b548a4d653e2,network=Network(7ed585ab-8901-4ced-a881-2dd15371baa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba899c72-f0') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.objects.instance [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] End _get_guest_xml xml=<domain type="kvm">
Nov 17 02:59:47 user nova-compute[74898]:   <uuid>9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d</uuid>
Nov 17 02:59:47 user nova-compute[74898]:   <name>instance-00000006</name>
Nov 17 02:59:47 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 02:59:47 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 02:59:47 user nova-compute[74898]:   <metadata>
Nov 17 02:59:47 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 02:59:47 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 02:59:47 user nova-compute[74898]:       <nova:name>tempest-VolumesAdminNegativeTest-server-726055417</nova:name>
Nov 17 02:59:47 user nova-compute[74898]:       <nova:creationTime>2023-11-17 02:59:47</nova:creationTime>
Nov 17 02:59:47 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 02:59:47 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 02:59:47 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 02:59:47 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 02:59:47 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 02:59:47 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 02:59:47 user nova-compute[74898]:       </nova:flavor>
Nov 17 02:59:47 user nova-compute[74898]:       <nova:owner>
Nov 17 02:59:47 user nova-compute[74898]:         <nova:user uuid="7a8202cbeb204cd38b3f8daa90578dbf">tempest-VolumesAdminNegativeTest-1538245231-project-member</nova:user>
Nov 17 02:59:47 user nova-compute[74898]:         <nova:project uuid="d29dfc5e055942b4af680a17e5b1de13">tempest-VolumesAdminNegativeTest-1538245231</nova:project>
Nov 17 02:59:47 user nova-compute[74898]:       </nova:owner>
Nov 17 02:59:47 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 02:59:47 user nova-compute[74898]:       <nova:ports>
Nov 17 02:59:47 user nova-compute[74898]:         <nova:port uuid="ba899c72-f082-46fe-9a32-b548a4d653e2">
Nov 17 02:59:47 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 17 02:59:47 user nova-compute[74898]:         </nova:port>
Nov 17 02:59:47 user nova-compute[74898]:       </nova:ports>
Nov 17 02:59:47 user nova-compute[74898]:     </nova:instance>
Nov 17 02:59:47 user nova-compute[74898]:   </metadata>
Nov 17 02:59:47 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 02:59:47 user nova-compute[74898]:     <system>
Nov 17 02:59:47 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 02:59:47 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 02:59:47 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 02:59:47 user nova-compute[74898]:       <entry name="serial">9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d</entry>
Nov 17 02:59:47 user nova-compute[74898]:       <entry name="uuid">9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d</entry>
Nov 17 02:59:47 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 02:59:47 user nova-compute[74898]:     </system>
Nov 17 02:59:47 user nova-compute[74898]:   </sysinfo>
Nov 17 02:59:47 user nova-compute[74898]:   <os>
Nov 17 02:59:47 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 02:59:47 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 02:59:47 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 02:59:47 user nova-compute[74898]:   </os>
Nov 17 02:59:47 user nova-compute[74898]:   <features>
Nov 17 02:59:47 user nova-compute[74898]:     <acpi/>
Nov 17 02:59:47 user nova-compute[74898]:     <apic/>
Nov 17 02:59:47 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 02:59:47 user nova-compute[74898]:   </features>
Nov 17 02:59:47 user nova-compute[74898]:   <clock offset="utc">
Nov 17 02:59:47 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 02:59:47 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 02:59:47 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 02:59:47 user nova-compute[74898]:   </clock>
Nov 17 02:59:47 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 02:59:47 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 02:59:47 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 02:59:47 user nova-compute[74898]:   </cpu>
Nov 17 02:59:47 user nova-compute[74898]:   <devices>
Nov 17 02:59:47 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 02:59:47 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 02:59:47 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk"/>
Nov 17 02:59:47 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 02:59:47 user nova-compute[74898]:     </disk>
Nov 17 02:59:47 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 02:59:47 user nova-compute[74898]:       <mac address="fa:16:3e:95:22:a1"/>
Nov 17 02:59:47 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 02:59:47 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 02:59:47 user nova-compute[74898]:       <target dev="tapba899c72-f0"/>
Nov 17 02:59:47 user nova-compute[74898]:     </interface>
Nov 17 02:59:47 user nova-compute[74898]:     <serial type="pty">
Nov 17 02:59:47 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/console.log" append="off"/>
Nov 17 02:59:47 user nova-compute[74898]:     </serial>
Nov 17 02:59:47 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 02:59:47 user nova-compute[74898]:     <video>
Nov 17 02:59:47 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 02:59:47 user nova-compute[74898]:     </video>
Nov 17 02:59:47 user nova-compute[74898]:     <rng model="virtio">
Nov 17 02:59:47 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 02:59:47 user nova-compute[74898]:     </rng>
Nov 17 02:59:47 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 02:59:47 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 02:59:47 user nova-compute[74898]:       <stats period="10"/>
Nov 17 02:59:47 user nova-compute[74898]:     </memballoon>
Nov 17 02:59:47 user nova-compute[74898]:   </devices>
Nov 17 02:59:47 user nova-compute[74898]: </domain>
Nov 17 02:59:47 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:59:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-726055417',display_name='tempest-VolumesAdminNegativeTest-server-726055417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-726055417',id=6,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC30BrfPqQJDfgorM4ZQwReNDojCk1D3CWtwBgzqiFO5igPwDfPE9xhJE1EdMhEjyqP3+A5AjzF+qtbW94MQ9WK/XN91KuFz/V8SFGJQqwdTqlIiD72gHluqQ7pz+yWrvA==',key_name='tempest-keypair-1435574687',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d29dfc5e055942b4af680a17e5b1de13',ramdisk_id='',reservation_id='r-x8ga30py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1538245231',owner_user_name='tempest-VolumesAdminNegativeTest-1538245231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T02:59:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a8202cbeb204cd38b3f8daa90578dbf',uuid=9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba899c72-f082-46fe-9a32-b548a4d653e2", "address": "fa:16:3e:95:22:a1", "network": {"id": "7ed585ab-8901-4ced-a881-2dd15371baa7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-738644687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d29dfc5e055942b4af680a17e5b1de13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba899c72-f0", "ovs_interfaceid": "ba899c72-f082-46fe-9a32-b548a4d653e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Converting VIF {"id": "ba899c72-f082-46fe-9a32-b548a4d653e2", "address": "fa:16:3e:95:22:a1", "network": {"id": "7ed585ab-8901-4ced-a881-2dd15371baa7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-738644687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d29dfc5e055942b4af680a17e5b1de13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba899c72-f0", "ovs_interfaceid": "ba899c72-f082-46fe-9a32-b548a4d653e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:22:a1,bridge_name='br-int',has_traffic_filtering=True,id=ba899c72-f082-46fe-9a32-b548a4d653e2,network=Network(7ed585ab-8901-4ced-a881-2dd15371baa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba899c72-f0') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG os_vif [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:22:a1,bridge_name='br-int',has_traffic_filtering=True,id=ba899c72-f082-46fe-9a32-b548a4d653e2,network=Network(7ed585ab-8901-4ced-a881-2dd15371baa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba899c72-f0') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1010d942-21ae-58eb-9d26-23919e9389ec', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba899c72-f0, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba899c72-f0, col_values=(('qos', UUID('6e5cd3af-f354-483c-9423-149736520b4f')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba899c72-f0, col_values=(('external_ids', {'iface-id': 'ba899c72-f082-46fe-9a32-b548a4d653e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:22:a1', 'vm-uuid': '9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:47 user nova-compute[74898]: INFO os_vif [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:22:a1,bridge_name='br-int',has_traffic_filtering=True,id=ba899c72-f082-46fe-9a32-b548a4d653e2,network=Network(7ed585ab-8901-4ced-a881-2dd15371baa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba899c72-f0')
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 02:59:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] No VIF found with MAC fa:16:3e:95:22:a1, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 02:59:49 user nova-compute[74898]: DEBUG nova.network.neutron [req-115fd159-1eeb-4604-8b08-12ee27bace3a req-35318c64-d70c-4e24-8724-67f4208edd0d service nova] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Updated VIF entry in instance network info cache for port ba899c72-f082-46fe-9a32-b548a4d653e2. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 02:59:49 user nova-compute[74898]: DEBUG nova.network.neutron [req-115fd159-1eeb-4604-8b08-12ee27bace3a req-35318c64-d70c-4e24-8724-67f4208edd0d service nova] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Updating instance_info_cache with network_info: [{"id": "ba899c72-f082-46fe-9a32-b548a4d653e2", "address": "fa:16:3e:95:22:a1", "network": {"id": "7ed585ab-8901-4ced-a881-2dd15371baa7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-738644687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d29dfc5e055942b4af680a17e5b1de13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba899c72-f0", "ovs_interfaceid": "ba899c72-f082-46fe-9a32-b548a4d653e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 02:59:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-115fd159-1eeb-4604-8b08-12ee27bace3a req-35318c64-d70c-4e24-8724-67f4208edd0d service nova] Releasing lock "refresh_cache-9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 02:59:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Acquiring lock "20c6c8ae-ef3d-428b-a6d5-1683eba214d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lock "20c6c8ae-ef3d-428b-a6d5-1683eba214d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:49 user nova-compute[74898]: DEBUG nova.compute.manager [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 02:59:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:49 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 02:59:49 user nova-compute[74898]: INFO nova.compute.claims [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Claim successful on node user
Nov 17 02:59:49 user nova-compute[74898]: DEBUG nova.network.neutron [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Successfully updated port: bd3b73ca-0068-42f4-8cf3-f84932dee960 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 02:59:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Acquiring lock "refresh_cache-b886ada4-5bcb-4b2a-b69e-80edefdd2119" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 02:59:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Acquired lock "refresh_cache-b886ada4-5bcb-4b2a-b69e-80edefdd2119" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 02:59:49 user nova-compute[74898]: DEBUG nova.network.neutron [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG nova.compute.manager [req-b543b009-a90c-4bd8-ad47-dcd03df7fd30 req-922836a2-109b-40c3-bfb0-87d837e41fd2 service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Received event network-changed-bd3b73ca-0068-42f4-8cf3-f84932dee960 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG nova.compute.manager [req-b543b009-a90c-4bd8-ad47-dcd03df7fd30 req-922836a2-109b-40c3-bfb0-87d837e41fd2 service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Refreshing instance network info cache due to event network-changed-bd3b73ca-0068-42f4-8cf3-f84932dee960. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b543b009-a90c-4bd8-ad47-dcd03df7fd30 req-922836a2-109b-40c3-bfb0-87d837e41fd2 service nova] Acquiring lock "refresh_cache-b886ada4-5bcb-4b2a-b69e-80edefdd2119" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG nova.network.neutron [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG nova.network.neutron [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Updating instance_info_cache with network_info: [{"id": "bd3b73ca-0068-42f4-8cf3-f84932dee960", "address": "fa:16:3e:2d:e6:07", "network": {"id": "a432562d-92fd-4786-944f-3a082f5146e8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1288851087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c45541cf5bd44c2a34d5a31f04e2a2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3b73ca-00", "ovs_interfaceid": "bd3b73ca-0068-42f4-8cf3-f84932dee960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Releasing lock "refresh_cache-b886ada4-5bcb-4b2a-b69e-80edefdd2119" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG nova.compute.manager [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Instance network_info: |[{"id": "bd3b73ca-0068-42f4-8cf3-f84932dee960", "address": "fa:16:3e:2d:e6:07", "network": {"id": "a432562d-92fd-4786-944f-3a082f5146e8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1288851087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c45541cf5bd44c2a34d5a31f04e2a2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3b73ca-00", "ovs_interfaceid": "bd3b73ca-0068-42f4-8cf3-f84932dee960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.011s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG nova.compute.manager [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b543b009-a90c-4bd8-ad47-dcd03df7fd30 req-922836a2-109b-40c3-bfb0-87d837e41fd2 service nova] Acquired lock "refresh_cache-b886ada4-5bcb-4b2a-b69e-80edefdd2119" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG nova.network.neutron [req-b543b009-a90c-4bd8-ad47-dcd03df7fd30 req-922836a2-109b-40c3-bfb0-87d837e41fd2 service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Refreshing network info cache for port bd3b73ca-0068-42f4-8cf3-f84932dee960 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Start _get_guest_xml network_info=[{"id": "bd3b73ca-0068-42f4-8cf3-f84932dee960", "address": "fa:16:3e:2d:e6:07", "network": {"id": "a432562d-92fd-4786-944f-3a082f5146e8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1288851087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c45541cf5bd44c2a34d5a31f04e2a2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3b73ca-00", "ovs_interfaceid": "bd3b73ca-0068-42f4-8cf3-f84932dee960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 02:59:50 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:59:50 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:59:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 02:59:50 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T02:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1059772796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1059772796',id=7,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbRzMswcys+QI6rLi6X0vGsy7XfMvLPPyHl7k0Ny6Kbzn4mYAR49YTYPPYUhsJ7Wj7VjaU+vGFbOCukOTayflDVlC4cnZKPAPKbqPCeENy+82k6vfJ0ZQpQ1EY3m67/9g==',key_name='tempest-keypair-1533313292',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c45541cf5bd44c2a34d5a31f04e2a2a',ramdisk_id='',reservation_id='r-ftctsg18',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1966129795',owner_user_name='tempest-TaggedAttachmentsTest-1966129795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T02:59:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7c4ed2ec81a411c95b2be4dcfb9859d',uuid=b886ada4-5bcb-4b2a-b69e-80edefdd2119,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd3b73ca-0068-42f4-8cf3-f84932dee960", "address": "fa:16:3e:2d:e6:07", "network": {"id": "a432562d-92fd-4786-944f-3a082f5146e8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1288851087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c45541cf5bd44c2a34d5a31f04e2a2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3b73ca-00", "ovs_interfaceid": "bd3b73ca-0068-42f4-8cf3-f84932dee960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Converting VIF {"id": "bd3b73ca-0068-42f4-8cf3-f84932dee960", "address": "fa:16:3e:2d:e6:07", "network": {"id": "a432562d-92fd-4786-944f-3a082f5146e8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1288851087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c45541cf5bd44c2a34d5a31f04e2a2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3b73ca-00", "ovs_interfaceid": "bd3b73ca-0068-42f4-8cf3-f84932dee960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=bd3b73ca-0068-42f4-8cf3-f84932dee960,network=Network(a432562d-92fd-4786-944f-3a082f5146e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd3b73ca-00') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG nova.objects.instance [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lazy-loading 'pci_devices' on Instance uuid b886ada4-5bcb-4b2a-b69e-80edefdd2119 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG nova.compute.manager [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG nova.network.neutron [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] End _get_guest_xml xml=<domain type="kvm">
Nov 17 02:59:51 user nova-compute[74898]:   <uuid>b886ada4-5bcb-4b2a-b69e-80edefdd2119</uuid>
Nov 17 02:59:51 user nova-compute[74898]:   <name>instance-00000007</name>
Nov 17 02:59:51 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 02:59:51 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 02:59:51 user nova-compute[74898]:   <metadata>
Nov 17 02:59:51 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 02:59:51 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 02:59:51 user nova-compute[74898]:       <nova:name>tempest-device-tagging-server-1059772796</nova:name>
Nov 17 02:59:51 user nova-compute[74898]:       <nova:creationTime>2023-11-17 02:59:50</nova:creationTime>
Nov 17 02:59:51 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 02:59:51 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 02:59:51 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 02:59:51 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 02:59:51 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 02:59:51 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 02:59:51 user nova-compute[74898]:       </nova:flavor>
Nov 17 02:59:51 user nova-compute[74898]:       <nova:owner>
Nov 17 02:59:51 user nova-compute[74898]:         <nova:user uuid="f7c4ed2ec81a411c95b2be4dcfb9859d">tempest-TaggedAttachmentsTest-1966129795-project-member</nova:user>
Nov 17 02:59:51 user nova-compute[74898]:         <nova:project uuid="8c45541cf5bd44c2a34d5a31f04e2a2a">tempest-TaggedAttachmentsTest-1966129795</nova:project>
Nov 17 02:59:51 user nova-compute[74898]:       </nova:owner>
Nov 17 02:59:51 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 02:59:51 user nova-compute[74898]:       <nova:ports>
Nov 17 02:59:51 user nova-compute[74898]:         <nova:port uuid="bd3b73ca-0068-42f4-8cf3-f84932dee960">
Nov 17 02:59:51 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 17 02:59:51 user nova-compute[74898]:         </nova:port>
Nov 17 02:59:51 user nova-compute[74898]:       </nova:ports>
Nov 17 02:59:51 user nova-compute[74898]:     </nova:instance>
Nov 17 02:59:51 user nova-compute[74898]:   </metadata>
Nov 17 02:59:51 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 02:59:51 user nova-compute[74898]:     <system>
Nov 17 02:59:51 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 02:59:51 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 02:59:51 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 02:59:51 user nova-compute[74898]:       <entry name="serial">b886ada4-5bcb-4b2a-b69e-80edefdd2119</entry>
Nov 17 02:59:51 user nova-compute[74898]:       <entry name="uuid">b886ada4-5bcb-4b2a-b69e-80edefdd2119</entry>
Nov 17 02:59:51 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 02:59:51 user nova-compute[74898]:     </system>
Nov 17 02:59:51 user nova-compute[74898]:   </sysinfo>
Nov 17 02:59:51 user nova-compute[74898]:   <os>
Nov 17 02:59:51 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 02:59:51 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 02:59:51 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 02:59:51 user nova-compute[74898]:   </os>
Nov 17 02:59:51 user nova-compute[74898]:   <features>
Nov 17 02:59:51 user nova-compute[74898]:     <acpi/>
Nov 17 02:59:51 user nova-compute[74898]:     <apic/>
Nov 17 02:59:51 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 02:59:51 user nova-compute[74898]:   </features>
Nov 17 02:59:51 user nova-compute[74898]:   <clock offset="utc">
Nov 17 02:59:51 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 02:59:51 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 02:59:51 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 02:59:51 user nova-compute[74898]:   </clock>
Nov 17 02:59:51 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 02:59:51 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 02:59:51 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 02:59:51 user nova-compute[74898]:   </cpu>
Nov 17 02:59:51 user nova-compute[74898]:   <devices>
Nov 17 02:59:51 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 02:59:51 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 02:59:51 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk"/>
Nov 17 02:59:51 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 02:59:51 user nova-compute[74898]:     </disk>
Nov 17 02:59:51 user nova-compute[74898]:     <disk type="file" device="cdrom">
Nov 17 02:59:51 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none"/>
Nov 17 02:59:51 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk.config"/>
Nov 17 02:59:51 user nova-compute[74898]:       <target dev="hda" bus="ide"/>
Nov 17 02:59:51 user nova-compute[74898]:     </disk>
Nov 17 02:59:51 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 02:59:51 user nova-compute[74898]:       <mac address="fa:16:3e:2d:e6:07"/>
Nov 17 02:59:51 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 02:59:51 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 02:59:51 user nova-compute[74898]:       <target dev="tapbd3b73ca-00"/>
Nov 17 02:59:51 user nova-compute[74898]:     </interface>
Nov 17 02:59:51 user nova-compute[74898]:     <serial type="pty">
Nov 17 02:59:51 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/console.log" append="off"/>
Nov 17 02:59:51 user nova-compute[74898]:     </serial>
Nov 17 02:59:51 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 02:59:51 user nova-compute[74898]:     <video>
Nov 17 02:59:51 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 02:59:51 user nova-compute[74898]:     </video>
Nov 17 02:59:51 user nova-compute[74898]:     <rng model="virtio">
Nov 17 02:59:51 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 02:59:51 user nova-compute[74898]:     </rng>
Nov 17 02:59:51 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 02:59:51 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 02:59:51 user nova-compute[74898]:       <stats period="10"/>
Nov 17 02:59:51 user nova-compute[74898]:     </memballoon>
Nov 17 02:59:51 user nova-compute[74898]:   </devices>
Nov 17 02:59:51 user nova-compute[74898]: </domain>
Nov 17 02:59:51 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T02:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1059772796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1059772796',id=7,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbRzMswcys+QI6rLi6X0vGsy7XfMvLPPyHl7k0Ny6Kbzn4mYAR49YTYPPYUhsJ7Wj7VjaU+vGFbOCukOTayflDVlC4cnZKPAPKbqPCeENy+82k6vfJ0ZQpQ1EY3m67/9g==',key_name='tempest-keypair-1533313292',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c45541cf5bd44c2a34d5a31f04e2a2a',ramdisk_id='',reservation_id='r-ftctsg18',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1966129795',owner_user_name='tempest-TaggedAttachmentsTest-1966129795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T02:59:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7c4ed2ec81a411c95b2be4dcfb9859d',uuid=b886ada4-5bcb-4b2a-b69e-80edefdd2119,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd3b73ca-0068-42f4-8cf3-f84932dee960", "address": "fa:16:3e:2d:e6:07", "network": {"id": "a432562d-92fd-4786-944f-3a082f5146e8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1288851087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c45541cf5bd44c2a34d5a31f04e2a2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3b73ca-00", "ovs_interfaceid": "bd3b73ca-0068-42f4-8cf3-f84932dee960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Converting VIF {"id": "bd3b73ca-0068-42f4-8cf3-f84932dee960", "address": "fa:16:3e:2d:e6:07", "network": {"id": "a432562d-92fd-4786-944f-3a082f5146e8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1288851087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c45541cf5bd44c2a34d5a31f04e2a2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3b73ca-00", "ovs_interfaceid": "bd3b73ca-0068-42f4-8cf3-f84932dee960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=bd3b73ca-0068-42f4-8cf3-f84932dee960,network=Network(a432562d-92fd-4786-944f-3a082f5146e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd3b73ca-00') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG os_vif [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=bd3b73ca-0068-42f4-8cf3-f84932dee960,network=Network(a432562d-92fd-4786-944f-3a082f5146e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd3b73ca-00') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '66c6ab2f-6a8e-5000-9497-5094ceae2dc1', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:51 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 17 02:59:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd3b73ca-00, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd3b73ca-00, col_values=(('qos', UUID('e37d037e-6ea6-47e1-b826-72aa52c63216')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd3b73ca-00, col_values=(('external_ids', {'iface-id': 'bd3b73ca-0068-42f4-8cf3-f84932dee960', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:e6:07', 'vm-uuid': 'b886ada4-5bcb-4b2a-b69e-80edefdd2119'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:51 user nova-compute[74898]: INFO os_vif [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=bd3b73ca-0068-42f4-8cf3-f84932dee960,network=Network(a432562d-92fd-4786-944f-3a082f5146e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd3b73ca-00')
Nov 17 02:59:51 user nova-compute[74898]: DEBUG nova.compute.manager [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] No BDM found with device name hda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] No VIF found with MAC fa:16:3e:2d:e6:07, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 02:59:51 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Using config drive
Nov 17 02:59:51 user nova-compute[74898]: DEBUG nova.policy [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cda65a1c72304a9dbdeaa6bf3ea9da0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c2ce1c558846ac83600108cc07750d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG nova.compute.manager [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 02:59:51 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Creating image(s)
Nov 17 02:59:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Acquiring lock "/opt/stack/data/nova/instances/20c6c8ae-ef3d-428b-a6d5-1683eba214d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lock "/opt/stack/data/nova/instances/20c6c8ae-ef3d-428b-a6d5-1683eba214d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lock "/opt/stack/data/nova/instances/20c6c8ae-ef3d-428b-a6d5-1683eba214d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Acquiring lock "7786aeb91018441e8158bc202cf7d57a84a51dff" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lock "7786aeb91018441e8158bc202cf7d57a84a51dff" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:51 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Creating config drive at /opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk.config
Nov 17 02:59:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmcsxf1fu {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmcsxf1fu" returned: 0 in 0.083s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7786aeb91018441e8158bc202cf7d57a84a51dff.part --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:52 user nova-compute[74898]: DEBUG nova.compute.manager [req-2406407d-25d8-48fa-b649-ca3f84147bd2 req-23d4f012-7e42-43d6-8195-039999bcfe79 service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Received event network-vif-plugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 02:59:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-2406407d-25d8-48fa-b649-ca3f84147bd2 req-23d4f012-7e42-43d6-8195-039999bcfe79 service nova] Acquiring lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-2406407d-25d8-48fa-b649-ca3f84147bd2 req-23d4f012-7e42-43d6-8195-039999bcfe79 service nova] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-2406407d-25d8-48fa-b649-ca3f84147bd2 req-23d4f012-7e42-43d6-8195-039999bcfe79 service nova] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:52 user nova-compute[74898]: DEBUG nova.compute.manager [req-2406407d-25d8-48fa-b649-ca3f84147bd2 req-23d4f012-7e42-43d6-8195-039999bcfe79 service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] No waiting events found dispatching network-vif-plugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 02:59:52 user nova-compute[74898]: WARNING nova.compute.manager [req-2406407d-25d8-48fa-b649-ca3f84147bd2 req-23d4f012-7e42-43d6-8195-039999bcfe79 service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Received unexpected event network-vif-plugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f for instance with vm_state active and task_state None.
Nov 17 02:59:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7786aeb91018441e8158bc202cf7d57a84a51dff.part --force-share --output=json" returned: 0 in 0.272s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:52 user nova-compute[74898]: DEBUG nova.virt.images [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] d17d827f-e97e-4f7f-8606-3d2a5e536d29 was qcow2, converting to raw {{(pid=74898) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 17 02:59:52 user nova-compute[74898]: DEBUG nova.privsep.utils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74898) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 02:59:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7786aeb91018441e8158bc202cf7d57a84a51dff.part /opt/stack/data/nova/instances/_base/7786aeb91018441e8158bc202cf7d57a84a51dff.converted {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:52 user nova-compute[74898]: DEBUG nova.network.neutron [req-b543b009-a90c-4bd8-ad47-dcd03df7fd30 req-922836a2-109b-40c3-bfb0-87d837e41fd2 service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Updated VIF entry in instance network info cache for port bd3b73ca-0068-42f4-8cf3-f84932dee960. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 02:59:52 user nova-compute[74898]: DEBUG nova.network.neutron [req-b543b009-a90c-4bd8-ad47-dcd03df7fd30 req-922836a2-109b-40c3-bfb0-87d837e41fd2 service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Updating instance_info_cache with network_info: [{"id": "bd3b73ca-0068-42f4-8cf3-f84932dee960", "address": "fa:16:3e:2d:e6:07", "network": {"id": "a432562d-92fd-4786-944f-3a082f5146e8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1288851087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c45541cf5bd44c2a34d5a31f04e2a2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3b73ca-00", "ovs_interfaceid": "bd3b73ca-0068-42f4-8cf3-f84932dee960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 02:59:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b543b009-a90c-4bd8-ad47-dcd03df7fd30 req-922836a2-109b-40c3-bfb0-87d837e41fd2 service nova] Releasing lock "refresh_cache-b886ada4-5bcb-4b2a-b69e-80edefdd2119" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 02:59:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7786aeb91018441e8158bc202cf7d57a84a51dff.part /opt/stack/data/nova/instances/_base/7786aeb91018441e8158bc202cf7d57a84a51dff.converted" returned: 0 in 0.435s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7786aeb91018441e8158bc202cf7d57a84a51dff.converted --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:53 user nova-compute[74898]: DEBUG nova.compute.manager [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 02:59:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 02:59:53 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Instance spawned successfully.
Nov 17 02:59:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 02:59:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7786aeb91018441e8158bc202cf7d57a84a51dff.converted --force-share --output=json" returned: 0 in 0.307s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lock "7786aeb91018441e8158bc202cf7d57a84a51dff" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.700s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7786aeb91018441e8158bc202cf7d57a84a51dff --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:53 user nova-compute[74898]: DEBUG nova.network.neutron [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Successfully created port: 1bfa5db9-9200-4130-9007-fca16f7064c4 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 02:59:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:53 user nova-compute[74898]: INFO nova.compute.manager [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Took 11.93 seconds to spawn the instance on the hypervisor.
Nov 17 02:59:53 user nova-compute[74898]: DEBUG nova.compute.manager [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 02:59:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7786aeb91018441e8158bc202cf7d57a84a51dff --force-share --output=json" returned: 0 in 0.392s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Acquiring lock "7786aeb91018441e8158bc202cf7d57a84a51dff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lock "7786aeb91018441e8158bc202cf7d57a84a51dff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7786aeb91018441e8158bc202cf7d57a84a51dff --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:53 user nova-compute[74898]: INFO nova.compute.manager [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Took 13.31 seconds to build instance.
Nov 17 02:59:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-dc9b907d-e369-47c3-9616-55761bf37019 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.586s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7786aeb91018441e8158bc202cf7d57a84a51dff --force-share --output=json" returned: 0 in 0.260s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7786aeb91018441e8158bc202cf7d57a84a51dff,backing_fmt=raw /opt/stack/data/nova/instances/20c6c8ae-ef3d-428b-a6d5-1683eba214d9/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7786aeb91018441e8158bc202cf7d57a84a51dff,backing_fmt=raw /opt/stack/data/nova/instances/20c6c8ae-ef3d-428b-a6d5-1683eba214d9/disk 1073741824" returned: 0 in 0.080s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lock "7786aeb91018441e8158bc202cf7d57a84a51dff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.348s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7786aeb91018441e8158bc202cf7d57a84a51dff --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7786aeb91018441e8158bc202cf7d57a84a51dff --force-share --output=json" returned: 0 in 0.258s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:54 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20c6c8ae-ef3d-428b-a6d5-1683eba214d9/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 02:59:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c6c8ae-ef3d-428b-a6d5-1683eba214d9/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:54 user nova-compute[74898]: DEBUG nova.compute.manager [req-c9147dd1-fc6f-4dff-bfa8-e262750ffcae req-5de90a9e-2cc0-4d30-a061-22b83566c2c9 service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Received event network-vif-plugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 02:59:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c9147dd1-fc6f-4dff-bfa8-e262750ffcae req-5de90a9e-2cc0-4d30-a061-22b83566c2c9 service nova] Acquiring lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c9147dd1-fc6f-4dff-bfa8-e262750ffcae req-5de90a9e-2cc0-4d30-a061-22b83566c2c9 service nova] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c9147dd1-fc6f-4dff-bfa8-e262750ffcae req-5de90a9e-2cc0-4d30-a061-22b83566c2c9 service nova] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:54 user nova-compute[74898]: DEBUG nova.compute.manager [req-c9147dd1-fc6f-4dff-bfa8-e262750ffcae req-5de90a9e-2cc0-4d30-a061-22b83566c2c9 service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] No waiting events found dispatching network-vif-plugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 02:59:54 user nova-compute[74898]: WARNING nova.compute.manager [req-c9147dd1-fc6f-4dff-bfa8-e262750ffcae req-5de90a9e-2cc0-4d30-a061-22b83566c2c9 service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Received unexpected event network-vif-plugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f for instance with vm_state active and task_state None.
Nov 17 02:59:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c6c8ae-ef3d-428b-a6d5-1683eba214d9/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:54 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Cannot resize image /opt/stack/data/nova/instances/20c6c8ae-ef3d-428b-a6d5-1683eba214d9/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 02:59:54 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 02:59:54 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Ensure instance console log exists: /opt/stack/data/nova/instances/20c6c8ae-ef3d-428b-a6d5-1683eba214d9/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 02:59:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:54 user nova-compute[74898]: DEBUG nova.network.neutron [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Successfully updated port: 1bfa5db9-9200-4130-9007-fca16f7064c4 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 02:59:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Acquiring lock "refresh_cache-20c6c8ae-ef3d-428b-a6d5-1683eba214d9" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 02:59:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Acquired lock "refresh_cache-20c6c8ae-ef3d-428b-a6d5-1683eba214d9" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 02:59:54 user nova-compute[74898]: DEBUG nova.network.neutron [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 02:59:54 user nova-compute[74898]: DEBUG nova.network.neutron [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.network.neutron [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Updating instance_info_cache with network_info: [{"id": "1bfa5db9-9200-4130-9007-fca16f7064c4", "address": "fa:16:3e:17:ef:99", "network": {"id": "52541a68-fc4e-4d45-8811-e55912d0ceec", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-194171318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29c2ce1c558846ac83600108cc07750d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bfa5db9-92", "ovs_interfaceid": "1bfa5db9-9200-4130-9007-fca16f7064c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Releasing lock "refresh_cache-20c6c8ae-ef3d-428b-a6d5-1683eba214d9" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.compute.manager [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Instance network_info: |[{"id": "1bfa5db9-9200-4130-9007-fca16f7064c4", "address": "fa:16:3e:17:ef:99", "network": {"id": "52541a68-fc4e-4d45-8811-e55912d0ceec", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-194171318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29c2ce1c558846ac83600108cc07750d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bfa5db9-92", "ovs_interfaceid": "1bfa5db9-9200-4130-9007-fca16f7064c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Start _get_guest_xml network_info=[{"id": "1bfa5db9-9200-4130-9007-fca16f7064c4", "address": "fa:16:3e:17:ef:99", "network": {"id": "52541a68-fc4e-4d45-8811-e55912d0ceec", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-194171318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29c2ce1c558846ac83600108cc07750d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bfa5db9-92", "ovs_interfaceid": "1bfa5db9-9200-4130-9007-fca16f7064c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:59:39Z,direct_url=<?>,disk_format='qcow2',id=d17d827f-e97e-4f7f-8606-3d2a5e536d29,min_disk=0,min_ram=0,name='',owner='61b76684e6a84b5388f34d5841e94ee9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:59:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'scsi', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/sda', 'encryption_options': None, 'encrypted': False, 'image_id': 'd17d827f-e97e-4f7f-8606-3d2a5e536d29'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 02:59:55 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:59:55 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:59:39Z,direct_url=<?>,disk_format='qcow2',id=d17d827f-e97e-4f7f-8606-3d2a5e536d29,min_disk=0,min_ram=0,name='',owner='61b76684e6a84b5388f34d5841e94ee9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:59:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T02:59:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-525249058',display_name='tempest-AttachSCSIVolumeTestJSON-server-525249058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-525249058',id=8,image_ref='d17d827f-e97e-4f7f-8606-3d2a5e536d29',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhquSVpuUc4Lnyn71oZdv7LCTpwVaU0y4W814wwRvXuttXu9htmzLQSuLM1plYQEtuhbRhH+cmcpLV8VbIcZdSn+h5wwrVA0tLiEdkUofkCi7VJMXrxRrFB9TDpyWV9bg==',key_name='tempest-keypair-561746567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29c2ce1c558846ac83600108cc07750d',ramdisk_id='',reservation_id='r-cu0oqpp5',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d17d827f-e97e-4f7f-8606-3d2a5e536d29',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-647753812',owner_user_name='tempest-AttachSCSIVolumeTestJSON-647753812-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T02:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cda65a1c72304a9dbdeaa6bf3ea9da0d',uuid=20c6c8ae-ef3d-428b-a6d5-1683eba214d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bfa5db9-9200-4130-9007-fca16f7064c4", "address": "fa:16:3e:17:ef:99", "network": {"id": "52541a68-fc4e-4d45-8811-e55912d0ceec", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-194171318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29c2ce1c558846ac83600108cc07750d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bfa5db9-92", "ovs_interfaceid": "1bfa5db9-9200-4130-9007-fca16f7064c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Converting VIF {"id": "1bfa5db9-9200-4130-9007-fca16f7064c4", "address": "fa:16:3e:17:ef:99", "network": {"id": "52541a68-fc4e-4d45-8811-e55912d0ceec", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-194171318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29c2ce1c558846ac83600108cc07750d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bfa5db9-92", "ovs_interfaceid": "1bfa5db9-9200-4130-9007-fca16f7064c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:ef:99,bridge_name='br-int',has_traffic_filtering=True,id=1bfa5db9-9200-4130-9007-fca16f7064c4,network=Network(52541a68-fc4e-4d45-8811-e55912d0ceec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bfa5db9-92') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.objects.instance [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lazy-loading 'pci_devices' on Instance uuid 20c6c8ae-ef3d-428b-a6d5-1683eba214d9 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Acquiring lock "e5885526-e2d0-41d4-8da1-b3440d243a19" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Lock "e5885526-e2d0-41d4-8da1-b3440d243a19" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] End _get_guest_xml xml=<domain type="kvm">
Nov 17 02:59:55 user nova-compute[74898]:   <uuid>20c6c8ae-ef3d-428b-a6d5-1683eba214d9</uuid>
Nov 17 02:59:55 user nova-compute[74898]:   <name>instance-00000008</name>
Nov 17 02:59:55 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 02:59:55 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 02:59:55 user nova-compute[74898]:   <metadata>
Nov 17 02:59:55 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 02:59:55 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 02:59:55 user nova-compute[74898]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-525249058</nova:name>
Nov 17 02:59:55 user nova-compute[74898]:       <nova:creationTime>2023-11-17 02:59:55</nova:creationTime>
Nov 17 02:59:55 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 02:59:55 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 02:59:55 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 02:59:55 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 02:59:55 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 02:59:55 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 02:59:55 user nova-compute[74898]:       </nova:flavor>
Nov 17 02:59:55 user nova-compute[74898]:       <nova:owner>
Nov 17 02:59:55 user nova-compute[74898]:         <nova:user uuid="cda65a1c72304a9dbdeaa6bf3ea9da0d">tempest-AttachSCSIVolumeTestJSON-647753812-project-member</nova:user>
Nov 17 02:59:55 user nova-compute[74898]:         <nova:project uuid="29c2ce1c558846ac83600108cc07750d">tempest-AttachSCSIVolumeTestJSON-647753812</nova:project>
Nov 17 02:59:55 user nova-compute[74898]:       </nova:owner>
Nov 17 02:59:55 user nova-compute[74898]:       <nova:root type="image" uuid="d17d827f-e97e-4f7f-8606-3d2a5e536d29"/>
Nov 17 02:59:55 user nova-compute[74898]:       <nova:ports>
Nov 17 02:59:55 user nova-compute[74898]:         <nova:port uuid="1bfa5db9-9200-4130-9007-fca16f7064c4">
Nov 17 02:59:55 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 17 02:59:55 user nova-compute[74898]:         </nova:port>
Nov 17 02:59:55 user nova-compute[74898]:       </nova:ports>
Nov 17 02:59:55 user nova-compute[74898]:     </nova:instance>
Nov 17 02:59:55 user nova-compute[74898]:   </metadata>
Nov 17 02:59:55 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 02:59:55 user nova-compute[74898]:     <system>
Nov 17 02:59:55 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 02:59:55 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 02:59:55 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 02:59:55 user nova-compute[74898]:       <entry name="serial">20c6c8ae-ef3d-428b-a6d5-1683eba214d9</entry>
Nov 17 02:59:55 user nova-compute[74898]:       <entry name="uuid">20c6c8ae-ef3d-428b-a6d5-1683eba214d9</entry>
Nov 17 02:59:55 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 02:59:55 user nova-compute[74898]:     </system>
Nov 17 02:59:55 user nova-compute[74898]:   </sysinfo>
Nov 17 02:59:55 user nova-compute[74898]:   <os>
Nov 17 02:59:55 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 02:59:55 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 02:59:55 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 02:59:55 user nova-compute[74898]:   </os>
Nov 17 02:59:55 user nova-compute[74898]:   <features>
Nov 17 02:59:55 user nova-compute[74898]:     <acpi/>
Nov 17 02:59:55 user nova-compute[74898]:     <apic/>
Nov 17 02:59:55 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 02:59:55 user nova-compute[74898]:   </features>
Nov 17 02:59:55 user nova-compute[74898]:   <clock offset="utc">
Nov 17 02:59:55 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 02:59:55 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 02:59:55 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 02:59:55 user nova-compute[74898]:   </clock>
Nov 17 02:59:55 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 02:59:55 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 02:59:55 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 02:59:55 user nova-compute[74898]:   </cpu>
Nov 17 02:59:55 user nova-compute[74898]:   <devices>
Nov 17 02:59:55 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 02:59:55 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 02:59:55 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/20c6c8ae-ef3d-428b-a6d5-1683eba214d9/disk"/>
Nov 17 02:59:55 user nova-compute[74898]:       <target dev="sda" bus="scsi"/>
Nov 17 02:59:55 user nova-compute[74898]:       <address type="drive" controller="0" unit="0"/>
Nov 17 02:59:55 user nova-compute[74898]:     </disk>
Nov 17 02:59:55 user nova-compute[74898]:     <disk type="file" device="cdrom">
Nov 17 02:59:55 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none"/>
Nov 17 02:59:55 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/20c6c8ae-ef3d-428b-a6d5-1683eba214d9/disk.config"/>
Nov 17 02:59:55 user nova-compute[74898]:       <target dev="sdb" bus="scsi"/>
Nov 17 02:59:55 user nova-compute[74898]:       <address type="drive" controller="0" unit="1"/>
Nov 17 02:59:55 user nova-compute[74898]:     </disk>
Nov 17 02:59:55 user nova-compute[74898]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 17 02:59:55 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 02:59:55 user nova-compute[74898]:       <mac address="fa:16:3e:17:ef:99"/>
Nov 17 02:59:55 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 02:59:55 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 02:59:55 user nova-compute[74898]:       <target dev="tap1bfa5db9-92"/>
Nov 17 02:59:55 user nova-compute[74898]:     </interface>
Nov 17 02:59:55 user nova-compute[74898]:     <serial type="pty">
Nov 17 02:59:55 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/20c6c8ae-ef3d-428b-a6d5-1683eba214d9/console.log" append="off"/>
Nov 17 02:59:55 user nova-compute[74898]:     </serial>
Nov 17 02:59:55 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 02:59:55 user nova-compute[74898]:     <video>
Nov 17 02:59:55 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 02:59:55 user nova-compute[74898]:     </video>
Nov 17 02:59:55 user nova-compute[74898]:     <rng model="virtio">
Nov 17 02:59:55 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 02:59:55 user nova-compute[74898]:     </rng>
Nov 17 02:59:55 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 02:59:55 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 02:59:55 user nova-compute[74898]:       <stats period="10"/>
Nov 17 02:59:55 user nova-compute[74898]:     </memballoon>
Nov 17 02:59:55 user nova-compute[74898]:   </devices>
Nov 17 02:59:55 user nova-compute[74898]: </domain>
Nov 17 02:59:55 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T02:59:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-525249058',display_name='tempest-AttachSCSIVolumeTestJSON-server-525249058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-525249058',id=8,image_ref='d17d827f-e97e-4f7f-8606-3d2a5e536d29',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhquSVpuUc4Lnyn71oZdv7LCTpwVaU0y4W814wwRvXuttXu9htmzLQSuLM1plYQEtuhbRhH+cmcpLV8VbIcZdSn+h5wwrVA0tLiEdkUofkCi7VJMXrxRrFB9TDpyWV9bg==',key_name='tempest-keypair-561746567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29c2ce1c558846ac83600108cc07750d',ramdisk_id='',reservation_id='r-cu0oqpp5',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d17d827f-e97e-4f7f-8606-3d2a5e536d29',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-647753812',owner_user_name='tempest-AttachSCSIVolumeTestJSON-647753812-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T02:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cda65a1c72304a9dbdeaa6bf3ea9da0d',uuid=20c6c8ae-ef3d-428b-a6d5-1683eba214d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bfa5db9-9200-4130-9007-fca16f7064c4", "address": "fa:16:3e:17:ef:99", "network": {"id": "52541a68-fc4e-4d45-8811-e55912d0ceec", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-194171318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29c2ce1c558846ac83600108cc07750d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bfa5db9-92", "ovs_interfaceid": "1bfa5db9-9200-4130-9007-fca16f7064c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Converting VIF {"id": "1bfa5db9-9200-4130-9007-fca16f7064c4", "address": "fa:16:3e:17:ef:99", "network": {"id": "52541a68-fc4e-4d45-8811-e55912d0ceec", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-194171318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29c2ce1c558846ac83600108cc07750d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bfa5db9-92", "ovs_interfaceid": "1bfa5db9-9200-4130-9007-fca16f7064c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:ef:99,bridge_name='br-int',has_traffic_filtering=True,id=1bfa5db9-9200-4130-9007-fca16f7064c4,network=Network(52541a68-fc4e-4d45-8811-e55912d0ceec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bfa5db9-92') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG os_vif [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:ef:99,bridge_name='br-int',has_traffic_filtering=True,id=1bfa5db9-9200-4130-9007-fca16f7064c4,network=Network(52541a68-fc4e-4d45-8811-e55912d0ceec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bfa5db9-92') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '744b04c3-fa4c-55b0-9186-707902780329', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1bfa5db9-92, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1bfa5db9-92, col_values=(('qos', UUID('bdfc0f5c-1547-44d4-b277-2a33d055b1da')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1bfa5db9-92, col_values=(('external_ids', {'iface-id': '1bfa5db9-9200-4130-9007-fca16f7064c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:ef:99', 'vm-uuid': '20c6c8ae-ef3d-428b-a6d5-1683eba214d9'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.compute.manager [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:55 user nova-compute[74898]: INFO os_vif [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:ef:99,bridge_name='br-int',has_traffic_filtering=True,id=1bfa5db9-9200-4130-9007-fca16f7064c4,network=Network(52541a68-fc4e-4d45-8811-e55912d0ceec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bfa5db9-92')
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] No BDM found with device name sda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] No VIF found with MAC fa:16:3e:17:ef:99, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 02:59:55 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Using config drive
Nov 17 02:59:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 02:59:55 user nova-compute[74898]: INFO nova.compute.claims [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Claim successful on node user
Nov 17 02:59:55 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Creating config drive at /opt/stack/data/nova/instances/20c6c8ae-ef3d-428b-a6d5-1683eba214d9/disk.config
Nov 17 02:59:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/20c6c8ae-ef3d-428b-a6d5-1683eba214d9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwqifzey6 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.compute.manager [req-ac5bcd2a-bb78-4867-bf20-38b9a4f09a37 req-eb5c40ef-9dc7-45a9-a1d7-ad9e40f5ed28 service nova] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Received event network-vif-plugged-f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ac5bcd2a-bb78-4867-bf20-38b9a4f09a37 req-eb5c40ef-9dc7-45a9-a1d7-ad9e40f5ed28 service nova] Acquiring lock "e733574a-56ba-4e24-babd-855bcb5bda61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ac5bcd2a-bb78-4867-bf20-38b9a4f09a37 req-eb5c40ef-9dc7-45a9-a1d7-ad9e40f5ed28 service nova] Lock "e733574a-56ba-4e24-babd-855bcb5bda61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ac5bcd2a-bb78-4867-bf20-38b9a4f09a37 req-eb5c40ef-9dc7-45a9-a1d7-ad9e40f5ed28 service nova] Lock "e733574a-56ba-4e24-babd-855bcb5bda61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:55 user nova-compute[74898]: DEBUG nova.compute.manager [req-ac5bcd2a-bb78-4867-bf20-38b9a4f09a37 req-eb5c40ef-9dc7-45a9-a1d7-ad9e40f5ed28 service nova] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] No waiting events found dispatching network-vif-plugged-f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 02:59:55 user nova-compute[74898]: WARNING nova.compute.manager [req-ac5bcd2a-bb78-4867-bf20-38b9a4f09a37 req-eb5c40ef-9dc7-45a9-a1d7-ad9e40f5ed28 service nova] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Received unexpected event network-vif-plugged-f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75 for instance with vm_state active and task_state None.
Nov 17 02:59:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/20c6c8ae-ef3d-428b-a6d5-1683eba214d9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwqifzey6" returned: 0 in 0.094s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:56 user nova-compute[74898]: DEBUG nova.compute.manager [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 02:59:56 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 02:59:56 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Instance spawned successfully.
Nov 17 02:59:56 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 02:59:56 user nova-compute[74898]: DEBUG nova.compute.manager [req-20053b92-fce6-43f5-9ab2-3abdc56b36c5 req-68c7b57f-6953-4427-94ac-e0617fd22fac service nova] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Received event network-changed-1bfa5db9-9200-4130-9007-fca16f7064c4 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 02:59:56 user nova-compute[74898]: DEBUG nova.compute.manager [req-20053b92-fce6-43f5-9ab2-3abdc56b36c5 req-68c7b57f-6953-4427-94ac-e0617fd22fac service nova] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Refreshing instance network info cache due to event network-changed-1bfa5db9-9200-4130-9007-fca16f7064c4. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 02:59:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-20053b92-fce6-43f5-9ab2-3abdc56b36c5 req-68c7b57f-6953-4427-94ac-e0617fd22fac service nova] Acquiring lock "refresh_cache-20c6c8ae-ef3d-428b-a6d5-1683eba214d9" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 02:59:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-20053b92-fce6-43f5-9ab2-3abdc56b36c5 req-68c7b57f-6953-4427-94ac-e0617fd22fac service nova] Acquired lock "refresh_cache-20c6c8ae-ef3d-428b-a6d5-1683eba214d9" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 02:59:56 user nova-compute[74898]: DEBUG nova.network.neutron [req-20053b92-fce6-43f5-9ab2-3abdc56b36c5 req-68c7b57f-6953-4427-94ac-e0617fd22fac service nova] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Refreshing network info cache for port 1bfa5db9-9200-4130-9007-fca16f7064c4 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 02:59:56 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:56 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:56 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:56 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:56 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:56 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:59:56 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 02:59:56 user nova-compute[74898]: INFO nova.compute.manager [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Took 12.86 seconds to spawn the instance on the hypervisor.
Nov 17 02:59:56 user nova-compute[74898]: DEBUG nova.compute.manager [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 02:59:56 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 02:59:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.254s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:56 user nova-compute[74898]: DEBUG nova.compute.manager [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 02:59:57 user nova-compute[74898]: INFO nova.compute.manager [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Took 14.56 seconds to build instance.
Nov 17 02:59:57 user nova-compute[74898]: DEBUG nova.compute.manager [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 02:59:57 user nova-compute[74898]: DEBUG nova.network.neutron [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 02:59:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8bc7ad57-2a63-4442-9a72-4dc2b50fa067 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.942s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:57 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 02:59:57 user nova-compute[74898]: DEBUG nova.compute.manager [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 02:59:57 user nova-compute[74898]: DEBUG nova.policy [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93084077b7414f73b09bd22324488e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08934f3952aa4f01809ed58e16905fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 02:59:57 user nova-compute[74898]: DEBUG nova.compute.manager [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 02:59:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 02:59:57 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Creating image(s)
Nov 17 02:59:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5885526-e2d0-41d4-8da1-b3440d243a19/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Lock "/opt/stack/data/nova/instances/e5885526-e2d0-41d4-8da1-b3440d243a19/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Lock "/opt/stack/data/nova/instances/e5885526-e2d0-41d4-8da1-b3440d243a19/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:57 user nova-compute[74898]: DEBUG nova.network.neutron [req-20053b92-fce6-43f5-9ab2-3abdc56b36c5 req-68c7b57f-6953-4427-94ac-e0617fd22fac service nova] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Updated VIF entry in instance network info cache for port 1bfa5db9-9200-4130-9007-fca16f7064c4. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 02:59:57 user nova-compute[74898]: DEBUG nova.network.neutron [req-20053b92-fce6-43f5-9ab2-3abdc56b36c5 req-68c7b57f-6953-4427-94ac-e0617fd22fac service nova] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Updating instance_info_cache with network_info: [{"id": "1bfa5db9-9200-4130-9007-fca16f7064c4", "address": "fa:16:3e:17:ef:99", "network": {"id": "52541a68-fc4e-4d45-8811-e55912d0ceec", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-194171318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29c2ce1c558846ac83600108cc07750d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bfa5db9-92", "ovs_interfaceid": "1bfa5db9-9200-4130-9007-fca16f7064c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 02:59:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-20053b92-fce6-43f5-9ab2-3abdc56b36c5 req-68c7b57f-6953-4427-94ac-e0617fd22fac service nova] Releasing lock "refresh_cache-20c6c8ae-ef3d-428b-a6d5-1683eba214d9" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 02:59:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.303s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:58 user nova-compute[74898]: DEBUG nova.compute.manager [req-da6b2ca7-9362-4b0f-9f7b-eeba4f850562 req-f85fa363-52c5-43e4-b6a0-9d47ad9216da service nova] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Received event network-vif-plugged-f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 02:59:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-da6b2ca7-9362-4b0f-9f7b-eeba4f850562 req-f85fa363-52c5-43e4-b6a0-9d47ad9216da service nova] Acquiring lock "e733574a-56ba-4e24-babd-855bcb5bda61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-da6b2ca7-9362-4b0f-9f7b-eeba4f850562 req-f85fa363-52c5-43e4-b6a0-9d47ad9216da service nova] Lock "e733574a-56ba-4e24-babd-855bcb5bda61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-da6b2ca7-9362-4b0f-9f7b-eeba4f850562 req-f85fa363-52c5-43e4-b6a0-9d47ad9216da service nova] Lock "e733574a-56ba-4e24-babd-855bcb5bda61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:58 user nova-compute[74898]: DEBUG nova.compute.manager [req-da6b2ca7-9362-4b0f-9f7b-eeba4f850562 req-f85fa363-52c5-43e4-b6a0-9d47ad9216da service nova] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] No waiting events found dispatching network-vif-plugged-f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 02:59:58 user nova-compute[74898]: WARNING nova.compute.manager [req-da6b2ca7-9362-4b0f-9f7b-eeba4f850562 req-f85fa363-52c5-43e4-b6a0-9d47ad9216da service nova] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Received unexpected event network-vif-plugged-f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75 for instance with vm_state active and task_state None.
Nov 17 02:59:58 user nova-compute[74898]: DEBUG nova.compute.manager [req-da6b2ca7-9362-4b0f-9f7b-eeba4f850562 req-f85fa363-52c5-43e4-b6a0-9d47ad9216da service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received event network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 02:59:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-da6b2ca7-9362-4b0f-9f7b-eeba4f850562 req-f85fa363-52c5-43e4-b6a0-9d47ad9216da service nova] Acquiring lock "11704034-7afe-475c-ae43-1324b40f0d92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-da6b2ca7-9362-4b0f-9f7b-eeba4f850562 req-f85fa363-52c5-43e4-b6a0-9d47ad9216da service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-da6b2ca7-9362-4b0f-9f7b-eeba4f850562 req-f85fa363-52c5-43e4-b6a0-9d47ad9216da service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:58 user nova-compute[74898]: DEBUG nova.compute.manager [req-da6b2ca7-9362-4b0f-9f7b-eeba4f850562 req-f85fa363-52c5-43e4-b6a0-9d47ad9216da service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] No waiting events found dispatching network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 02:59:58 user nova-compute[74898]: WARNING nova.compute.manager [req-da6b2ca7-9362-4b0f-9f7b-eeba4f850562 req-f85fa363-52c5-43e4-b6a0-9d47ad9216da service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received unexpected event network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 for instance with vm_state active and task_state None.
Nov 17 02:59:58 user nova-compute[74898]: DEBUG nova.compute.manager [req-da6b2ca7-9362-4b0f-9f7b-eeba4f850562 req-f85fa363-52c5-43e4-b6a0-9d47ad9216da service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received event network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 02:59:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-da6b2ca7-9362-4b0f-9f7b-eeba4f850562 req-f85fa363-52c5-43e4-b6a0-9d47ad9216da service nova] Acquiring lock "11704034-7afe-475c-ae43-1324b40f0d92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-da6b2ca7-9362-4b0f-9f7b-eeba4f850562 req-f85fa363-52c5-43e4-b6a0-9d47ad9216da service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-da6b2ca7-9362-4b0f-9f7b-eeba4f850562 req-f85fa363-52c5-43e4-b6a0-9d47ad9216da service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:58 user nova-compute[74898]: DEBUG nova.compute.manager [req-da6b2ca7-9362-4b0f-9f7b-eeba4f850562 req-f85fa363-52c5-43e4-b6a0-9d47ad9216da service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] No waiting events found dispatching network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 02:59:58 user nova-compute[74898]: WARNING nova.compute.manager [req-da6b2ca7-9362-4b0f-9f7b-eeba4f850562 req-f85fa363-52c5-43e4-b6a0-9d47ad9216da service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received unexpected event network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 for instance with vm_state active and task_state None.
Nov 17 02:59:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.302s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/e5885526-e2d0-41d4-8da1-b3440d243a19/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/e5885526-e2d0-41d4-8da1-b3440d243a19/disk 1073741824" returned: 0 in 0.159s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.467s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.413s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:58 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e5885526-e2d0-41d4-8da1-b3440d243a19/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 02:59:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5885526-e2d0-41d4-8da1-b3440d243a19/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:59:58 user nova-compute[74898]: DEBUG nova.network.neutron [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Successfully created port: 9bcfc458-e33f-4119-91dc-af8a29f214e8 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 02:59:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5885526-e2d0-41d4-8da1-b3440d243a19/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:59:58 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Cannot resize image /opt/stack/data/nova/instances/e5885526-e2d0-41d4-8da1-b3440d243a19/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 02:59:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 02:59:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Ensure instance console log exists: /opt/stack/data/nova/instances/e5885526-e2d0-41d4-8da1-b3440d243a19/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 02:59:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:59:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:59:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:59:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:59:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG nova.network.neutron [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Successfully updated port: 9bcfc458-e33f-4119-91dc-af8a29f214e8 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Acquiring lock "refresh_cache-e5885526-e2d0-41d4-8da1-b3440d243a19" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Acquired lock "refresh_cache-e5885526-e2d0-41d4-8da1-b3440d243a19" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG nova.network.neutron [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG nova.compute.manager [req-a3ac05b1-d4b9-41ed-a1f9-cab1c4c039bf req-a61e4f9d-068a-4d88-9445-0e798ce72400 service nova] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Received event network-changed-9bcfc458-e33f-4119-91dc-af8a29f214e8 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG nova.compute.manager [req-a3ac05b1-d4b9-41ed-a1f9-cab1c4c039bf req-a61e4f9d-068a-4d88-9445-0e798ce72400 service nova] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Refreshing instance network info cache due to event network-changed-9bcfc458-e33f-4119-91dc-af8a29f214e8. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a3ac05b1-d4b9-41ed-a1f9-cab1c4c039bf req-a61e4f9d-068a-4d88-9445-0e798ce72400 service nova] Acquiring lock "refresh_cache-e5885526-e2d0-41d4-8da1-b3440d243a19" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG nova.network.neutron [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG nova.network.neutron [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Updating instance_info_cache with network_info: [{"id": "9bcfc458-e33f-4119-91dc-af8a29f214e8", "address": "fa:16:3e:15:7a:74", "network": {"id": "8084ece6-42d8-412f-841a-f0a2b78991fa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1363926162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08934f3952aa4f01809ed58e16905fd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bcfc458-e3", "ovs_interfaceid": "9bcfc458-e33f-4119-91dc-af8a29f214e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Releasing lock "refresh_cache-e5885526-e2d0-41d4-8da1-b3440d243a19" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG nova.compute.manager [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Instance network_info: |[{"id": "9bcfc458-e33f-4119-91dc-af8a29f214e8", "address": "fa:16:3e:15:7a:74", "network": {"id": "8084ece6-42d8-412f-841a-f0a2b78991fa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1363926162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08934f3952aa4f01809ed58e16905fd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bcfc458-e3", "ovs_interfaceid": "9bcfc458-e33f-4119-91dc-af8a29f214e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a3ac05b1-d4b9-41ed-a1f9-cab1c4c039bf req-a61e4f9d-068a-4d88-9445-0e798ce72400 service nova] Acquired lock "refresh_cache-e5885526-e2d0-41d4-8da1-b3440d243a19" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG nova.network.neutron [req-a3ac05b1-d4b9-41ed-a1f9-cab1c4c039bf req-a61e4f9d-068a-4d88-9445-0e798ce72400 service nova] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Refreshing network info cache for port 9bcfc458-e33f-4119-91dc-af8a29f214e8 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Start _get_guest_xml network_info=[{"id": "9bcfc458-e33f-4119-91dc-af8a29f214e8", "address": "fa:16:3e:15:7a:74", "network": {"id": "8084ece6-42d8-412f-841a-f0a2b78991fa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1363926162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08934f3952aa4f01809ed58e16905fd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bcfc458-e3", "ovs_interfaceid": "9bcfc458-e33f-4119-91dc-af8a29f214e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:00:00 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:00:00 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:00:00 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:59:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1346803539',display_name='tempest-VolumesAssistedSnapshotsTest-server-1346803539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1346803539',id=9,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxzg7Va6PTW9bTrepjvinQmsSUemZ5Gcj2p486It2ugKXaqN4w5w24X992yN7jBzyi5lm7BNinGAzDIG7f3lM1DWALT1ZcATMF9WmYgjTzZ3T7fVwQ4IJxgGojRd7s/bw==',key_name='tempest-keypair-1780004240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08934f3952aa4f01809ed58e16905fd1',ramdisk_id='',reservation_id='r-ye0jfeu1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-796155726',owner_user_name='tempest-VolumesAssistedSnapshotsTest-796155726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T02:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93084077b7414f73b09bd22324488e74',uuid=e5885526-e2d0-41d4-8da1-b3440d243a19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bcfc458-e33f-4119-91dc-af8a29f214e8", "address": "fa:16:3e:15:7a:74", "network": {"id": "8084ece6-42d8-412f-841a-f0a2b78991fa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1363926162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08934f3952aa4f01809ed58e16905fd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bcfc458-e3", "ovs_interfaceid": "9bcfc458-e33f-4119-91dc-af8a29f214e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Converting VIF {"id": "9bcfc458-e33f-4119-91dc-af8a29f214e8", "address": "fa:16:3e:15:7a:74", "network": {"id": "8084ece6-42d8-412f-841a-f0a2b78991fa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1363926162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08934f3952aa4f01809ed58e16905fd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bcfc458-e3", "ovs_interfaceid": "9bcfc458-e33f-4119-91dc-af8a29f214e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:7a:74,bridge_name='br-int',has_traffic_filtering=True,id=9bcfc458-e33f-4119-91dc-af8a29f214e8,network=Network(8084ece6-42d8-412f-841a-f0a2b78991fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bcfc458-e3') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:00:00 user nova-compute[74898]: DEBUG nova.objects.instance [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Lazy-loading 'pci_devices' on Instance uuid e5885526-e2d0-41d4-8da1-b3440d243a19 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:00:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:00:01 user nova-compute[74898]:   <uuid>e5885526-e2d0-41d4-8da1-b3440d243a19</uuid>
Nov 17 03:00:01 user nova-compute[74898]:   <name>instance-00000009</name>
Nov 17 03:00:01 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:00:01 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:00:01 user nova-compute[74898]:   <metadata>
Nov 17 03:00:01 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:00:01 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:00:01 user nova-compute[74898]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1346803539</nova:name>
Nov 17 03:00:01 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:00:00</nova:creationTime>
Nov 17 03:00:01 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:00:01 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:00:01 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:00:01 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:00:01 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:00:01 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:00:01 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:00:01 user nova-compute[74898]:       <nova:owner>
Nov 17 03:00:01 user nova-compute[74898]:         <nova:user uuid="93084077b7414f73b09bd22324488e74">tempest-VolumesAssistedSnapshotsTest-796155726-project-member</nova:user>
Nov 17 03:00:01 user nova-compute[74898]:         <nova:project uuid="08934f3952aa4f01809ed58e16905fd1">tempest-VolumesAssistedSnapshotsTest-796155726</nova:project>
Nov 17 03:00:01 user nova-compute[74898]:       </nova:owner>
Nov 17 03:00:01 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:00:01 user nova-compute[74898]:       <nova:ports>
Nov 17 03:00:01 user nova-compute[74898]:         <nova:port uuid="9bcfc458-e33f-4119-91dc-af8a29f214e8">
Nov 17 03:00:01 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 17 03:00:01 user nova-compute[74898]:         </nova:port>
Nov 17 03:00:01 user nova-compute[74898]:       </nova:ports>
Nov 17 03:00:01 user nova-compute[74898]:     </nova:instance>
Nov 17 03:00:01 user nova-compute[74898]:   </metadata>
Nov 17 03:00:01 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:00:01 user nova-compute[74898]:     <system>
Nov 17 03:00:01 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:00:01 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:00:01 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:00:01 user nova-compute[74898]:       <entry name="serial">e5885526-e2d0-41d4-8da1-b3440d243a19</entry>
Nov 17 03:00:01 user nova-compute[74898]:       <entry name="uuid">e5885526-e2d0-41d4-8da1-b3440d243a19</entry>
Nov 17 03:00:01 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:00:01 user nova-compute[74898]:     </system>
Nov 17 03:00:01 user nova-compute[74898]:   </sysinfo>
Nov 17 03:00:01 user nova-compute[74898]:   <os>
Nov 17 03:00:01 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:00:01 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:00:01 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:00:01 user nova-compute[74898]:   </os>
Nov 17 03:00:01 user nova-compute[74898]:   <features>
Nov 17 03:00:01 user nova-compute[74898]:     <acpi/>
Nov 17 03:00:01 user nova-compute[74898]:     <apic/>
Nov 17 03:00:01 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:00:01 user nova-compute[74898]:   </features>
Nov 17 03:00:01 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:00:01 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:00:01 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:00:01 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:00:01 user nova-compute[74898]:   </clock>
Nov 17 03:00:01 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:00:01 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:00:01 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:00:01 user nova-compute[74898]:   </cpu>
Nov 17 03:00:01 user nova-compute[74898]:   <devices>
Nov 17 03:00:01 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:00:01 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:00:01 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/e5885526-e2d0-41d4-8da1-b3440d243a19/disk"/>
Nov 17 03:00:01 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:00:01 user nova-compute[74898]:     </disk>
Nov 17 03:00:01 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:00:01 user nova-compute[74898]:       <mac address="fa:16:3e:15:7a:74"/>
Nov 17 03:00:01 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:00:01 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:00:01 user nova-compute[74898]:       <target dev="tap9bcfc458-e3"/>
Nov 17 03:00:01 user nova-compute[74898]:     </interface>
Nov 17 03:00:01 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:00:01 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/e5885526-e2d0-41d4-8da1-b3440d243a19/console.log" append="off"/>
Nov 17 03:00:01 user nova-compute[74898]:     </serial>
Nov 17 03:00:01 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:00:01 user nova-compute[74898]:     <video>
Nov 17 03:00:01 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:00:01 user nova-compute[74898]:     </video>
Nov 17 03:00:01 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:00:01 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:00:01 user nova-compute[74898]:     </rng>
Nov 17 03:00:01 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:00:01 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:00:01 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:00:01 user nova-compute[74898]:     </memballoon>
Nov 17 03:00:01 user nova-compute[74898]:   </devices>
Nov 17 03:00:01 user nova-compute[74898]: </domain>
Nov 17 03:00:01 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:00:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:59:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1346803539',display_name='tempest-VolumesAssistedSnapshotsTest-server-1346803539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1346803539',id=9,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxzg7Va6PTW9bTrepjvinQmsSUemZ5Gcj2p486It2ugKXaqN4w5w24X992yN7jBzyi5lm7BNinGAzDIG7f3lM1DWALT1ZcATMF9WmYgjTzZ3T7fVwQ4IJxgGojRd7s/bw==',key_name='tempest-keypair-1780004240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08934f3952aa4f01809ed58e16905fd1',ramdisk_id='',reservation_id='r-ye0jfeu1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-796155726',owner_user_name='tempest-VolumesAssistedSnapshotsTest-796155726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T02:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93084077b7414f73b09bd22324488e74',uuid=e5885526-e2d0-41d4-8da1-b3440d243a19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bcfc458-e33f-4119-91dc-af8a29f214e8", "address": "fa:16:3e:15:7a:74", "network": {"id": "8084ece6-42d8-412f-841a-f0a2b78991fa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1363926162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08934f3952aa4f01809ed58e16905fd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bcfc458-e3", "ovs_interfaceid": "9bcfc458-e33f-4119-91dc-af8a29f214e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:00:01 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Converting VIF {"id": "9bcfc458-e33f-4119-91dc-af8a29f214e8", "address": "fa:16:3e:15:7a:74", "network": {"id": "8084ece6-42d8-412f-841a-f0a2b78991fa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1363926162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08934f3952aa4f01809ed58e16905fd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bcfc458-e3", "ovs_interfaceid": "9bcfc458-e33f-4119-91dc-af8a29f214e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:00:01 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:7a:74,bridge_name='br-int',has_traffic_filtering=True,id=9bcfc458-e33f-4119-91dc-af8a29f214e8,network=Network(8084ece6-42d8-412f-841a-f0a2b78991fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bcfc458-e3') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:00:01 user nova-compute[74898]: DEBUG os_vif [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:7a:74,bridge_name='br-int',has_traffic_filtering=True,id=9bcfc458-e33f-4119-91dc-af8a29f214e8,network=Network(8084ece6-42d8-412f-841a-f0a2b78991fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bcfc458-e3') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:00:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:00:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '457a9967-f31f-578c-8f0e-f4829cdfd8a9', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:00:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9bcfc458-e3, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9bcfc458-e3, col_values=(('qos', UUID('6b43f84c-b301-4269-92a2-9e58850183e1')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9bcfc458-e3, col_values=(('external_ids', {'iface-id': '9bcfc458-e33f-4119-91dc-af8a29f214e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:7a:74', 'vm-uuid': 'e5885526-e2d0-41d4-8da1-b3440d243a19'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:00:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:01 user nova-compute[74898]: INFO os_vif [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:7a:74,bridge_name='br-int',has_traffic_filtering=True,id=9bcfc458-e33f-4119-91dc-af8a29f214e8,network=Network(8084ece6-42d8-412f-841a-f0a2b78991fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bcfc458-e3')
Nov 17 03:00:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:00:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] No VIF found with MAC fa:16:3e:15:7a:74, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:00:01 user nova-compute[74898]: DEBUG nova.compute.manager [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:00:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:00:01 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Instance spawned successfully.
Nov 17 03:00:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:00:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:00:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:00:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:00:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:00:01 user nova-compute[74898]: INFO nova.compute.manager [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Took 10.16 seconds to spawn the instance on the hypervisor.
Nov 17 03:00:01 user nova-compute[74898]: DEBUG nova.compute.manager [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:00:01 user nova-compute[74898]: DEBUG nova.network.neutron [req-a3ac05b1-d4b9-41ed-a1f9-cab1c4c039bf req-a61e4f9d-068a-4d88-9445-0e798ce72400 service nova] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Updated VIF entry in instance network info cache for port 9bcfc458-e33f-4119-91dc-af8a29f214e8. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:00:01 user nova-compute[74898]: DEBUG nova.network.neutron [req-a3ac05b1-d4b9-41ed-a1f9-cab1c4c039bf req-a61e4f9d-068a-4d88-9445-0e798ce72400 service nova] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Updating instance_info_cache with network_info: [{"id": "9bcfc458-e33f-4119-91dc-af8a29f214e8", "address": "fa:16:3e:15:7a:74", "network": {"id": "8084ece6-42d8-412f-841a-f0a2b78991fa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1363926162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08934f3952aa4f01809ed58e16905fd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bcfc458-e3", "ovs_interfaceid": "9bcfc458-e33f-4119-91dc-af8a29f214e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:00:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a3ac05b1-d4b9-41ed-a1f9-cab1c4c039bf req-a61e4f9d-068a-4d88-9445-0e798ce72400 service nova] Releasing lock "refresh_cache-e5885526-e2d0-41d4-8da1-b3440d243a19" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:00:01 user nova-compute[74898]: INFO nova.compute.manager [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Took 11.97 seconds to build instance.
Nov 17 03:00:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f9ac5e71-548f-4929-bde5-9fad479d6f8a tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lock "20c6c8ae-ef3d-428b-a6d5-1683eba214d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.214s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:05 user nova-compute[74898]: DEBUG nova.compute.manager [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:00:05 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:00:05 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Instance spawned successfully.
Nov 17 03:00:05 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:00:05 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:00:05 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:00:05 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:00:05 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:00:05 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:00:05 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:00:05 user nova-compute[74898]: INFO nova.compute.manager [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Took 8.17 seconds to spawn the instance on the hypervisor.
Nov 17 03:00:05 user nova-compute[74898]: DEBUG nova.compute.manager [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:00:05 user nova-compute[74898]: INFO nova.compute.manager [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Took 10.17 seconds to build instance.
Nov 17 03:00:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-33f7a44b-3aeb-4a26-83ac-778141ab3a7c tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Lock "e5885526-e2d0-41d4-8da1-b3440d243a19" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.437s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:08 user nova-compute[74898]: DEBUG nova.compute.manager [req-a6b796cf-8806-49d6-8480-40e31be6de9b req-84bbda7f-c916-4d43-a043-0a178f051aaf service nova] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Received event network-vif-plugged-ba899c72-f082-46fe-9a32-b548a4d653e2 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a6b796cf-8806-49d6-8480-40e31be6de9b req-84bbda7f-c916-4d43-a043-0a178f051aaf service nova] Acquiring lock "9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a6b796cf-8806-49d6-8480-40e31be6de9b req-84bbda7f-c916-4d43-a043-0a178f051aaf service nova] Lock "9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a6b796cf-8806-49d6-8480-40e31be6de9b req-84bbda7f-c916-4d43-a043-0a178f051aaf service nova] Lock "9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:08 user nova-compute[74898]: DEBUG nova.compute.manager [req-a6b796cf-8806-49d6-8480-40e31be6de9b req-84bbda7f-c916-4d43-a043-0a178f051aaf service nova] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] No waiting events found dispatching network-vif-plugged-ba899c72-f082-46fe-9a32-b548a4d653e2 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:00:08 user nova-compute[74898]: WARNING nova.compute.manager [req-a6b796cf-8806-49d6-8480-40e31be6de9b req-84bbda7f-c916-4d43-a043-0a178f051aaf service nova] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Received unexpected event network-vif-plugged-ba899c72-f082-46fe-9a32-b548a4d653e2 for instance with vm_state active and task_state None.
Nov 17 03:00:09 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:00:09 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Cleaning up deleted instances {{(pid=74898) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 17 03:00:09 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] There are 0 instances to clean {{(pid=74898) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 17 03:00:09 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:00:09 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Cleaning up deleted instances with incomplete migration  {{(pid=74898) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 17 03:00:09 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:00:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:10 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:00:10 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Received event network-vif-plugged-ba899c72-f082-46fe-9a32-b548a4d653e2 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] Acquiring lock "9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] Lock "9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] Lock "9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] No waiting events found dispatching network-vif-plugged-ba899c72-f082-46fe-9a32-b548a4d653e2 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:00:11 user nova-compute[74898]: WARNING nova.compute.manager [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Received unexpected event network-vif-plugged-ba899c72-f082-46fe-9a32-b548a4d653e2 for instance with vm_state active and task_state None.
Nov 17 03:00:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Received event network-vif-plugged-bd3b73ca-0068-42f4-8cf3-f84932dee960 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] Acquiring lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] Lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] Lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] No waiting events found dispatching network-vif-plugged-bd3b73ca-0068-42f4-8cf3-f84932dee960 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:00:11 user nova-compute[74898]: WARNING nova.compute.manager [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Received unexpected event network-vif-plugged-bd3b73ca-0068-42f4-8cf3-f84932dee960 for instance with vm_state active and task_state None.
Nov 17 03:00:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Received event network-vif-plugged-bd3b73ca-0068-42f4-8cf3-f84932dee960 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] Acquiring lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] Lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] Lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] No waiting events found dispatching network-vif-plugged-bd3b73ca-0068-42f4-8cf3-f84932dee960 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:00:11 user nova-compute[74898]: WARNING nova.compute.manager [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Received unexpected event network-vif-plugged-bd3b73ca-0068-42f4-8cf3-f84932dee960 for instance with vm_state active and task_state None.
Nov 17 03:00:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Received event network-vif-plugged-1bfa5db9-9200-4130-9007-fca16f7064c4 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] Acquiring lock "20c6c8ae-ef3d-428b-a6d5-1683eba214d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] Lock "20c6c8ae-ef3d-428b-a6d5-1683eba214d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] Lock "20c6c8ae-ef3d-428b-a6d5-1683eba214d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] No waiting events found dispatching network-vif-plugged-1bfa5db9-9200-4130-9007-fca16f7064c4 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:00:11 user nova-compute[74898]: WARNING nova.compute.manager [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Received unexpected event network-vif-plugged-1bfa5db9-9200-4130-9007-fca16f7064c4 for instance with vm_state active and task_state None.
Nov 17 03:00:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Received event network-vif-plugged-1bfa5db9-9200-4130-9007-fca16f7064c4 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] Acquiring lock "20c6c8ae-ef3d-428b-a6d5-1683eba214d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] Lock "20c6c8ae-ef3d-428b-a6d5-1683eba214d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] Lock "20c6c8ae-ef3d-428b-a6d5-1683eba214d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] No waiting events found dispatching network-vif-plugged-1bfa5db9-9200-4130-9007-fca16f7064c4 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:00:11 user nova-compute[74898]: WARNING nova.compute.manager [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Received unexpected event network-vif-plugged-1bfa5db9-9200-4130-9007-fca16f7064c4 for instance with vm_state active and task_state None.
Nov 17 03:00:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Received event network-vif-plugged-9bcfc458-e33f-4119-91dc-af8a29f214e8 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] Acquiring lock "e5885526-e2d0-41d4-8da1-b3440d243a19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] Lock "e5885526-e2d0-41d4-8da1-b3440d243a19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] Lock "e5885526-e2d0-41d4-8da1-b3440d243a19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] No waiting events found dispatching network-vif-plugged-9bcfc458-e33f-4119-91dc-af8a29f214e8 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:00:11 user nova-compute[74898]: WARNING nova.compute.manager [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Received unexpected event network-vif-plugged-9bcfc458-e33f-4119-91dc-af8a29f214e8 for instance with vm_state active and task_state None.
Nov 17 03:00:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Received event network-vif-plugged-9bcfc458-e33f-4119-91dc-af8a29f214e8 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] Acquiring lock "e5885526-e2d0-41d4-8da1-b3440d243a19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] Lock "e5885526-e2d0-41d4-8da1-b3440d243a19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] Lock "e5885526-e2d0-41d4-8da1-b3440d243a19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] No waiting events found dispatching network-vif-plugged-9bcfc458-e33f-4119-91dc-af8a29f214e8 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:00:11 user nova-compute[74898]: WARNING nova.compute.manager [req-b82963e5-12ac-452e-9041-0e3c03f272b1 req-0b6e7a38-2df4-4b3a-8ffd-cf39cf828c0a service nova] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Received unexpected event network-vif-plugged-9bcfc458-e33f-4119-91dc-af8a29f214e8 for instance with vm_state active and task_state None.
Nov 17 03:00:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Rebuilding the list of instances to heal {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-33dd1cff-39dc-4eba-ab39-c9239632cccc" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-33dd1cff-39dc-4eba-ab39-c9239632cccc" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:00:11 user nova-compute[74898]: DEBUG nova.objects.instance [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lazy-loading 'info_cache' on Instance uuid 33dd1cff-39dc-4eba-ab39-c9239632cccc {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:00:12 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Updating instance_info_cache with network_info: [{"id": "f42f6852-a6ae-44cd-8ece-8d0d752c714c", "address": "fa:16:3e:f3:93:7f", "network": {"id": "b4d0cc21-8655-4c40-b432-138148a77dd1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1477483123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74586ad5235f439d8873accc42469cba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf42f6852-a6", "ovs_interfaceid": "f42f6852-a6ae-44cd-8ece-8d0d752c714c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:00:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-33dd1cff-39dc-4eba-ab39-c9239632cccc" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:00:12 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:00:12 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:00:12 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:00:13 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:00:13 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:00:13 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:00:13 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:00:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:13 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:00:14 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33dd1cff-39dc-4eba-ab39-c9239632cccc/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:14 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33dd1cff-39dc-4eba-ab39-c9239632cccc/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:14 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33dd1cff-39dc-4eba-ab39-c9239632cccc/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:14 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33dd1cff-39dc-4eba-ab39-c9239632cccc/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:14 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:14 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:14 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:14 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:14 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5885526-e2d0-41d4-8da1-b3440d243a19/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5885526-e2d0-41d4-8da1-b3440d243a19/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5885526-e2d0-41d4-8da1-b3440d243a19/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5885526-e2d0-41d4-8da1-b3440d243a19/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:16 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c6c8ae-ef3d-428b-a6d5-1683eba214d9/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c6c8ae-ef3d-428b-a6d5-1683eba214d9/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c6c8ae-ef3d-428b-a6d5-1683eba214d9/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c6c8ae-ef3d-428b-a6d5-1683eba214d9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:18 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:00:18 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:00:18 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=7410MB free_disk=25.74224853515625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:00:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:18 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 33dd1cff-39dc-4eba-ab39-c9239632cccc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:00:18 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:00:18 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance e733574a-56ba-4e24-babd-855bcb5bda61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:00:18 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 11704034-7afe-475c-ae43-1324b40f0d92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:00:18 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 015ff42a-4d69-4f60-b86c-c6bd68d23c99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:00:18 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:00:18 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance b886ada4-5bcb-4b2a-b69e-80edefdd2119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:00:18 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 20c6c8ae-ef3d-428b-a6d5-1683eba214d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:00:18 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance e5885526-e2d0-41d4-8da1-b3440d243a19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:00:18 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:00:18 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:00:18 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Refreshing inventories for resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 17 03:00:18 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Updating ProviderTree inventory for provider b743bdc9-a8bb-467c-98c8-06f1954f87df from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 17 03:00:18 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Updating inventory in ProviderTree for provider b743bdc9-a8bb-467c-98c8-06f1954f87df with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 17 03:00:18 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Refreshing aggregate associations for resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df, aggregates: None {{(pid=74898) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 17 03:00:18 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Refreshing trait associations for resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=74898) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 17 03:00:19 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:00:19 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:00:19 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:00:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.947s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:21 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:00:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "df13492d-d351-49c1-9755-7c30caae89f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:24 user nova-compute[74898]: DEBUG nova.compute.manager [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:00:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:25 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:00:25 user nova-compute[74898]: INFO nova.compute.claims [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Claim successful on node user
Nov 17 03:00:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:25 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:00:25 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:00:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:25 user nova-compute[74898]: DEBUG nova.compute.manager [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:00:25 user nova-compute[74898]: DEBUG nova.compute.manager [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:00:25 user nova-compute[74898]: DEBUG nova.network.neutron [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:00:25 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:00:25 user nova-compute[74898]: DEBUG nova.compute.manager [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:00:25 user nova-compute[74898]: INFO nova.virt.block_device [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Booting with volume 35255e9c-5fd6-477f-818a-3fc7fbe655d1 at /dev/vda
Nov 17 03:00:25 user nova-compute[74898]: DEBUG os_brick.utils [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:00:25 user nova-compute[74898]: INFO oslo.privsep.daemon [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpv50jua4f/privsep.sock']
Nov 17 03:00:25 user nova-compute[74898]: DEBUG nova.policy [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c9a303c92cc4937a595f49417224e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd06ab04c365d49639386a4c40620f735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:00:25 user sudo[86016]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpv50jua4f/privsep.sock
Nov 17 03:00:25 user sudo[86016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 17 03:00:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:26 user nova-compute[74898]: DEBUG nova.network.neutron [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Successfully created port: 33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:00:27 user nova-compute[74898]: DEBUG nova.network.neutron [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Successfully created port: e20d2c64-8b92-434c-84a4-d28453214349 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:00:27 user sudo[86016]: pam_unix(sudo:session): session closed for user root
Nov 17 03:00:27 user nova-compute[74898]: INFO oslo.privsep.daemon [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Spawned new privsep daemon via rootwrap
Nov 17 03:00:27 user nova-compute[74898]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 17 03:00:27 user nova-compute[74898]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 17 03:00:27 user nova-compute[74898]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 17 03:00:27 user nova-compute[74898]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86021
Nov 17 03:00:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cc09d8-7ae5-4b79-b0c6-c9cc350d342c]: (2,) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccacc320-3580-47f8-b4d1-ac42f0dc66ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:27 user nova-compute[74898]: WARNING os_brick.initiator.connectors.nvmeof [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 17 03:00:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2588238d-f4c3-4f3a-b82a-bc810ccc935a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:27 user nova-compute[74898]: DEBUG nova.network.neutron [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Successfully created port: e0003a9c-9202-4863-92aa-0fd29a026c8c {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:00:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdf647a-c814-45ce-951d-7e5536c32116]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c7fdb9-dea9-4f5b-8489-a87ca07d7594]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:00:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:00:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:00:27 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:00:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a764098a-018d-467e-92a7-b3ed15d6f6dd]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:00:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:00:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:00:27 user nova-compute[74898]: DEBUG os_brick.utils [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] <== get_connector_properties: return (2027ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:00:27 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Updating existing volume attachment record: 971a0d0e-e9fc-4326-bd15-29538435e649 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:00:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:28 user nova-compute[74898]: DEBUG nova.network.neutron [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Successfully created port: 207857d3-8c12-4e4f-b934-c69ed1f92961 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:00:29 user nova-compute[74898]: DEBUG nova.network.neutron [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Successfully created port: 7b0aade1-07ec-4744-b85c-d71ff8e10663 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:00:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:30 user nova-compute[74898]: DEBUG nova.network.neutron [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Successfully updated port: 33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:00:30 user nova-compute[74898]: DEBUG nova.compute.manager [req-4d12d0a3-e2b7-49cd-823b-b1aa459828a5 req-53c207d0-8e65-4cb5-8b88-28fb1fd783c4 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-changed-33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:30 user nova-compute[74898]: DEBUG nova.compute.manager [req-4d12d0a3-e2b7-49cd-823b-b1aa459828a5 req-53c207d0-8e65-4cb5-8b88-28fb1fd783c4 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Refreshing instance network info cache due to event network-changed-33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:00:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4d12d0a3-e2b7-49cd-823b-b1aa459828a5 req-53c207d0-8e65-4cb5-8b88-28fb1fd783c4 service nova] Acquiring lock "refresh_cache-df13492d-d351-49c1-9755-7c30caae89f1" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:00:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4d12d0a3-e2b7-49cd-823b-b1aa459828a5 req-53c207d0-8e65-4cb5-8b88-28fb1fd783c4 service nova] Acquired lock "refresh_cache-df13492d-d351-49c1-9755-7c30caae89f1" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:00:30 user nova-compute[74898]: DEBUG nova.network.neutron [req-4d12d0a3-e2b7-49cd-823b-b1aa459828a5 req-53c207d0-8e65-4cb5-8b88-28fb1fd783c4 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Refreshing network info cache for port 33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:00:30 user nova-compute[74898]: DEBUG nova.network.neutron [req-4d12d0a3-e2b7-49cd-823b-b1aa459828a5 req-53c207d0-8e65-4cb5-8b88-28fb1fd783c4 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:00:30 user nova-compute[74898]: DEBUG nova.network.neutron [req-4d12d0a3-e2b7-49cd-823b-b1aa459828a5 req-53c207d0-8e65-4cb5-8b88-28fb1fd783c4 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:00:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4d12d0a3-e2b7-49cd-823b-b1aa459828a5 req-53c207d0-8e65-4cb5-8b88-28fb1fd783c4 service nova] Releasing lock "refresh_cache-df13492d-d351-49c1-9755-7c30caae89f1" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:00:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:31 user nova-compute[74898]: DEBUG nova.network.neutron [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Successfully updated port: c1a0a6a3-d445-4e76-b6ca-1183ae4b724f {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:00:32 user nova-compute[74898]: DEBUG nova.compute.manager [req-5fbadc4e-b3ee-4aac-a668-2669b5720eea req-3584fd6d-8e28-4284-bbbd-13d003efc403 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-changed-c1a0a6a3-d445-4e76-b6ca-1183ae4b724f {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:32 user nova-compute[74898]: DEBUG nova.compute.manager [req-5fbadc4e-b3ee-4aac-a668-2669b5720eea req-3584fd6d-8e28-4284-bbbd-13d003efc403 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Refreshing instance network info cache due to event network-changed-c1a0a6a3-d445-4e76-b6ca-1183ae4b724f. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:00:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5fbadc4e-b3ee-4aac-a668-2669b5720eea req-3584fd6d-8e28-4284-bbbd-13d003efc403 service nova] Acquiring lock "refresh_cache-df13492d-d351-49c1-9755-7c30caae89f1" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:00:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5fbadc4e-b3ee-4aac-a668-2669b5720eea req-3584fd6d-8e28-4284-bbbd-13d003efc403 service nova] Acquired lock "refresh_cache-df13492d-d351-49c1-9755-7c30caae89f1" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:00:32 user nova-compute[74898]: DEBUG nova.network.neutron [req-5fbadc4e-b3ee-4aac-a668-2669b5720eea req-3584fd6d-8e28-4284-bbbd-13d003efc403 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Refreshing network info cache for port c1a0a6a3-d445-4e76-b6ca-1183ae4b724f {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:00:32 user nova-compute[74898]: DEBUG nova.network.neutron [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Successfully updated port: d59452b9-ad23-4cfd-810a-776bb572d493 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:00:32 user nova-compute[74898]: DEBUG nova.network.neutron [req-5fbadc4e-b3ee-4aac-a668-2669b5720eea req-3584fd6d-8e28-4284-bbbd-13d003efc403 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:00:32 user nova-compute[74898]: DEBUG nova.network.neutron [req-5fbadc4e-b3ee-4aac-a668-2669b5720eea req-3584fd6d-8e28-4284-bbbd-13d003efc403 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:00:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5fbadc4e-b3ee-4aac-a668-2669b5720eea req-3584fd6d-8e28-4284-bbbd-13d003efc403 service nova] Releasing lock "refresh_cache-df13492d-d351-49c1-9755-7c30caae89f1" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:00:33 user nova-compute[74898]: DEBUG nova.network.neutron [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Successfully updated port: e20d2c64-8b92-434c-84a4-d28453214349 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:00:34 user nova-compute[74898]: DEBUG nova.network.neutron [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Successfully updated port: e0003a9c-9202-4863-92aa-0fd29a026c8c {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:00:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-b6832d52-daec-4612-83c7-f4914d2de513 req-db43348d-8ca9-4d92-baa5-4c51a48751aa service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-changed-d59452b9-ad23-4cfd-810a-776bb572d493 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-b6832d52-daec-4612-83c7-f4914d2de513 req-db43348d-8ca9-4d92-baa5-4c51a48751aa service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Refreshing instance network info cache due to event network-changed-d59452b9-ad23-4cfd-810a-776bb572d493. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:00:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b6832d52-daec-4612-83c7-f4914d2de513 req-db43348d-8ca9-4d92-baa5-4c51a48751aa service nova] Acquiring lock "refresh_cache-df13492d-d351-49c1-9755-7c30caae89f1" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:00:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b6832d52-daec-4612-83c7-f4914d2de513 req-db43348d-8ca9-4d92-baa5-4c51a48751aa service nova] Acquired lock "refresh_cache-df13492d-d351-49c1-9755-7c30caae89f1" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:00:34 user nova-compute[74898]: DEBUG nova.network.neutron [req-b6832d52-daec-4612-83c7-f4914d2de513 req-db43348d-8ca9-4d92-baa5-4c51a48751aa service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Refreshing network info cache for port d59452b9-ad23-4cfd-810a-776bb572d493 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:00:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Acquiring lock "4b869a55-acf6-4550-9354-2480273a4ee2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "4b869a55-acf6-4550-9354-2480273a4ee2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:34 user nova-compute[74898]: DEBUG nova.compute.manager [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:00:34 user nova-compute[74898]: DEBUG nova.network.neutron [req-b6832d52-daec-4612-83c7-f4914d2de513 req-db43348d-8ca9-4d92-baa5-4c51a48751aa service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:00:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:34 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:00:34 user nova-compute[74898]: INFO nova.compute.claims [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Claim successful on node user
Nov 17 03:00:34 user nova-compute[74898]: DEBUG nova.network.neutron [req-b6832d52-daec-4612-83c7-f4914d2de513 req-db43348d-8ca9-4d92-baa5-4c51a48751aa service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b6832d52-daec-4612-83c7-f4914d2de513 req-db43348d-8ca9-4d92-baa5-4c51a48751aa service nova] Releasing lock "refresh_cache-df13492d-d351-49c1-9755-7c30caae89f1" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG nova.compute.manager [req-b6832d52-daec-4612-83c7-f4914d2de513 req-db43348d-8ca9-4d92-baa5-4c51a48751aa service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-changed-e20d2c64-8b92-434c-84a4-d28453214349 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG nova.compute.manager [req-b6832d52-daec-4612-83c7-f4914d2de513 req-db43348d-8ca9-4d92-baa5-4c51a48751aa service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Refreshing instance network info cache due to event network-changed-e20d2c64-8b92-434c-84a4-d28453214349. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b6832d52-daec-4612-83c7-f4914d2de513 req-db43348d-8ca9-4d92-baa5-4c51a48751aa service nova] Acquiring lock "refresh_cache-df13492d-d351-49c1-9755-7c30caae89f1" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b6832d52-daec-4612-83c7-f4914d2de513 req-db43348d-8ca9-4d92-baa5-4c51a48751aa service nova] Acquired lock "refresh_cache-df13492d-d351-49c1-9755-7c30caae89f1" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG nova.network.neutron [req-b6832d52-daec-4612-83c7-f4914d2de513 req-db43348d-8ca9-4d92-baa5-4c51a48751aa service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Refreshing network info cache for port e20d2c64-8b92-434c-84a4-d28453214349 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG nova.network.neutron [req-b6832d52-daec-4612-83c7-f4914d2de513 req-db43348d-8ca9-4d92-baa5-4c51a48751aa service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG nova.compute.manager [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG nova.network.neutron [req-b6832d52-daec-4612-83c7-f4914d2de513 req-db43348d-8ca9-4d92-baa5-4c51a48751aa service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b6832d52-daec-4612-83c7-f4914d2de513 req-db43348d-8ca9-4d92-baa5-4c51a48751aa service nova] Releasing lock "refresh_cache-df13492d-d351-49c1-9755-7c30caae89f1" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG nova.compute.manager [req-b6832d52-daec-4612-83c7-f4914d2de513 req-db43348d-8ca9-4d92-baa5-4c51a48751aa service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-changed-e0003a9c-9202-4863-92aa-0fd29a026c8c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG nova.compute.manager [req-b6832d52-daec-4612-83c7-f4914d2de513 req-db43348d-8ca9-4d92-baa5-4c51a48751aa service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Refreshing instance network info cache due to event network-changed-e0003a9c-9202-4863-92aa-0fd29a026c8c. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b6832d52-daec-4612-83c7-f4914d2de513 req-db43348d-8ca9-4d92-baa5-4c51a48751aa service nova] Acquiring lock "refresh_cache-df13492d-d351-49c1-9755-7c30caae89f1" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b6832d52-daec-4612-83c7-f4914d2de513 req-db43348d-8ca9-4d92-baa5-4c51a48751aa service nova] Acquired lock "refresh_cache-df13492d-d351-49c1-9755-7c30caae89f1" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG nova.network.neutron [req-b6832d52-daec-4612-83c7-f4914d2de513 req-db43348d-8ca9-4d92-baa5-4c51a48751aa service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Refreshing network info cache for port e0003a9c-9202-4863-92aa-0fd29a026c8c {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG nova.compute.manager [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG nova.network.neutron [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:00:35 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:00:35 user nova-compute[74898]: DEBUG nova.compute.manager [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG nova.network.neutron [req-b6832d52-daec-4612-83c7-f4914d2de513 req-db43348d-8ca9-4d92-baa5-4c51a48751aa service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG nova.compute.manager [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:00:35 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Creating image(s)
Nov 17 03:00:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b869a55-acf6-4550-9354-2480273a4ee2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "/opt/stack/data/nova/instances/4b869a55-acf6-4550-9354-2480273a4ee2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "/opt/stack/data/nova/instances/4b869a55-acf6-4550-9354-2480273a4ee2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG nova.policy [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83af8ef9a30143d5a46127cabba702f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd898b2b6f76441aa5cc13fd96d668f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG nova.network.neutron [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Successfully updated port: 207857d3-8c12-4e4f-b934-c69ed1f92961 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG nova.network.neutron [req-b6832d52-daec-4612-83c7-f4914d2de513 req-db43348d-8ca9-4d92-baa5-4c51a48751aa service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.292s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b6832d52-daec-4612-83c7-f4914d2de513 req-db43348d-8ca9-4d92-baa5-4c51a48751aa service nova] Releasing lock "refresh_cache-df13492d-d351-49c1-9755-7c30caae89f1" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.205s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/4b869a55-acf6-4550-9354-2480273a4ee2/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/4b869a55-acf6-4550-9354-2480273a4ee2/disk 1073741824" returned: 0 in 0.067s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.226s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b869a55-acf6-4550-9354-2480273a4ee2/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b869a55-acf6-4550-9354-2480273a4ee2/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:36 user nova-compute[74898]: INFO nova.virt.block_device [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Booting with volume c9e40fe2-9d7f-4715-969a-be06e02bf1cd at /dev/vdb
Nov 17 03:00:36 user nova-compute[74898]: DEBUG os_brick.utils [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b869a55-acf6-4550-9354-2480273a4ee2/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Cannot resize image /opt/stack/data/nova/instances/4b869a55-acf6-4550-9354-2480273a4ee2/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Ensure instance console log exists: /opt/stack/data/nova/instances/4b869a55-acf6-4550-9354-2480273a4ee2/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a3f6df-1507-44e5-bd48-951f9fd7ef56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acfad6d-b832-4593-a573-c9495bc4f4c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d78257-70c3-4991-b272-cf01b9f18ab9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e6bc90-e6de-4f66-ac7b-93692b586cfd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG nova.compute.manager [req-8085229c-83d0-4a1d-8514-d8892e7c5fe4 req-d8e4713f-8cf9-4613-a7d5-d668cf65e539 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-changed-207857d3-8c12-4e4f-b934-c69ed1f92961 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG nova.compute.manager [req-8085229c-83d0-4a1d-8514-d8892e7c5fe4 req-d8e4713f-8cf9-4613-a7d5-d668cf65e539 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Refreshing instance network info cache due to event network-changed-207857d3-8c12-4e4f-b934-c69ed1f92961. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8085229c-83d0-4a1d-8514-d8892e7c5fe4 req-d8e4713f-8cf9-4613-a7d5-d668cf65e539 service nova] Acquiring lock "refresh_cache-df13492d-d351-49c1-9755-7c30caae89f1" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8085229c-83d0-4a1d-8514-d8892e7c5fe4 req-d8e4713f-8cf9-4613-a7d5-d668cf65e539 service nova] Acquired lock "refresh_cache-df13492d-d351-49c1-9755-7c30caae89f1" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG nova.network.neutron [req-8085229c-83d0-4a1d-8514-d8892e7c5fe4 req-d8e4713f-8cf9-4613-a7d5-d668cf65e539 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Refreshing network info cache for port 207857d3-8c12-4e4f-b934-c69ed1f92961 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:00:36 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:00:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0c9378-8d4f-4da8-a701-7066c6ddbb00]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG os_brick.utils [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Updating existing volume attachment record: 295d32dd-ea2f-4bd3-9eb5-34dad14c074e {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG nova.network.neutron [req-8085229c-83d0-4a1d-8514-d8892e7c5fe4 req-d8e4713f-8cf9-4613-a7d5-d668cf65e539 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG nova.network.neutron [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Successfully created port: edcbb515-e95f-4dee-a4be-ca8b4e2191c4 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:00:36 user nova-compute[74898]: DEBUG nova.network.neutron [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Successfully updated port: 7b0aade1-07ec-4744-b85c-d71ff8e10663 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:00:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Acquiring lock "refresh_cache-df13492d-d351-49c1-9755-7c30caae89f1" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:00:37 user nova-compute[74898]: DEBUG nova.network.neutron [req-8085229c-83d0-4a1d-8514-d8892e7c5fe4 req-d8e4713f-8cf9-4613-a7d5-d668cf65e539 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:00:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8085229c-83d0-4a1d-8514-d8892e7c5fe4 req-d8e4713f-8cf9-4613-a7d5-d668cf65e539 service nova] Releasing lock "refresh_cache-df13492d-d351-49c1-9755-7c30caae89f1" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:00:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Acquired lock "refresh_cache-df13492d-d351-49c1-9755-7c30caae89f1" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:00:37 user nova-compute[74898]: DEBUG nova.network.neutron [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:00:37 user nova-compute[74898]: DEBUG nova.network.neutron [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:00:37 user nova-compute[74898]: DEBUG nova.network.neutron [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Successfully updated port: edcbb515-e95f-4dee-a4be-ca8b4e2191c4 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:00:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Acquiring lock "refresh_cache-4b869a55-acf6-4550-9354-2480273a4ee2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:00:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Acquired lock "refresh_cache-4b869a55-acf6-4550-9354-2480273a4ee2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:00:37 user nova-compute[74898]: DEBUG nova.network.neutron [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:00:37 user nova-compute[74898]: DEBUG nova.network.neutron [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.network.neutron [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Updating instance_info_cache with network_info: [{"id": "edcbb515-e95f-4dee-a4be-ca8b4e2191c4", "address": "fa:16:3e:cd:e9:3a", "network": {"id": "d0089735-d511-4277-92cc-f97083a06ac5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1908721109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd898b2b6f76441aa5cc13fd96d668f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedcbb515-e9", "ovs_interfaceid": "edcbb515-e95f-4dee-a4be-ca8b4e2191c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Releasing lock "refresh_cache-4b869a55-acf6-4550-9354-2480273a4ee2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.compute.manager [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Instance network_info: |[{"id": "edcbb515-e95f-4dee-a4be-ca8b4e2191c4", "address": "fa:16:3e:cd:e9:3a", "network": {"id": "d0089735-d511-4277-92cc-f97083a06ac5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1908721109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd898b2b6f76441aa5cc13fd96d668f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedcbb515-e9", "ovs_interfaceid": "edcbb515-e95f-4dee-a4be-ca8b4e2191c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Start _get_guest_xml network_info=[{"id": "edcbb515-e95f-4dee-a4be-ca8b4e2191c4", "address": "fa:16:3e:cd:e9:3a", "network": {"id": "d0089735-d511-4277-92cc-f97083a06ac5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1908721109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd898b2b6f76441aa5cc13fd96d668f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedcbb515-e9", "ovs_interfaceid": "edcbb515-e95f-4dee-a4be-ca8b4e2191c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:00:38 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:00:38 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:00:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-349146135',display_name='tempest-TestServerVolumeAttachmentScenario-server-349146135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-349146135',id=11,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1C3vk7XLcPHGJ7XhRnb7qPtFY6UKbHX3jryNoe+V4NSq+LPfmGHjkkhP7l9SQPjd46XiCZvWOLAU4hUSl8ispg0tsgqb+YlaUfuJE1GhaBVSUR+lN2NuBQIPYLqsrVbg==',key_name='tempest-keypair-638123582',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd898b2b6f76441aa5cc13fd96d668f2',ramdisk_id='',reservation_id='r-uq3cyxhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1653593012',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1653593012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:00:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83af8ef9a30143d5a46127cabba702f5',uuid=4b869a55-acf6-4550-9354-2480273a4ee2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edcbb515-e95f-4dee-a4be-ca8b4e2191c4", "address": "fa:16:3e:cd:e9:3a", "network": {"id": "d0089735-d511-4277-92cc-f97083a06ac5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1908721109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd898b2b6f76441aa5cc13fd96d668f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedcbb515-e9", "ovs_interfaceid": "edcbb515-e95f-4dee-a4be-ca8b4e2191c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Converting VIF {"id": "edcbb515-e95f-4dee-a4be-ca8b4e2191c4", "address": "fa:16:3e:cd:e9:3a", "network": {"id": "d0089735-d511-4277-92cc-f97083a06ac5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1908721109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd898b2b6f76441aa5cc13fd96d668f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedcbb515-e9", "ovs_interfaceid": "edcbb515-e95f-4dee-a4be-ca8b4e2191c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e9:3a,bridge_name='br-int',has_traffic_filtering=True,id=edcbb515-e95f-4dee-a4be-ca8b4e2191c4,network=Network(d0089735-d511-4277-92cc-f97083a06ac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedcbb515-e9') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.objects.instance [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b869a55-acf6-4550-9354-2480273a4ee2 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:00:38 user nova-compute[74898]:   <uuid>4b869a55-acf6-4550-9354-2480273a4ee2</uuid>
Nov 17 03:00:38 user nova-compute[74898]:   <name>instance-0000000b</name>
Nov 17 03:00:38 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:00:38 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:00:38 user nova-compute[74898]:   <metadata>
Nov 17 03:00:38 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:00:38 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:00:38 user nova-compute[74898]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-349146135</nova:name>
Nov 17 03:00:38 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:00:38</nova:creationTime>
Nov 17 03:00:38 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:00:38 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:00:38 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:00:38 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:00:38 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:00:38 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:00:38 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:00:38 user nova-compute[74898]:       <nova:owner>
Nov 17 03:00:38 user nova-compute[74898]:         <nova:user uuid="83af8ef9a30143d5a46127cabba702f5">tempest-TestServerVolumeAttachmentScenario-1653593012-project-member</nova:user>
Nov 17 03:00:38 user nova-compute[74898]:         <nova:project uuid="fd898b2b6f76441aa5cc13fd96d668f2">tempest-TestServerVolumeAttachmentScenario-1653593012</nova:project>
Nov 17 03:00:38 user nova-compute[74898]:       </nova:owner>
Nov 17 03:00:38 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:00:38 user nova-compute[74898]:       <nova:ports>
Nov 17 03:00:38 user nova-compute[74898]:         <nova:port uuid="edcbb515-e95f-4dee-a4be-ca8b4e2191c4">
Nov 17 03:00:38 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 17 03:00:38 user nova-compute[74898]:         </nova:port>
Nov 17 03:00:38 user nova-compute[74898]:       </nova:ports>
Nov 17 03:00:38 user nova-compute[74898]:     </nova:instance>
Nov 17 03:00:38 user nova-compute[74898]:   </metadata>
Nov 17 03:00:38 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:00:38 user nova-compute[74898]:     <system>
Nov 17 03:00:38 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:00:38 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:00:38 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:00:38 user nova-compute[74898]:       <entry name="serial">4b869a55-acf6-4550-9354-2480273a4ee2</entry>
Nov 17 03:00:38 user nova-compute[74898]:       <entry name="uuid">4b869a55-acf6-4550-9354-2480273a4ee2</entry>
Nov 17 03:00:38 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:00:38 user nova-compute[74898]:     </system>
Nov 17 03:00:38 user nova-compute[74898]:   </sysinfo>
Nov 17 03:00:38 user nova-compute[74898]:   <os>
Nov 17 03:00:38 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:00:38 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:00:38 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:00:38 user nova-compute[74898]:   </os>
Nov 17 03:00:38 user nova-compute[74898]:   <features>
Nov 17 03:00:38 user nova-compute[74898]:     <acpi/>
Nov 17 03:00:38 user nova-compute[74898]:     <apic/>
Nov 17 03:00:38 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:00:38 user nova-compute[74898]:   </features>
Nov 17 03:00:38 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:00:38 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:00:38 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:00:38 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:00:38 user nova-compute[74898]:   </clock>
Nov 17 03:00:38 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:00:38 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:00:38 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:00:38 user nova-compute[74898]:   </cpu>
Nov 17 03:00:38 user nova-compute[74898]:   <devices>
Nov 17 03:00:38 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:00:38 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:00:38 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/4b869a55-acf6-4550-9354-2480273a4ee2/disk"/>
Nov 17 03:00:38 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:00:38 user nova-compute[74898]:     </disk>
Nov 17 03:00:38 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:00:38 user nova-compute[74898]:       <mac address="fa:16:3e:cd:e9:3a"/>
Nov 17 03:00:38 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:00:38 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:00:38 user nova-compute[74898]:       <target dev="tapedcbb515-e9"/>
Nov 17 03:00:38 user nova-compute[74898]:     </interface>
Nov 17 03:00:38 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:00:38 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/4b869a55-acf6-4550-9354-2480273a4ee2/console.log" append="off"/>
Nov 17 03:00:38 user nova-compute[74898]:     </serial>
Nov 17 03:00:38 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:00:38 user nova-compute[74898]:     <video>
Nov 17 03:00:38 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:00:38 user nova-compute[74898]:     </video>
Nov 17 03:00:38 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:00:38 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:00:38 user nova-compute[74898]:     </rng>
Nov 17 03:00:38 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:00:38 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:00:38 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:00:38 user nova-compute[74898]:     </memballoon>
Nov 17 03:00:38 user nova-compute[74898]:   </devices>
Nov 17 03:00:38 user nova-compute[74898]: </domain>
Nov 17 03:00:38 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:00:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-349146135',display_name='tempest-TestServerVolumeAttachmentScenario-server-349146135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-349146135',id=11,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1C3vk7XLcPHGJ7XhRnb7qPtFY6UKbHX3jryNoe+V4NSq+LPfmGHjkkhP7l9SQPjd46XiCZvWOLAU4hUSl8ispg0tsgqb+YlaUfuJE1GhaBVSUR+lN2NuBQIPYLqsrVbg==',key_name='tempest-keypair-638123582',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd898b2b6f76441aa5cc13fd96d668f2',ramdisk_id='',reservation_id='r-uq3cyxhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1653593012',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1653593012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:00:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83af8ef9a30143d5a46127cabba702f5',uuid=4b869a55-acf6-4550-9354-2480273a4ee2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edcbb515-e95f-4dee-a4be-ca8b4e2191c4", "address": "fa:16:3e:cd:e9:3a", "network": {"id": "d0089735-d511-4277-92cc-f97083a06ac5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1908721109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd898b2b6f76441aa5cc13fd96d668f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedcbb515-e9", "ovs_interfaceid": "edcbb515-e95f-4dee-a4be-ca8b4e2191c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Converting VIF {"id": "edcbb515-e95f-4dee-a4be-ca8b4e2191c4", "address": "fa:16:3e:cd:e9:3a", "network": {"id": "d0089735-d511-4277-92cc-f97083a06ac5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1908721109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd898b2b6f76441aa5cc13fd96d668f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedcbb515-e9", "ovs_interfaceid": "edcbb515-e95f-4dee-a4be-ca8b4e2191c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e9:3a,bridge_name='br-int',has_traffic_filtering=True,id=edcbb515-e95f-4dee-a4be-ca8b4e2191c4,network=Network(d0089735-d511-4277-92cc-f97083a06ac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedcbb515-e9') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG os_vif [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e9:3a,bridge_name='br-int',has_traffic_filtering=True,id=edcbb515-e95f-4dee-a4be-ca8b4e2191c4,network=Network(d0089735-d511-4277-92cc-f97083a06ac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedcbb515-e9') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b22cf46-a279-52b9-960e-bf7121f82ed3', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapedcbb515-e9, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapedcbb515-e9, col_values=(('qos', UUID('d65c1fab-2477-49a3-89e4-01c9026d769a')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapedcbb515-e9, col_values=(('external_ids', {'iface-id': 'edcbb515-e95f-4dee-a4be-ca8b4e2191c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:e9:3a', 'vm-uuid': '4b869a55-acf6-4550-9354-2480273a4ee2'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:38 user nova-compute[74898]: INFO os_vif [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:e9:3a,bridge_name='br-int',has_traffic_filtering=True,id=edcbb515-e95f-4dee-a4be-ca8b4e2191c4,network=Network(d0089735-d511-4277-92cc-f97083a06ac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedcbb515-e9')
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] No VIF found with MAC fa:16:3e:cd:e9:3a, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.compute.manager [req-44ccb1b9-f493-46bf-82c8-d04a6525f382 req-14005026-ed3e-43ae-8e58-3241c1a644be service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-changed-7b0aade1-07ec-4744-b85c-d71ff8e10663 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG nova.compute.manager [req-44ccb1b9-f493-46bf-82c8-d04a6525f382 req-14005026-ed3e-43ae-8e58-3241c1a644be service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Refreshing instance network info cache due to event network-changed-7b0aade1-07ec-4744-b85c-d71ff8e10663. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:00:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-44ccb1b9-f493-46bf-82c8-d04a6525f382 req-14005026-ed3e-43ae-8e58-3241c1a644be service nova] Acquiring lock "refresh_cache-df13492d-d351-49c1-9755-7c30caae89f1" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:00:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:39 user nova-compute[74898]: DEBUG nova.network.neutron [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Updating instance_info_cache with network_info: [{"id": "33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5", "address": "fa:16:3e:62:7a:e1", "network": {"id": "97f8611a-f601-4395-8871-1fc8bd7801af", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-548653871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33c1e7b3-fb", "ovs_interfaceid": "33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1a0a6a3-d445-4e76-b6ca-1183ae4b724f", "address": "fa:16:3e:6d:37:0c", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a0a6a3-d4", "ovs_interfaceid": "c1a0a6a3-d445-4e76-b6ca-1183ae4b724f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d59452b9-ad23-4cfd-810a-776bb572d493", "address": "fa:16:3e:86:66:f2", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59452b9-ad", "ovs_interfaceid": "d59452b9-ad23-4cfd-810a-776bb572d493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e20d2c64-8b92-434c-84a4-d28453214349", "address": "fa:16:3e:e1:f4:1c", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape20d2c64-8b", "ovs_interfaceid": "e20d2c64-8b92-434c-84a4-d28453214349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0003a9c-9202-4863-92aa-0fd29a026c8c", "address": "fa:16:3e:8f:4e:96", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0003a9c-92", "ovs_interfaceid": "e0003a9c-9202-4863-92aa-0fd29a026c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "207857d3-8c12-4e4f-b934-c69ed1f92961", "address": "fa:16:3e:ca:ec:13", "network": {"id": "86a58fdf-5837-4342-b488-23f43f0c8db6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1066442327", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207857d3-8c", "ovs_interfaceid": "207857d3-8c12-4e4f-b934-c69ed1f92961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b0aade1-07ec-4744-b85c-d71ff8e10663", "address": "fa:16:3e:07:d7:07", "network": {"id": "86a58fdf-5837-4342-b488-23f43f0c8db6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1066442327", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b0aade1-07", "ovs_interfaceid": "7b0aade1-07ec-4744-b85c-d71ff8e10663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:00:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Releasing lock "refresh_cache-df13492d-d351-49c1-9755-7c30caae89f1" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:00:39 user nova-compute[74898]: DEBUG nova.compute.manager [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Instance network_info: |[{"id": "33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5", "address": "fa:16:3e:62:7a:e1", "network": {"id": "97f8611a-f601-4395-8871-1fc8bd7801af", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-548653871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33c1e7b3-fb", "ovs_interfaceid": "33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1a0a6a3-d445-4e76-b6ca-1183ae4b724f", "address": "fa:16:3e:6d:37:0c", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a0a6a3-d4", "ovs_interfaceid": "c1a0a6a3-d445-4e76-b6ca-1183ae4b724f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d59452b9-ad23-4cfd-810a-776bb572d493", "address": "fa:16:3e:86:66:f2", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59452b9-ad", "ovs_interfaceid": "d59452b9-ad23-4cfd-810a-776bb572d493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e20d2c64-8b92-434c-84a4-d28453214349", "address": "fa:16:3e:e1:f4:1c", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape20d2c64-8b", "ovs_interfaceid": "e20d2c64-8b92-434c-84a4-d28453214349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0003a9c-9202-4863-92aa-0fd29a026c8c", "address": "fa:16:3e:8f:4e:96", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0003a9c-92", "ovs_interfaceid": "e0003a9c-9202-4863-92aa-0fd29a026c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "207857d3-8c12-4e4f-b934-c69ed1f92961", "address": "fa:16:3e:ca:ec:13", "network": {"id": "86a58fdf-5837-4342-b488-23f43f0c8db6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1066442327", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207857d3-8c", "ovs_interfaceid": "207857d3-8c12-4e4f-b934-c69ed1f92961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b0aade1-07ec-4744-b85c-d71ff8e10663", "address": "fa:16:3e:07:d7:07", "network": {"id": "86a58fdf-5837-4342-b488-23f43f0c8db6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1066442327", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b0aade1-07", "ovs_interfaceid": "7b0aade1-07ec-4744-b85c-d71ff8e10663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:00:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-44ccb1b9-f493-46bf-82c8-d04a6525f382 req-14005026-ed3e-43ae-8e58-3241c1a644be service nova] Acquired lock "refresh_cache-df13492d-d351-49c1-9755-7c30caae89f1" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:00:39 user nova-compute[74898]: DEBUG nova.network.neutron [req-44ccb1b9-f493-46bf-82c8-d04a6525f382 req-14005026-ed3e-43ae-8e58-3241c1a644be service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Refreshing network info cache for port 7b0aade1-07ec-4744-b85c-d71ff8e10663 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:00:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-ea49c9ba-0c2e-46cd-8afa-d080a5f320a0 req-4c416f66-ab78-4a98-96ae-026d8824cf1a service nova] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Received event network-vif-plugged-edcbb515-e95f-4dee-a4be-ca8b4e2191c4 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ea49c9ba-0c2e-46cd-8afa-d080a5f320a0 req-4c416f66-ab78-4a98-96ae-026d8824cf1a service nova] Acquiring lock "4b869a55-acf6-4550-9354-2480273a4ee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ea49c9ba-0c2e-46cd-8afa-d080a5f320a0 req-4c416f66-ab78-4a98-96ae-026d8824cf1a service nova] Lock "4b869a55-acf6-4550-9354-2480273a4ee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ea49c9ba-0c2e-46cd-8afa-d080a5f320a0 req-4c416f66-ab78-4a98-96ae-026d8824cf1a service nova] Lock "4b869a55-acf6-4550-9354-2480273a4ee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-ea49c9ba-0c2e-46cd-8afa-d080a5f320a0 req-4c416f66-ab78-4a98-96ae-026d8824cf1a service nova] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] No waiting events found dispatching network-vif-plugged-edcbb515-e95f-4dee-a4be-ca8b4e2191c4 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:00:39 user nova-compute[74898]: WARNING nova.compute.manager [req-ea49c9ba-0c2e-46cd-8afa-d080a5f320a0 req-4c416f66-ab78-4a98-96ae-026d8824cf1a service nova] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Received unexpected event network-vif-plugged-edcbb515-e95f-4dee-a4be-ca8b4e2191c4 for instance with vm_state building and task_state spawning.
Nov 17 03:00:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:40 user nova-compute[74898]: DEBUG nova.network.neutron [req-44ccb1b9-f493-46bf-82c8-d04a6525f382 req-14005026-ed3e-43ae-8e58-3241c1a644be service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Updated VIF entry in instance network info cache for port 7b0aade1-07ec-4744-b85c-d71ff8e10663. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:00:40 user nova-compute[74898]: DEBUG nova.network.neutron [req-44ccb1b9-f493-46bf-82c8-d04a6525f382 req-14005026-ed3e-43ae-8e58-3241c1a644be service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Updating instance_info_cache with network_info: [{"id": "33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5", "address": "fa:16:3e:62:7a:e1", "network": {"id": "97f8611a-f601-4395-8871-1fc8bd7801af", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-548653871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33c1e7b3-fb", "ovs_interfaceid": "33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1a0a6a3-d445-4e76-b6ca-1183ae4b724f", "address": "fa:16:3e:6d:37:0c", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a0a6a3-d4", "ovs_interfaceid": "c1a0a6a3-d445-4e76-b6ca-1183ae4b724f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d59452b9-ad23-4cfd-810a-776bb572d493", "address": "fa:16:3e:86:66:f2", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59452b9-ad", "ovs_interfaceid": "d59452b9-ad23-4cfd-810a-776bb572d493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e20d2c64-8b92-434c-84a4-d28453214349", "address": "fa:16:3e:e1:f4:1c", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape20d2c64-8b", "ovs_interfaceid": "e20d2c64-8b92-434c-84a4-d28453214349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0003a9c-9202-4863-92aa-0fd29a026c8c", "address": "fa:16:3e:8f:4e:96", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0003a9c-92", "ovs_interfaceid": "e0003a9c-9202-4863-92aa-0fd29a026c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "207857d3-8c12-4e4f-b934-c69ed1f92961", "address": "fa:16:3e:ca:ec:13", "network": {"id": "86a58fdf-5837-4342-b488-23f43f0c8db6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1066442327", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207857d3-8c", "ovs_interfaceid": "207857d3-8c12-4e4f-b934-c69ed1f92961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b0aade1-07ec-4744-b85c-d71ff8e10663", "address": "fa:16:3e:07:d7:07", "network": {"id": "86a58fdf-5837-4342-b488-23f43f0c8db6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1066442327", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b0aade1-07", "ovs_interfaceid": "7b0aade1-07ec-4744-b85c-d71ff8e10663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:00:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-44ccb1b9-f493-46bf-82c8-d04a6525f382 req-14005026-ed3e-43ae-8e58-3241c1a644be service nova] Releasing lock "refresh_cache-df13492d-d351-49c1-9755-7c30caae89f1" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:00:40 user nova-compute[74898]: DEBUG nova.compute.manager [req-44ccb1b9-f493-46bf-82c8-d04a6525f382 req-14005026-ed3e-43ae-8e58-3241c1a644be service nova] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Received event network-changed-edcbb515-e95f-4dee-a4be-ca8b4e2191c4 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:40 user nova-compute[74898]: DEBUG nova.compute.manager [req-44ccb1b9-f493-46bf-82c8-d04a6525f382 req-14005026-ed3e-43ae-8e58-3241c1a644be service nova] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Refreshing instance network info cache due to event network-changed-edcbb515-e95f-4dee-a4be-ca8b4e2191c4. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:00:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-44ccb1b9-f493-46bf-82c8-d04a6525f382 req-14005026-ed3e-43ae-8e58-3241c1a644be service nova] Acquiring lock "refresh_cache-4b869a55-acf6-4550-9354-2480273a4ee2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:00:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-44ccb1b9-f493-46bf-82c8-d04a6525f382 req-14005026-ed3e-43ae-8e58-3241c1a644be service nova] Acquired lock "refresh_cache-4b869a55-acf6-4550-9354-2480273a4ee2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:00:40 user nova-compute[74898]: DEBUG nova.network.neutron [req-44ccb1b9-f493-46bf-82c8-d04a6525f382 req-14005026-ed3e-43ae-8e58-3241c1a644be service nova] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Refreshing network info cache for port edcbb515-e95f-4dee-a4be-ca8b4e2191c4 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:00:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:40 user nova-compute[74898]: DEBUG nova.network.neutron [req-44ccb1b9-f493-46bf-82c8-d04a6525f382 req-14005026-ed3e-43ae-8e58-3241c1a644be service nova] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Updated VIF entry in instance network info cache for port edcbb515-e95f-4dee-a4be-ca8b4e2191c4. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:00:40 user nova-compute[74898]: DEBUG nova.network.neutron [req-44ccb1b9-f493-46bf-82c8-d04a6525f382 req-14005026-ed3e-43ae-8e58-3241c1a644be service nova] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Updating instance_info_cache with network_info: [{"id": "edcbb515-e95f-4dee-a4be-ca8b4e2191c4", "address": "fa:16:3e:cd:e9:3a", "network": {"id": "d0089735-d511-4277-92cc-f97083a06ac5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1908721109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd898b2b6f76441aa5cc13fd96d668f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedcbb515-e9", "ovs_interfaceid": "edcbb515-e95f-4dee-a4be-ca8b4e2191c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:00:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-44ccb1b9-f493-46bf-82c8-d04a6525f382 req-14005026-ed3e-43ae-8e58-3241c1a644be service nova] Releasing lock "refresh_cache-4b869a55-acf6-4550-9354-2480273a4ee2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:00:41 user nova-compute[74898]: DEBUG nova.compute.manager [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:00:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:00:41 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Instance spawned successfully.
Nov 17 03:00:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:00:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:00:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:00:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:00:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:00:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:00:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:00:42 user nova-compute[74898]: INFO nova.compute.manager [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Took 6.47 seconds to spawn the instance on the hypervisor.
Nov 17 03:00:42 user nova-compute[74898]: DEBUG nova.compute.manager [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:00:42 user nova-compute[74898]: DEBUG nova.compute.manager [req-16163961-b096-4703-96d7-f6d9f16d7595 req-5f01778a-a662-460b-8a12-e6ca28f773ce service nova] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Received event network-vif-plugged-edcbb515-e95f-4dee-a4be-ca8b4e2191c4 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-16163961-b096-4703-96d7-f6d9f16d7595 req-5f01778a-a662-460b-8a12-e6ca28f773ce service nova] Acquiring lock "4b869a55-acf6-4550-9354-2480273a4ee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-16163961-b096-4703-96d7-f6d9f16d7595 req-5f01778a-a662-460b-8a12-e6ca28f773ce service nova] Lock "4b869a55-acf6-4550-9354-2480273a4ee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-16163961-b096-4703-96d7-f6d9f16d7595 req-5f01778a-a662-460b-8a12-e6ca28f773ce service nova] Lock "4b869a55-acf6-4550-9354-2480273a4ee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:42 user nova-compute[74898]: DEBUG nova.compute.manager [req-16163961-b096-4703-96d7-f6d9f16d7595 req-5f01778a-a662-460b-8a12-e6ca28f773ce service nova] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] No waiting events found dispatching network-vif-plugged-edcbb515-e95f-4dee-a4be-ca8b4e2191c4 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:00:42 user nova-compute[74898]: WARNING nova.compute.manager [req-16163961-b096-4703-96d7-f6d9f16d7595 req-5f01778a-a662-460b-8a12-e6ca28f773ce service nova] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Received unexpected event network-vif-plugged-edcbb515-e95f-4dee-a4be-ca8b4e2191c4 for instance with vm_state building and task_state spawning.
Nov 17 03:00:42 user nova-compute[74898]: INFO nova.compute.manager [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Took 7.34 seconds to build instance.
Nov 17 03:00:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0bb2035d-35c0-4577-b0e1-b6be7dc326e0 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "4b869a55-acf6-4550-9354-2480273a4ee2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.467s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:42 user nova-compute[74898]: INFO nova.virt.block_device [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Booting with volume dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 at /dev/vdc
Nov 17 03:00:42 user nova-compute[74898]: DEBUG os_brick.utils [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:00:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:42 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5ca154-a9b7-49eb-9bac-500077e6297d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:42 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[97811ca5-296b-4feb-b565-b9c018881f1c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:42 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[893ae595-2fea-4d13-9149-1e071b623e02]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:42 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb822636-71b7-4bca-b3a8-494ab2f0a71b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:00:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:00:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:00:42 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:00:42 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5450422-7ae5-4278-8071-b52fee8e3ac8]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:00:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:00:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:00:42 user nova-compute[74898]: DEBUG os_brick.utils [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:00:42 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Updating existing volume attachment record: 78da2377-5b70-4a94-896b-0373aa6e54c7 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:00:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG nova.compute.manager [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:00:48 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Creating image(s)
Nov 17 03:00:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Did not create local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Ensure instance console log exists: /opt/stack/data/nova/instances/df13492d-d351-49c1-9755-7c30caae89f1/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Start _get_guest_xml network_info=[{"id": "33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5", "address": "fa:16:3e:62:7a:e1", "network": {"id": "97f8611a-f601-4395-8871-1fc8bd7801af", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-548653871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33c1e7b3-fb", "ovs_interfaceid": "33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1a0a6a3-d445-4e76-b6ca-1183ae4b724f", "address": "fa:16:3e:6d:37:0c", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a0a6a3-d4", "ovs_interfaceid": "c1a0a6a3-d445-4e76-b6ca-1183ae4b724f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d59452b9-ad23-4cfd-810a-776bb572d493", "address": "fa:16:3e:86:66:f2", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59452b9-ad", "ovs_interfaceid": "d59452b9-ad23-4cfd-810a-776bb572d493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e20d2c64-8b92-434c-84a4-d28453214349", "address": "fa:16:3e:e1:f4:1c", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape20d2c64-8b", "ovs_interfaceid": "e20d2c64-8b92-434c-84a4-d28453214349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0003a9c-9202-4863-92aa-0fd29a026c8c", "address": "fa:16:3e:8f:4e:96", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0003a9c-92", "ovs_interfaceid": "e0003a9c-9202-4863-92aa-0fd29a026c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "207857d3-8c12-4e4f-b934-c69ed1f92961", "address": "fa:16:3e:ca:ec:13", "network": {"id": "86a58fdf-5837-4342-b488-23f43f0c8db6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1066442327", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207857d3-8c", "ovs_interfaceid": "207857d3-8c12-4e4f-b934-c69ed1f92961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b0aade1-07ec-4744-b85c-d71ff8e10663", "address": "fa:16:3e:07:d7:07", "network": {"id": "86a58fdf-5837-4342-b488-23f43f0c8db6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1066442327", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b0aade1-07", "ovs_interfaceid": "7b0aade1-07ec-4744-b85c-d71ff8e10663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVXlTDCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'df13492d-d351-49c1-9755-7c30caae89f1', 'attached_at': '', 'detached_at': '', 'volume_id': '35255e9c-5fd6-477f-818a-3fc7fbe655d1', 'serial': '35255e9c-5fd6-477f-818a-3fc7fbe655d1'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '971a0d0e-e9fc-4326-bd15-29538435e649', 'volume_type': None}, {'boot_index': 1, 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pDoAKakF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'df13492d-d351-49c1-9755-7c30caae89f1', 'attached_at': '', 'detached_at': '', 'volume_id': 'c9e40fe2-9d7f-4715-969a-be06e02bf1cd', 'serial': 'c9e40fe2-9d7f-4715-969a-be06e02bf1cd'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '295d32dd-ea2f-4bd3-9eb5-34dad14c074e', 'volume_type': None}, {'boot_index': 2, 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnAIxhtL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'df13492d-d351-49c1-9755-7c30caae89f1', 'attached_at': '', 'detached_at': '', 'volume_id': 'dee1ebf2-c6ab-4269-9c9a-68cb23c8a962', 'serial': 'dee1ebf2-c6ab-4269-9c9a-68cb23c8a962'}, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '78da2377-5b70-4a94-896b-0373aa6e54c7', 'volume_type': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:00:48 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:00:48 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:00:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG os_brick.initiator.connector [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Factory for ISCSI on None {{(pid=74898) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVXlTDCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:00:48 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:00:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:00:48 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:00:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:00:48 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f1c65f-83f7-49db-9b7c-b1215e7e2556]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:00:48 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe18b875-25b6-4594-bb75-518b25d6db05]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1] added
Nov 17 03:00:48 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ab35d3-2718-4c84-be2b-517066c9ac31]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[248344f1-5329-4acb-a763-24b67fe46051]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pVXlTDCc {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pVXlTDCc" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d7d2e8-914b-4f6e-982e-fa58f077de1b]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pVXlTDCc'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6716157b-8cfd-4e35-829f-f6bfa9ad8058]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff24eb0-eaf7-47fa-b40f-e4b2c40b8adf]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 17 03:00:48 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 17 03:00:48 user nova-compute[74898]:  {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:00:48 user nova-compute[74898]: WARNING os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 17 03:00:48 user nova-compute[74898]: 
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[62367c0a-2725-4fec-b5b6-0159163aa119]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1, portal: 172.16.0.220,3260]
Nov 17 03:00:48 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1, portal: 172.16.0.220,3260] successful.
Nov 17 03:00:48 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6a5a2a-06d8-4ef1-bde5-bb97b4f8c617]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[39892ffe-9e15-4b19-b9e7-5ff381bc4d3d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:00:48 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:00:48 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d1a8ea-ec86-484c-bd5d-d091b10253c5]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVXlTDCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:00:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26331616633383235', 'path': '/dev/sdb'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331616633383235', 'path': '/dev/sdb'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pDoAKakF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:00:49 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:00:49 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:00:49 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:00:49 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:00:49 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f506104-91f3-4a17-a4e4-c5ad53267af2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:00:49 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[99043416-9683-4b91-8d2d-b98fa06a3e42]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd] added
Nov 17 03:00:49 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e17c33-9b56-4531-8d6e-890bb4e1fd50]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c4b919-1cb0-495f-83ce-ba848a288646]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pDoAKakF {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pDoAKakF" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1658f35a-80ec-4f07-bff0-49dcb2901999]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pDoAKakF'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3c666f-f8ae-48fc-a39e-b742dc5ea638]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8fb66f-e675-47a9-bf98-5dbfa6f33643]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:00:49 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:00:49 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea96b70-500a-47dd-ac9f-d994138fb702]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd, portal: 172.16.0.220,3260]
Nov 17 03:00:49 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd, portal: 172.16.0.220,3260] successful.
Nov 17 03:00:49 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e36e710-47c2-4c45-8882-1b949dbb489b]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0fa645-4991-4537-a671-a1f5f73e87a0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:00:49 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:00:49 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:00:49 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:00:49 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f40ffc-985f-4f39-bea8-22ffd986854a]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:00:49 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pDoAKakF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:00:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:00:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26530346362396536', 'path': '/dev/sdc'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:00:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530346362396536', 'path': '/dev/sdc'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:00:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:00:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnAIxhtL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:00:50 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:00:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:00:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:00:51 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:00:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:00:51 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c07542-623a-496f-b6fd-13a2575bc916]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:00:51 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfb1fe4-c517-49ff-9778-c622d40a42c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962] added
Nov 17 03:00:51 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a687a558-b766-4556-9ff3-2e2c207ca09f]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[971e229b-dfc6-45f3-9971-5a55e587325f]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dnAIxhtL {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dnAIxhtL" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[49902c78-0e55-4976-b09d-b3169f72959c]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dnAIxhtL'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a734dee5-9834-49b2-97f9-cc03ac924ad4]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a984dfbd-29fa-417b-96a2-e14f09d5a89b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:00:51 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:00:51 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:00:51 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:00:51 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[030f668c-144e-4368-9f96-934f8552f8a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962, portal: 172.16.0.220,3260]
Nov 17 03:00:51 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962, portal: 172.16.0.220,3260] successful.
Nov 17 03:00:51 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d12e9c-779d-476d-b890-294eebe2b65c]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[275f8d01-2b72-41e1-a326-df5eced7b697]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:00:51 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:00:51 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:00:51 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:00:51 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:00:51 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:00:51 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f954ad7-ec64-4f36-9b7c-6506b7d37ca7]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:00:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnAIxhtL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23032306538626265', 'path': '/dev/sdd'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032306538626265', 'path': '/dev/sdd'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759658847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759658847',id=10,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9l33pWbZQh9MlgJ0c526xiqvNHClwgljKX0oW5Ns00va7Ih1kDjLTORglU0E8d91/kOyn6EwD4XGWP+H2+9W1xPbcpyJIBbpTxN1SZ9Q8W3RAxUoEhXIJ97lxsaeV5EQ==',key_name='tempest-keypair-1177168277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d06ab04c365d49639386a4c40620f735',ramdisk_id='',reservation_id='r-hg4z88r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1407862931',owner_user_name='tempest-TaggedBootDevicesTest-1407862931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c9a303c92cc4937a595f49417224e46',uuid=df13492d-d351-49c1-9755-7c30caae89f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5", "address": "fa:16:3e:62:7a:e1", "network": {"id": "97f8611a-f601-4395-8871-1fc8bd7801af", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-548653871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33c1e7b3-fb", "ovs_interfaceid": "33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converting VIF {"id": "33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5", "address": "fa:16:3e:62:7a:e1", "network": {"id": "97f8611a-f601-4395-8871-1fc8bd7801af", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-548653871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33c1e7b3-fb", "ovs_interfaceid": "33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:7a:e1,bridge_name='br-int',has_traffic_filtering=True,id=33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5,network=Network(97f8611a-f601-4395-8871-1fc8bd7801af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33c1e7b3-fb') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759658847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759658847',id=10,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9l33pWbZQh9MlgJ0c526xiqvNHClwgljKX0oW5Ns00va7Ih1kDjLTORglU0E8d91/kOyn6EwD4XGWP+H2+9W1xPbcpyJIBbpTxN1SZ9Q8W3RAxUoEhXIJ97lxsaeV5EQ==',key_name='tempest-keypair-1177168277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d06ab04c365d49639386a4c40620f735',ramdisk_id='',reservation_id='r-hg4z88r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1407862931',owner_user_name='tempest-TaggedBootDevicesTest-1407862931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c9a303c92cc4937a595f49417224e46',uuid=df13492d-d351-49c1-9755-7c30caae89f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1a0a6a3-d445-4e76-b6ca-1183ae4b724f", "address": "fa:16:3e:6d:37:0c", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a0a6a3-d4", "ovs_interfaceid": "c1a0a6a3-d445-4e76-b6ca-1183ae4b724f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converting VIF {"id": "c1a0a6a3-d445-4e76-b6ca-1183ae4b724f", "address": "fa:16:3e:6d:37:0c", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a0a6a3-d4", "ovs_interfaceid": "c1a0a6a3-d445-4e76-b6ca-1183ae4b724f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:37:0c,bridge_name='br-int',has_traffic_filtering=True,id=c1a0a6a3-d445-4e76-b6ca-1183ae4b724f,network=Network(a1111cf3-2ce5-4e9c-a5d1-7468a768f08e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc1a0a6a3-d4') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759658847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759658847',id=10,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9l33pWbZQh9MlgJ0c526xiqvNHClwgljKX0oW5Ns00va7Ih1kDjLTORglU0E8d91/kOyn6EwD4XGWP+H2+9W1xPbcpyJIBbpTxN1SZ9Q8W3RAxUoEhXIJ97lxsaeV5EQ==',key_name='tempest-keypair-1177168277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d06ab04c365d49639386a4c40620f735',ramdisk_id='',reservation_id='r-hg4z88r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1407862931',owner_user_name='tempest-TaggedBootDevicesTest-1407862931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c9a303c92cc4937a595f49417224e46',uuid=df13492d-d351-49c1-9755-7c30caae89f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d59452b9-ad23-4cfd-810a-776bb572d493", "address": "fa:16:3e:86:66:f2", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59452b9-ad", "ovs_interfaceid": "d59452b9-ad23-4cfd-810a-776bb572d493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converting VIF {"id": "d59452b9-ad23-4cfd-810a-776bb572d493", "address": "fa:16:3e:86:66:f2", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59452b9-ad", "ovs_interfaceid": "d59452b9-ad23-4cfd-810a-776bb572d493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:66:f2,bridge_name='br-int',has_traffic_filtering=True,id=d59452b9-ad23-4cfd-810a-776bb572d493,network=Network(a1111cf3-2ce5-4e9c-a5d1-7468a768f08e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd59452b9-ad') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759658847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759658847',id=10,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9l33pWbZQh9MlgJ0c526xiqvNHClwgljKX0oW5Ns00va7Ih1kDjLTORglU0E8d91/kOyn6EwD4XGWP+H2+9W1xPbcpyJIBbpTxN1SZ9Q8W3RAxUoEhXIJ97lxsaeV5EQ==',key_name='tempest-keypair-1177168277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d06ab04c365d49639386a4c40620f735',ramdisk_id='',reservation_id='r-hg4z88r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1407862931',owner_user_name='tempest-TaggedBootDevicesTest-1407862931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c9a303c92cc4937a595f49417224e46',uuid=df13492d-d351-49c1-9755-7c30caae89f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e20d2c64-8b92-434c-84a4-d28453214349", "address": "fa:16:3e:e1:f4:1c", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape20d2c64-8b", "ovs_interfaceid": "e20d2c64-8b92-434c-84a4-d28453214349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converting VIF {"id": "e20d2c64-8b92-434c-84a4-d28453214349", "address": "fa:16:3e:e1:f4:1c", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape20d2c64-8b", "ovs_interfaceid": "e20d2c64-8b92-434c-84a4-d28453214349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f4:1c,bridge_name='br-int',has_traffic_filtering=True,id=e20d2c64-8b92-434c-84a4-d28453214349,network=Network(a1111cf3-2ce5-4e9c-a5d1-7468a768f08e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape20d2c64-8b') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759658847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759658847',id=10,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9l33pWbZQh9MlgJ0c526xiqvNHClwgljKX0oW5Ns00va7Ih1kDjLTORglU0E8d91/kOyn6EwD4XGWP+H2+9W1xPbcpyJIBbpTxN1SZ9Q8W3RAxUoEhXIJ97lxsaeV5EQ==',key_name='tempest-keypair-1177168277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d06ab04c365d49639386a4c40620f735',ramdisk_id='',reservation_id='r-hg4z88r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1407862931',owner_user_name='tempest-TaggedBootDevicesTest-1407862931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c9a303c92cc4937a595f49417224e46',uuid=df13492d-d351-49c1-9755-7c30caae89f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0003a9c-9202-4863-92aa-0fd29a026c8c", "address": "fa:16:3e:8f:4e:96", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0003a9c-92", "ovs_interfaceid": "e0003a9c-9202-4863-92aa-0fd29a026c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converting VIF {"id": "e0003a9c-9202-4863-92aa-0fd29a026c8c", "address": "fa:16:3e:8f:4e:96", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0003a9c-92", "ovs_interfaceid": "e0003a9c-9202-4863-92aa-0fd29a026c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4e:96,bridge_name='br-int',has_traffic_filtering=True,id=e0003a9c-9202-4863-92aa-0fd29a026c8c,network=Network(a1111cf3-2ce5-4e9c-a5d1-7468a768f08e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0003a9c-92') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759658847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759658847',id=10,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9l33pWbZQh9MlgJ0c526xiqvNHClwgljKX0oW5Ns00va7Ih1kDjLTORglU0E8d91/kOyn6EwD4XGWP+H2+9W1xPbcpyJIBbpTxN1SZ9Q8W3RAxUoEhXIJ97lxsaeV5EQ==',key_name='tempest-keypair-1177168277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d06ab04c365d49639386a4c40620f735',ramdisk_id='',reservation_id='r-hg4z88r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1407862931',owner_user_name='tempest-TaggedBootDevicesTest-1407862931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c9a303c92cc4937a595f49417224e46',uuid=df13492d-d351-49c1-9755-7c30caae89f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "207857d3-8c12-4e4f-b934-c69ed1f92961", "address": "fa:16:3e:ca:ec:13", "network": {"id": "86a58fdf-5837-4342-b488-23f43f0c8db6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1066442327", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207857d3-8c", "ovs_interfaceid": "207857d3-8c12-4e4f-b934-c69ed1f92961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converting VIF {"id": "207857d3-8c12-4e4f-b934-c69ed1f92961", "address": "fa:16:3e:ca:ec:13", "network": {"id": "86a58fdf-5837-4342-b488-23f43f0c8db6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1066442327", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207857d3-8c", "ovs_interfaceid": "207857d3-8c12-4e4f-b934-c69ed1f92961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:ec:13,bridge_name='br-int',has_traffic_filtering=True,id=207857d3-8c12-4e4f-b934-c69ed1f92961,network=Network(86a58fdf-5837-4342-b488-23f43f0c8db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap207857d3-8c') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759658847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759658847',id=10,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9l33pWbZQh9MlgJ0c526xiqvNHClwgljKX0oW5Ns00va7Ih1kDjLTORglU0E8d91/kOyn6EwD4XGWP+H2+9W1xPbcpyJIBbpTxN1SZ9Q8W3RAxUoEhXIJ97lxsaeV5EQ==',key_name='tempest-keypair-1177168277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d06ab04c365d49639386a4c40620f735',ramdisk_id='',reservation_id='r-hg4z88r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1407862931',owner_user_name='tempest-TaggedBootDevicesTest-1407862931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c9a303c92cc4937a595f49417224e46',uuid=df13492d-d351-49c1-9755-7c30caae89f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b0aade1-07ec-4744-b85c-d71ff8e10663", "address": "fa:16:3e:07:d7:07", "network": {"id": "86a58fdf-5837-4342-b488-23f43f0c8db6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1066442327", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b0aade1-07", "ovs_interfaceid": "7b0aade1-07ec-4744-b85c-d71ff8e10663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converting VIF {"id": "7b0aade1-07ec-4744-b85c-d71ff8e10663", "address": "fa:16:3e:07:d7:07", "network": {"id": "86a58fdf-5837-4342-b488-23f43f0c8db6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1066442327", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b0aade1-07", "ovs_interfaceid": "7b0aade1-07ec-4744-b85c-d71ff8e10663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:d7:07,bridge_name='br-int',has_traffic_filtering=True,id=7b0aade1-07ec-4744-b85c-d71ff8e10663,network=Network(86a58fdf-5837-4342-b488-23f43f0c8db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b0aade1-07') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.objects.instance [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lazy-loading 'pci_devices' on Instance uuid df13492d-d351-49c1-9755-7c30caae89f1 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:00:52 user nova-compute[74898]:   <uuid>df13492d-d351-49c1-9755-7c30caae89f1</uuid>
Nov 17 03:00:52 user nova-compute[74898]:   <name>instance-0000000a</name>
Nov 17 03:00:52 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:00:52 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:00:52 user nova-compute[74898]:   <metadata>
Nov 17 03:00:52 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:00:52 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:00:52 user nova-compute[74898]:       <nova:name>tempest-device-tagging-server-759658847</nova:name>
Nov 17 03:00:52 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:00:48</nova:creationTime>
Nov 17 03:00:52 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:00:52 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:00:52 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:00:52 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:00:52 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:00:52 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:00:52 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:00:52 user nova-compute[74898]:       <nova:owner>
Nov 17 03:00:52 user nova-compute[74898]:         <nova:user uuid="4c9a303c92cc4937a595f49417224e46">tempest-TaggedBootDevicesTest-1407862931-project-member</nova:user>
Nov 17 03:00:52 user nova-compute[74898]:         <nova:project uuid="d06ab04c365d49639386a4c40620f735">tempest-TaggedBootDevicesTest-1407862931</nova:project>
Nov 17 03:00:52 user nova-compute[74898]:       </nova:owner>
Nov 17 03:00:52 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:00:52 user nova-compute[74898]:       <nova:ports>
Nov 17 03:00:52 user nova-compute[74898]:         <nova:port uuid="33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5">
Nov 17 03:00:52 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 17 03:00:52 user nova-compute[74898]:         </nova:port>
Nov 17 03:00:52 user nova-compute[74898]:         <nova:port uuid="c1a0a6a3-d445-4e76-b6ca-1183ae4b724f">
Nov 17 03:00:52 user nova-compute[74898]:           <nova:ip type="fixed" address="10.1.1.145" ipVersion="4"/>
Nov 17 03:00:52 user nova-compute[74898]:         </nova:port>
Nov 17 03:00:52 user nova-compute[74898]:         <nova:port uuid="d59452b9-ad23-4cfd-810a-776bb572d493">
Nov 17 03:00:52 user nova-compute[74898]:           <nova:ip type="fixed" address="10.1.1.241" ipVersion="4"/>
Nov 17 03:00:52 user nova-compute[74898]:         </nova:port>
Nov 17 03:00:52 user nova-compute[74898]:         <nova:port uuid="e20d2c64-8b92-434c-84a4-d28453214349">
Nov 17 03:00:52 user nova-compute[74898]:           <nova:ip type="fixed" address="10.1.1.244" ipVersion="4"/>
Nov 17 03:00:52 user nova-compute[74898]:         </nova:port>
Nov 17 03:00:52 user nova-compute[74898]:         <nova:port uuid="e0003a9c-9202-4863-92aa-0fd29a026c8c">
Nov 17 03:00:52 user nova-compute[74898]:           <nova:ip type="fixed" address="10.1.1.237" ipVersion="4"/>
Nov 17 03:00:52 user nova-compute[74898]:         </nova:port>
Nov 17 03:00:52 user nova-compute[74898]:         <nova:port uuid="207857d3-8c12-4e4f-b934-c69ed1f92961">
Nov 17 03:00:52 user nova-compute[74898]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 17 03:00:52 user nova-compute[74898]:         </nova:port>
Nov 17 03:00:52 user nova-compute[74898]:         <nova:port uuid="7b0aade1-07ec-4744-b85c-d71ff8e10663">
Nov 17 03:00:52 user nova-compute[74898]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 17 03:00:52 user nova-compute[74898]:         </nova:port>
Nov 17 03:00:52 user nova-compute[74898]:       </nova:ports>
Nov 17 03:00:52 user nova-compute[74898]:     </nova:instance>
Nov 17 03:00:52 user nova-compute[74898]:   </metadata>
Nov 17 03:00:52 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:00:52 user nova-compute[74898]:     <system>
Nov 17 03:00:52 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:00:52 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:00:52 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:00:52 user nova-compute[74898]:       <entry name="serial">df13492d-d351-49c1-9755-7c30caae89f1</entry>
Nov 17 03:00:52 user nova-compute[74898]:       <entry name="uuid">df13492d-d351-49c1-9755-7c30caae89f1</entry>
Nov 17 03:00:52 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:00:52 user nova-compute[74898]:     </system>
Nov 17 03:00:52 user nova-compute[74898]:   </sysinfo>
Nov 17 03:00:52 user nova-compute[74898]:   <os>
Nov 17 03:00:52 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:00:52 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:00:52 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:00:52 user nova-compute[74898]:   </os>
Nov 17 03:00:52 user nova-compute[74898]:   <features>
Nov 17 03:00:52 user nova-compute[74898]:     <acpi/>
Nov 17 03:00:52 user nova-compute[74898]:     <apic/>
Nov 17 03:00:52 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:00:52 user nova-compute[74898]:   </features>
Nov 17 03:00:52 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:00:52 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:00:52 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:00:52 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:00:52 user nova-compute[74898]:   </clock>
Nov 17 03:00:52 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:00:52 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:00:52 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:00:52 user nova-compute[74898]:   </cpu>
Nov 17 03:00:52 user nova-compute[74898]:   <devices>
Nov 17 03:00:52 user nova-compute[74898]:     <disk type="file" device="cdrom">
Nov 17 03:00:52 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none"/>
Nov 17 03:00:52 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/df13492d-d351-49c1-9755-7c30caae89f1/disk.config"/>
Nov 17 03:00:52 user nova-compute[74898]:       <target dev="hda" bus="ide"/>
Nov 17 03:00:52 user nova-compute[74898]:     </disk>
Nov 17 03:00:52 user nova-compute[74898]:     <disk type="block" device="disk">
Nov 17 03:00:52 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:00:52 user nova-compute[74898]:       <source dev="/dev/sdb"/>
Nov 17 03:00:52 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:00:52 user nova-compute[74898]:       <serial>35255e9c-5fd6-477f-818a-3fc7fbe655d1</serial>
Nov 17 03:00:52 user nova-compute[74898]:     </disk>
Nov 17 03:00:52 user nova-compute[74898]:     <disk type="block" device="disk">
Nov 17 03:00:52 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:00:52 user nova-compute[74898]:       <source dev="/dev/sdc"/>
Nov 17 03:00:52 user nova-compute[74898]:       <target dev="vdb" bus="virtio"/>
Nov 17 03:00:52 user nova-compute[74898]:       <serial>c9e40fe2-9d7f-4715-969a-be06e02bf1cd</serial>
Nov 17 03:00:52 user nova-compute[74898]:     </disk>
Nov 17 03:00:52 user nova-compute[74898]:     <disk type="block" device="disk">
Nov 17 03:00:52 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:00:52 user nova-compute[74898]:       <source dev="/dev/sdd"/>
Nov 17 03:00:52 user nova-compute[74898]:       <target dev="vdc" bus="virtio"/>
Nov 17 03:00:52 user nova-compute[74898]:       <serial>dee1ebf2-c6ab-4269-9c9a-68cb23c8a962</serial>
Nov 17 03:00:52 user nova-compute[74898]:     </disk>
Nov 17 03:00:52 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:00:52 user nova-compute[74898]:       <mac address="fa:16:3e:62:7a:e1"/>
Nov 17 03:00:52 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:00:52 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:00:52 user nova-compute[74898]:       <target dev="tap33c1e7b3-fb"/>
Nov 17 03:00:52 user nova-compute[74898]:     </interface>
Nov 17 03:00:52 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:00:52 user nova-compute[74898]:       <mac address="fa:16:3e:6d:37:0c"/>
Nov 17 03:00:52 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:00:52 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:00:52 user nova-compute[74898]:       <target dev="tapc1a0a6a3-d4"/>
Nov 17 03:00:52 user nova-compute[74898]:     </interface>
Nov 17 03:00:52 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:00:52 user nova-compute[74898]:       <mac address="fa:16:3e:86:66:f2"/>
Nov 17 03:00:52 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:00:52 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:00:52 user nova-compute[74898]:       <target dev="tapd59452b9-ad"/>
Nov 17 03:00:52 user nova-compute[74898]:     </interface>
Nov 17 03:00:52 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:00:52 user nova-compute[74898]:       <mac address="fa:16:3e:e1:f4:1c"/>
Nov 17 03:00:52 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:00:52 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:00:52 user nova-compute[74898]:       <target dev="tape20d2c64-8b"/>
Nov 17 03:00:52 user nova-compute[74898]:     </interface>
Nov 17 03:00:52 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:00:52 user nova-compute[74898]:       <mac address="fa:16:3e:8f:4e:96"/>
Nov 17 03:00:52 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:00:52 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:00:52 user nova-compute[74898]:       <target dev="tape0003a9c-92"/>
Nov 17 03:00:52 user nova-compute[74898]:     </interface>
Nov 17 03:00:52 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:00:52 user nova-compute[74898]:       <mac address="fa:16:3e:ca:ec:13"/>
Nov 17 03:00:52 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:00:52 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:00:52 user nova-compute[74898]:       <target dev="tap207857d3-8c"/>
Nov 17 03:00:52 user nova-compute[74898]:     </interface>
Nov 17 03:00:52 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:00:52 user nova-compute[74898]:       <mac address="fa:16:3e:07:d7:07"/>
Nov 17 03:00:52 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:00:52 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:00:52 user nova-compute[74898]:       <target dev="tap7b0aade1-07"/>
Nov 17 03:00:52 user nova-compute[74898]:     </interface>
Nov 17 03:00:52 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:00:52 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/df13492d-d351-49c1-9755-7c30caae89f1/console.log" append="off"/>
Nov 17 03:00:52 user nova-compute[74898]:     </serial>
Nov 17 03:00:52 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:00:52 user nova-compute[74898]:     <video>
Nov 17 03:00:52 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:00:52 user nova-compute[74898]:     </video>
Nov 17 03:00:52 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:00:52 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:00:52 user nova-compute[74898]:     </rng>
Nov 17 03:00:52 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:00:52 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:00:52 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:00:52 user nova-compute[74898]:     </memballoon>
Nov 17 03:00:52 user nova-compute[74898]:   </devices>
Nov 17 03:00:52 user nova-compute[74898]: </domain>
Nov 17 03:00:52 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759658847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759658847',id=10,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9l33pWbZQh9MlgJ0c526xiqvNHClwgljKX0oW5Ns00va7Ih1kDjLTORglU0E8d91/kOyn6EwD4XGWP+H2+9W1xPbcpyJIBbpTxN1SZ9Q8W3RAxUoEhXIJ97lxsaeV5EQ==',key_name='tempest-keypair-1177168277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d06ab04c365d49639386a4c40620f735',ramdisk_id='',reservation_id='r-hg4z88r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1407862931',owner_user_name='tempest-TaggedBootDevicesTest-1407862931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c9a303c92cc4937a595f49417224e46',uuid=df13492d-d351-49c1-9755-7c30caae89f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5", "address": "fa:16:3e:62:7a:e1", "network": {"id": "97f8611a-f601-4395-8871-1fc8bd7801af", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-548653871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33c1e7b3-fb", "ovs_interfaceid": "33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converting VIF {"id": "33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5", "address": "fa:16:3e:62:7a:e1", "network": {"id": "97f8611a-f601-4395-8871-1fc8bd7801af", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-548653871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33c1e7b3-fb", "ovs_interfaceid": "33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:7a:e1,bridge_name='br-int',has_traffic_filtering=True,id=33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5,network=Network(97f8611a-f601-4395-8871-1fc8bd7801af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33c1e7b3-fb') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG os_vif [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:7a:e1,bridge_name='br-int',has_traffic_filtering=True,id=33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5,network=Network(97f8611a-f601-4395-8871-1fc8bd7801af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33c1e7b3-fb') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a8b5887-1da0-57c9-a671-560171057f3c', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33c1e7b3-fb, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap33c1e7b3-fb, col_values=(('qos', UUID('c61e1d26-6253-43c4-a531-578a6860327d')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap33c1e7b3-fb, col_values=(('external_ids', {'iface-id': '33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:7a:e1', 'vm-uuid': 'df13492d-d351-49c1-9755-7c30caae89f1'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: INFO os_vif [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:7a:e1,bridge_name='br-int',has_traffic_filtering=True,id=33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5,network=Network(97f8611a-f601-4395-8871-1fc8bd7801af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33c1e7b3-fb')
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759658847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759658847',id=10,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9l33pWbZQh9MlgJ0c526xiqvNHClwgljKX0oW5Ns00va7Ih1kDjLTORglU0E8d91/kOyn6EwD4XGWP+H2+9W1xPbcpyJIBbpTxN1SZ9Q8W3RAxUoEhXIJ97lxsaeV5EQ==',key_name='tempest-keypair-1177168277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d06ab04c365d49639386a4c40620f735',ramdisk_id='',reservation_id='r-hg4z88r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1407862931',owner_user_name='tempest-TaggedBootDevicesTest-1407862931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c9a303c92cc4937a595f49417224e46',uuid=df13492d-d351-49c1-9755-7c30caae89f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1a0a6a3-d445-4e76-b6ca-1183ae4b724f", "address": "fa:16:3e:6d:37:0c", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a0a6a3-d4", "ovs_interfaceid": "c1a0a6a3-d445-4e76-b6ca-1183ae4b724f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converting VIF {"id": "c1a0a6a3-d445-4e76-b6ca-1183ae4b724f", "address": "fa:16:3e:6d:37:0c", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a0a6a3-d4", "ovs_interfaceid": "c1a0a6a3-d445-4e76-b6ca-1183ae4b724f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:37:0c,bridge_name='br-int',has_traffic_filtering=True,id=c1a0a6a3-d445-4e76-b6ca-1183ae4b724f,network=Network(a1111cf3-2ce5-4e9c-a5d1-7468a768f08e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc1a0a6a3-d4') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG os_vif [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:37:0c,bridge_name='br-int',has_traffic_filtering=True,id=c1a0a6a3-d445-4e76-b6ca-1183ae4b724f,network=Network(a1111cf3-2ce5-4e9c-a5d1-7468a768f08e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc1a0a6a3-d4') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e25c37be-705f-511c-b65e-86a3da88024b', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1a0a6a3-d4, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc1a0a6a3-d4, col_values=(('qos', UUID('070782f7-ebc0-4926-a567-b1d6ba83980d')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc1a0a6a3-d4, col_values=(('external_ids', {'iface-id': 'c1a0a6a3-d445-4e76-b6ca-1183ae4b724f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:37:0c', 'vm-uuid': 'df13492d-d351-49c1-9755-7c30caae89f1'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: INFO os_vif [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:37:0c,bridge_name='br-int',has_traffic_filtering=True,id=c1a0a6a3-d445-4e76-b6ca-1183ae4b724f,network=Network(a1111cf3-2ce5-4e9c-a5d1-7468a768f08e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc1a0a6a3-d4')
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759658847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759658847',id=10,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9l33pWbZQh9MlgJ0c526xiqvNHClwgljKX0oW5Ns00va7Ih1kDjLTORglU0E8d91/kOyn6EwD4XGWP+H2+9W1xPbcpyJIBbpTxN1SZ9Q8W3RAxUoEhXIJ97lxsaeV5EQ==',key_name='tempest-keypair-1177168277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d06ab04c365d49639386a4c40620f735',ramdisk_id='',reservation_id='r-hg4z88r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1407862931',owner_user_name='tempest-TaggedBootDevicesTest-1407862931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c9a303c92cc4937a595f49417224e46',uuid=df13492d-d351-49c1-9755-7c30caae89f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d59452b9-ad23-4cfd-810a-776bb572d493", "address": "fa:16:3e:86:66:f2", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59452b9-ad", "ovs_interfaceid": "d59452b9-ad23-4cfd-810a-776bb572d493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converting VIF {"id": "d59452b9-ad23-4cfd-810a-776bb572d493", "address": "fa:16:3e:86:66:f2", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59452b9-ad", "ovs_interfaceid": "d59452b9-ad23-4cfd-810a-776bb572d493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:66:f2,bridge_name='br-int',has_traffic_filtering=True,id=d59452b9-ad23-4cfd-810a-776bb572d493,network=Network(a1111cf3-2ce5-4e9c-a5d1-7468a768f08e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd59452b9-ad') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG os_vif [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:66:f2,bridge_name='br-int',has_traffic_filtering=True,id=d59452b9-ad23-4cfd-810a-776bb572d493,network=Network(a1111cf3-2ce5-4e9c-a5d1-7468a768f08e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd59452b9-ad') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55e51b98-b758-51cc-a54e-9f7e1424b1b4', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd59452b9-ad, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd59452b9-ad, col_values=(('qos', UUID('ea173f02-9874-489c-8c73-cfa56b2d1014')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd59452b9-ad, col_values=(('external_ids', {'iface-id': 'd59452b9-ad23-4cfd-810a-776bb572d493', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:66:f2', 'vm-uuid': 'df13492d-d351-49c1-9755-7c30caae89f1'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: INFO os_vif [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:66:f2,bridge_name='br-int',has_traffic_filtering=True,id=d59452b9-ad23-4cfd-810a-776bb572d493,network=Network(a1111cf3-2ce5-4e9c-a5d1-7468a768f08e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd59452b9-ad')
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759658847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759658847',id=10,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9l33pWbZQh9MlgJ0c526xiqvNHClwgljKX0oW5Ns00va7Ih1kDjLTORglU0E8d91/kOyn6EwD4XGWP+H2+9W1xPbcpyJIBbpTxN1SZ9Q8W3RAxUoEhXIJ97lxsaeV5EQ==',key_name='tempest-keypair-1177168277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d06ab04c365d49639386a4c40620f735',ramdisk_id='',reservation_id='r-hg4z88r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1407862931',owner_user_name='tempest-TaggedBootDevicesTest-1407862931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c9a303c92cc4937a595f49417224e46',uuid=df13492d-d351-49c1-9755-7c30caae89f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e20d2c64-8b92-434c-84a4-d28453214349", "address": "fa:16:3e:e1:f4:1c", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape20d2c64-8b", "ovs_interfaceid": "e20d2c64-8b92-434c-84a4-d28453214349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converting VIF {"id": "e20d2c64-8b92-434c-84a4-d28453214349", "address": "fa:16:3e:e1:f4:1c", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape20d2c64-8b", "ovs_interfaceid": "e20d2c64-8b92-434c-84a4-d28453214349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f4:1c,bridge_name='br-int',has_traffic_filtering=True,id=e20d2c64-8b92-434c-84a4-d28453214349,network=Network(a1111cf3-2ce5-4e9c-a5d1-7468a768f08e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape20d2c64-8b') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG os_vif [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f4:1c,bridge_name='br-int',has_traffic_filtering=True,id=e20d2c64-8b92-434c-84a4-d28453214349,network=Network(a1111cf3-2ce5-4e9c-a5d1-7468a768f08e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape20d2c64-8b') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56a72350-9675-5703-bd7e-0350fbad9a46', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape20d2c64-8b, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape20d2c64-8b, col_values=(('qos', UUID('284b0abb-219d-43f5-abcc-3beb3967e6c5')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape20d2c64-8b, col_values=(('external_ids', {'iface-id': 'e20d2c64-8b92-434c-84a4-d28453214349', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:f4:1c', 'vm-uuid': 'df13492d-d351-49c1-9755-7c30caae89f1'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: INFO os_vif [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f4:1c,bridge_name='br-int',has_traffic_filtering=True,id=e20d2c64-8b92-434c-84a4-d28453214349,network=Network(a1111cf3-2ce5-4e9c-a5d1-7468a768f08e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape20d2c64-8b')
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759658847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759658847',id=10,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9l33pWbZQh9MlgJ0c526xiqvNHClwgljKX0oW5Ns00va7Ih1kDjLTORglU0E8d91/kOyn6EwD4XGWP+H2+9W1xPbcpyJIBbpTxN1SZ9Q8W3RAxUoEhXIJ97lxsaeV5EQ==',key_name='tempest-keypair-1177168277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d06ab04c365d49639386a4c40620f735',ramdisk_id='',reservation_id='r-hg4z88r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1407862931',owner_user_name='tempest-TaggedBootDevicesTest-1407862931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c9a303c92cc4937a595f49417224e46',uuid=df13492d-d351-49c1-9755-7c30caae89f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0003a9c-9202-4863-92aa-0fd29a026c8c", "address": "fa:16:3e:8f:4e:96", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0003a9c-92", "ovs_interfaceid": "e0003a9c-9202-4863-92aa-0fd29a026c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converting VIF {"id": "e0003a9c-9202-4863-92aa-0fd29a026c8c", "address": "fa:16:3e:8f:4e:96", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0003a9c-92", "ovs_interfaceid": "e0003a9c-9202-4863-92aa-0fd29a026c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4e:96,bridge_name='br-int',has_traffic_filtering=True,id=e0003a9c-9202-4863-92aa-0fd29a026c8c,network=Network(a1111cf3-2ce5-4e9c-a5d1-7468a768f08e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0003a9c-92') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG os_vif [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4e:96,bridge_name='br-int',has_traffic_filtering=True,id=e0003a9c-9202-4863-92aa-0fd29a026c8c,network=Network(a1111cf3-2ce5-4e9c-a5d1-7468a768f08e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0003a9c-92') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8375e379-0be7-523f-b0bf-41b9e4ed84b7', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0003a9c-92, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape0003a9c-92, col_values=(('qos', UUID('c2556061-37d3-497d-872d-96869e76be4c')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape0003a9c-92, col_values=(('external_ids', {'iface-id': 'e0003a9c-9202-4863-92aa-0fd29a026c8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:4e:96', 'vm-uuid': 'df13492d-d351-49c1-9755-7c30caae89f1'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: INFO os_vif [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4e:96,bridge_name='br-int',has_traffic_filtering=True,id=e0003a9c-9202-4863-92aa-0fd29a026c8c,network=Network(a1111cf3-2ce5-4e9c-a5d1-7468a768f08e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0003a9c-92')
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759658847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759658847',id=10,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9l33pWbZQh9MlgJ0c526xiqvNHClwgljKX0oW5Ns00va7Ih1kDjLTORglU0E8d91/kOyn6EwD4XGWP+H2+9W1xPbcpyJIBbpTxN1SZ9Q8W3RAxUoEhXIJ97lxsaeV5EQ==',key_name='tempest-keypair-1177168277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d06ab04c365d49639386a4c40620f735',ramdisk_id='',reservation_id='r-hg4z88r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1407862931',owner_user_name='tempest-TaggedBootDevicesTest-1407862931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c9a303c92cc4937a595f49417224e46',uuid=df13492d-d351-49c1-9755-7c30caae89f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "207857d3-8c12-4e4f-b934-c69ed1f92961", "address": "fa:16:3e:ca:ec:13", "network": {"id": "86a58fdf-5837-4342-b488-23f43f0c8db6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1066442327", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207857d3-8c", "ovs_interfaceid": "207857d3-8c12-4e4f-b934-c69ed1f92961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converting VIF {"id": "207857d3-8c12-4e4f-b934-c69ed1f92961", "address": "fa:16:3e:ca:ec:13", "network": {"id": "86a58fdf-5837-4342-b488-23f43f0c8db6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1066442327", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207857d3-8c", "ovs_interfaceid": "207857d3-8c12-4e4f-b934-c69ed1f92961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:ec:13,bridge_name='br-int',has_traffic_filtering=True,id=207857d3-8c12-4e4f-b934-c69ed1f92961,network=Network(86a58fdf-5837-4342-b488-23f43f0c8db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap207857d3-8c') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG os_vif [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:ec:13,bridge_name='br-int',has_traffic_filtering=True,id=207857d3-8c12-4e4f-b934-c69ed1f92961,network=Network(86a58fdf-5837-4342-b488-23f43f0c8db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap207857d3-8c') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc185e8b-eaaf-5492-bb4e-94e17e0e4330', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap207857d3-8c, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap207857d3-8c, col_values=(('qos', UUID('fe2264f8-1b7e-4d22-af1d-01a5e3dad562')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap207857d3-8c, col_values=(('external_ids', {'iface-id': '207857d3-8c12-4e4f-b934-c69ed1f92961', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:ec:13', 'vm-uuid': 'df13492d-d351-49c1-9755-7c30caae89f1'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: INFO os_vif [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:ec:13,bridge_name='br-int',has_traffic_filtering=True,id=207857d3-8c12-4e4f-b934-c69ed1f92961,network=Network(86a58fdf-5837-4342-b488-23f43f0c8db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap207857d3-8c')
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759658847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759658847',id=10,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9l33pWbZQh9MlgJ0c526xiqvNHClwgljKX0oW5Ns00va7Ih1kDjLTORglU0E8d91/kOyn6EwD4XGWP+H2+9W1xPbcpyJIBbpTxN1SZ9Q8W3RAxUoEhXIJ97lxsaeV5EQ==',key_name='tempest-keypair-1177168277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d06ab04c365d49639386a4c40620f735',ramdisk_id='',reservation_id='r-hg4z88r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1407862931',owner_user_name='tempest-TaggedBootDevicesTest-1407862931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c9a303c92cc4937a595f49417224e46',uuid=df13492d-d351-49c1-9755-7c30caae89f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b0aade1-07ec-4744-b85c-d71ff8e10663", "address": "fa:16:3e:07:d7:07", "network": {"id": "86a58fdf-5837-4342-b488-23f43f0c8db6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1066442327", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b0aade1-07", "ovs_interfaceid": "7b0aade1-07ec-4744-b85c-d71ff8e10663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converting VIF {"id": "7b0aade1-07ec-4744-b85c-d71ff8e10663", "address": "fa:16:3e:07:d7:07", "network": {"id": "86a58fdf-5837-4342-b488-23f43f0c8db6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1066442327", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b0aade1-07", "ovs_interfaceid": "7b0aade1-07ec-4744-b85c-d71ff8e10663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:d7:07,bridge_name='br-int',has_traffic_filtering=True,id=7b0aade1-07ec-4744-b85c-d71ff8e10663,network=Network(86a58fdf-5837-4342-b488-23f43f0c8db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b0aade1-07') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG os_vif [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:d7:07,bridge_name='br-int',has_traffic_filtering=True,id=7b0aade1-07ec-4744-b85c-d71ff8e10663,network=Network(86a58fdf-5837-4342-b488-23f43f0c8db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b0aade1-07') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b8080a38-e7cf-5887-a58a-76986dd0fe61', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b0aade1-07, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b0aade1-07, col_values=(('qos', UUID('608c15a9-71db-421c-9f62-23e1bf1b118c')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b0aade1-07, col_values=(('external_ids', {'iface-id': '7b0aade1-07ec-4744-b85c-d71ff8e10663', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:d7:07', 'vm-uuid': 'df13492d-d351-49c1-9755-7c30caae89f1'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:00:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:52 user nova-compute[74898]: INFO os_vif [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:d7:07,bridge_name='br-int',has_traffic_filtering=True,id=7b0aade1-07ec-4744-b85c-d71ff8e10663,network=Network(86a58fdf-5837-4342-b488-23f43f0c8db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b0aade1-07')
Nov 17 03:00:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] No BDM found with device name hda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:00:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:00:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] No VIF found with MAC fa:16:3e:62:7a:e1, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:00:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] No VIF found with MAC fa:16:3e:8f:4e:96, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:00:53 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Using config drive
Nov 17 03:00:53 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Creating config drive at /opt/stack/data/nova/instances/df13492d-d351-49c1-9755-7c30caae89f1/disk.config
Nov 17 03:00:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/df13492d-d351-49c1-9755-7c30caae89f1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpay0apde5 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/df13492d-d351-49c1-9755-7c30caae89f1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpay0apde5" returned: 0 in 0.061s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "d1ee03a5-13fb-47e7-8712-ea31aed36643" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "d1ee03a5-13fb-47e7-8712-ea31aed36643" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:54 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:00:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:54 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:00:54 user nova-compute[74898]: INFO nova.compute.claims [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Claim successful on node user
Nov 17 03:00:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:55 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:00:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:55 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:00:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.628s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:55 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:00:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:55 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:00:55 user nova-compute[74898]: DEBUG nova.network.neutron [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:00:55 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:00:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:55 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:00:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:55 user nova-compute[74898]: DEBUG nova.policy [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8507fa418393437cbba167b470aa7dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3251ef4d69740409c9beec4f368bf72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:00:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:55 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:00:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:00:55 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Creating image(s)
Nov 17 03:00:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "/opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "/opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "0d26be1178031a8201ee5e12c522d9728e450cac" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "0d26be1178031a8201ee5e12c522d9728e450cac" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d26be1178031a8201ee5e12c522d9728e450cac.part --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG nova.compute.manager [req-bfe2349c-bca2-4a0c-bd4d-557194745490 req-b7066160-7dfd-4730-8102-cc56ba669f08 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-plugged-d59452b9-ad23-4cfd-810a-776bb572d493 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-bfe2349c-bca2-4a0c-bd4d-557194745490 req-b7066160-7dfd-4730-8102-cc56ba669f08 service nova] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-bfe2349c-bca2-4a0c-bd4d-557194745490 req-b7066160-7dfd-4730-8102-cc56ba669f08 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-bfe2349c-bca2-4a0c-bd4d-557194745490 req-b7066160-7dfd-4730-8102-cc56ba669f08 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG nova.compute.manager [req-bfe2349c-bca2-4a0c-bd4d-557194745490 req-b7066160-7dfd-4730-8102-cc56ba669f08 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] No waiting events found dispatching network-vif-plugged-d59452b9-ad23-4cfd-810a-776bb572d493 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:00:56 user nova-compute[74898]: WARNING nova.compute.manager [req-bfe2349c-bca2-4a0c-bd4d-557194745490 req-b7066160-7dfd-4730-8102-cc56ba669f08 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received unexpected event network-vif-plugged-d59452b9-ad23-4cfd-810a-776bb572d493 for instance with vm_state building and task_state spawning.
Nov 17 03:00:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d26be1178031a8201ee5e12c522d9728e450cac.part --force-share --output=json" returned: 0 in 0.200s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG nova.virt.images [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] 69542cfe-cdd4-48dc-9b63-061653d7cdc6 was qcow2, converting to raw {{(pid=74898) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG nova.privsep.utils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74898) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0d26be1178031a8201ee5e12c522d9728e450cac.part /opt/stack/data/nova/instances/_base/0d26be1178031a8201ee5e12c522d9728e450cac.converted {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG nova.compute.manager [req-c6cfb633-db61-435f-9e6f-36fddbc3fe31 req-cb615579-1a5f-49ea-8f6f-0f89d0d4ec96 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-plugged-e0003a9c-9202-4863-92aa-0fd29a026c8c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c6cfb633-db61-435f-9e6f-36fddbc3fe31 req-cb615579-1a5f-49ea-8f6f-0f89d0d4ec96 service nova] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c6cfb633-db61-435f-9e6f-36fddbc3fe31 req-cb615579-1a5f-49ea-8f6f-0f89d0d4ec96 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c6cfb633-db61-435f-9e6f-36fddbc3fe31 req-cb615579-1a5f-49ea-8f6f-0f89d0d4ec96 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG nova.compute.manager [req-c6cfb633-db61-435f-9e6f-36fddbc3fe31 req-cb615579-1a5f-49ea-8f6f-0f89d0d4ec96 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] No waiting events found dispatching network-vif-plugged-e0003a9c-9202-4863-92aa-0fd29a026c8c {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:00:56 user nova-compute[74898]: WARNING nova.compute.manager [req-c6cfb633-db61-435f-9e6f-36fddbc3fe31 req-cb615579-1a5f-49ea-8f6f-0f89d0d4ec96 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received unexpected event network-vif-plugged-e0003a9c-9202-4863-92aa-0fd29a026c8c for instance with vm_state building and task_state spawning.
Nov 17 03:00:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0d26be1178031a8201ee5e12c522d9728e450cac.part /opt/stack/data/nova/instances/_base/0d26be1178031a8201ee5e12c522d9728e450cac.converted" returned: 0 in 0.175s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d26be1178031a8201ee5e12c522d9728e450cac.converted --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG nova.network.neutron [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Successfully created port: 4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d26be1178031a8201ee5e12c522d9728e450cac.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "0d26be1178031a8201ee5e12c522d9728e450cac" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.214s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d26be1178031a8201ee5e12c522d9728e450cac --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d26be1178031a8201ee5e12c522d9728e450cac --force-share --output=json" returned: 0 in 0.181s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "0d26be1178031a8201ee5e12c522d9728e450cac" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "0d26be1178031a8201ee5e12c522d9728e450cac" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d26be1178031a8201ee5e12c522d9728e450cac --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d26be1178031a8201ee5e12c522d9728e450cac --force-share --output=json" returned: 0 in 0.191s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d26be1178031a8201ee5e12c522d9728e450cac,backing_fmt=raw /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d26be1178031a8201ee5e12c522d9728e450cac,backing_fmt=raw /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk 1073741824" returned: 0 in 0.097s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "0d26be1178031a8201ee5e12c522d9728e450cac" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d26be1178031a8201ee5e12c522d9728e450cac --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.network.neutron [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Successfully updated port: 4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "refresh_cache-d1ee03a5-13fb-47e7-8712-ea31aed36643" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquired lock "refresh_cache-d1ee03a5-13fb-47e7-8712-ea31aed36643" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.network.neutron [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d26be1178031a8201ee5e12c522d9728e450cac --force-share --output=json" returned: 0 in 0.186s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.network.neutron [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Cannot resize image /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Ensure instance console log exists: /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.compute.manager [req-8b836641-bd8d-43ea-be37-226815923173 req-d52ae2d5-cca9-44c7-8006-b599c57fd1e7 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-plugged-33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8b836641-bd8d-43ea-be37-226815923173 req-d52ae2d5-cca9-44c7-8006-b599c57fd1e7 service nova] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8b836641-bd8d-43ea-be37-226815923173 req-d52ae2d5-cca9-44c7-8006-b599c57fd1e7 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8b836641-bd8d-43ea-be37-226815923173 req-d52ae2d5-cca9-44c7-8006-b599c57fd1e7 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.compute.manager [req-8b836641-bd8d-43ea-be37-226815923173 req-d52ae2d5-cca9-44c7-8006-b599c57fd1e7 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] No waiting events found dispatching network-vif-plugged-33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:00:57 user nova-compute[74898]: WARNING nova.compute.manager [req-8b836641-bd8d-43ea-be37-226815923173 req-d52ae2d5-cca9-44c7-8006-b599c57fd1e7 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received unexpected event network-vif-plugged-33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5 for instance with vm_state building and task_state spawning.
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.network.neutron [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Updating instance_info_cache with network_info: [{"id": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "address": "fa:16:3e:46:e0:47", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cfbdbfd-83", "ovs_interfaceid": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Releasing lock "refresh_cache-d1ee03a5-13fb-47e7-8712-ea31aed36643" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Instance network_info: |[{"id": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "address": "fa:16:3e:46:e0:47", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cfbdbfd-83", "ovs_interfaceid": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Start _get_guest_xml network_info=[{"id": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "address": "fa:16:3e:46:e0:47", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cfbdbfd-83", "ovs_interfaceid": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T03:00:52Z,direct_url=<?>,disk_format='qcow2',id=69542cfe-cdd4-48dc-9b63-061653d7cdc6,min_disk=0,min_ram=0,name='tempest-scenario-img--164646168',owner='e3251ef4d69740409c9beec4f368bf72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T03:00:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '69542cfe-cdd4-48dc-9b63-061653d7cdc6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:00:57 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:00:57 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T03:00:52Z,direct_url=<?>,disk_format='qcow2',id=69542cfe-cdd4-48dc-9b63-061653d7cdc6,min_disk=0,min_ram=0,name='tempest-scenario-img--164646168',owner='e3251ef4d69740409c9beec4f368bf72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T03:00:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-518555806',display_name='tempest-TestMinimumBasicScenario-server-518555806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-518555806',id=12,image_ref='69542cfe-cdd4-48dc-9b63-061653d7cdc6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1EY5rCz2E3x/wAgxCKYUaqooziw3CyJR0nPDRdz0y4i4+yhrfN56ldStLgGItlqOV644u8QPrJzURL6gJ6sRaVxPODdWNcHba75nAX5V0fmckz29P2gUNRuvvbham3/Q==',key_name='tempest-TestMinimumBasicScenario-1952571884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3251ef4d69740409c9beec4f368bf72',ramdisk_id='',reservation_id='r-d70154jv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='69542cfe-cdd4-48dc-9b63-061653d7cdc6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1625508354',owner_user_name='tempest-TestMinimumBasicScenario-1625508354-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:00:55Z,user_data=None,user_id='8507fa418393437cbba167b470aa7dc1',uuid=d1ee03a5-13fb-47e7-8712-ea31aed36643,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "address": "fa:16:3e:46:e0:47", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cfbdbfd-83", "ovs_interfaceid": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Converting VIF {"id": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "address": "fa:16:3e:46:e0:47", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cfbdbfd-83", "ovs_interfaceid": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:e0:47,bridge_name='br-int',has_traffic_filtering=True,id=4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd,network=Network(7b139a66-9d14-40e3-b129-0febdd13b264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cfbdbfd-83') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.objects.instance [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lazy-loading 'pci_devices' on Instance uuid d1ee03a5-13fb-47e7-8712-ea31aed36643 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.compute.manager [req-57f9916a-3358-425c-a8b6-dd188b527341 req-6675de0f-0968-4274-a3b4-986a91e6d2fe service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-plugged-d59452b9-ad23-4cfd-810a-776bb572d493 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-57f9916a-3358-425c-a8b6-dd188b527341 req-6675de0f-0968-4274-a3b4-986a91e6d2fe service nova] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-57f9916a-3358-425c-a8b6-dd188b527341 req-6675de0f-0968-4274-a3b4-986a91e6d2fe service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-57f9916a-3358-425c-a8b6-dd188b527341 req-6675de0f-0968-4274-a3b4-986a91e6d2fe service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.compute.manager [req-57f9916a-3358-425c-a8b6-dd188b527341 req-6675de0f-0968-4274-a3b4-986a91e6d2fe service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] No waiting events found dispatching network-vif-plugged-d59452b9-ad23-4cfd-810a-776bb572d493 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:00:57 user nova-compute[74898]: WARNING nova.compute.manager [req-57f9916a-3358-425c-a8b6-dd188b527341 req-6675de0f-0968-4274-a3b4-986a91e6d2fe service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received unexpected event network-vif-plugged-d59452b9-ad23-4cfd-810a-776bb572d493 for instance with vm_state building and task_state spawning.
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.compute.manager [req-57f9916a-3358-425c-a8b6-dd188b527341 req-6675de0f-0968-4274-a3b4-986a91e6d2fe service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Received event network-changed-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.compute.manager [req-57f9916a-3358-425c-a8b6-dd188b527341 req-6675de0f-0968-4274-a3b4-986a91e6d2fe service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Refreshing instance network info cache due to event network-changed-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-57f9916a-3358-425c-a8b6-dd188b527341 req-6675de0f-0968-4274-a3b4-986a91e6d2fe service nova] Acquiring lock "refresh_cache-d1ee03a5-13fb-47e7-8712-ea31aed36643" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-57f9916a-3358-425c-a8b6-dd188b527341 req-6675de0f-0968-4274-a3b4-986a91e6d2fe service nova] Acquired lock "refresh_cache-d1ee03a5-13fb-47e7-8712-ea31aed36643" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.network.neutron [req-57f9916a-3358-425c-a8b6-dd188b527341 req-6675de0f-0968-4274-a3b4-986a91e6d2fe service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Refreshing network info cache for port 4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:00:57 user nova-compute[74898]:   <uuid>d1ee03a5-13fb-47e7-8712-ea31aed36643</uuid>
Nov 17 03:00:57 user nova-compute[74898]:   <name>instance-0000000c</name>
Nov 17 03:00:57 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:00:57 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:00:57 user nova-compute[74898]:   <metadata>
Nov 17 03:00:57 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:00:57 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:00:57 user nova-compute[74898]:       <nova:name>tempest-TestMinimumBasicScenario-server-518555806</nova:name>
Nov 17 03:00:57 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:00:57</nova:creationTime>
Nov 17 03:00:57 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:00:57 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:00:57 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:00:57 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:00:57 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:00:57 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:00:57 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:00:57 user nova-compute[74898]:       <nova:owner>
Nov 17 03:00:57 user nova-compute[74898]:         <nova:user uuid="8507fa418393437cbba167b470aa7dc1">tempest-TestMinimumBasicScenario-1625508354-project-member</nova:user>
Nov 17 03:00:57 user nova-compute[74898]:         <nova:project uuid="e3251ef4d69740409c9beec4f368bf72">tempest-TestMinimumBasicScenario-1625508354</nova:project>
Nov 17 03:00:57 user nova-compute[74898]:       </nova:owner>
Nov 17 03:00:57 user nova-compute[74898]:       <nova:root type="image" uuid="69542cfe-cdd4-48dc-9b63-061653d7cdc6"/>
Nov 17 03:00:57 user nova-compute[74898]:       <nova:ports>
Nov 17 03:00:57 user nova-compute[74898]:         <nova:port uuid="4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd">
Nov 17 03:00:57 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 17 03:00:57 user nova-compute[74898]:         </nova:port>
Nov 17 03:00:57 user nova-compute[74898]:       </nova:ports>
Nov 17 03:00:57 user nova-compute[74898]:     </nova:instance>
Nov 17 03:00:57 user nova-compute[74898]:   </metadata>
Nov 17 03:00:57 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:00:57 user nova-compute[74898]:     <system>
Nov 17 03:00:57 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:00:57 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:00:57 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:00:57 user nova-compute[74898]:       <entry name="serial">d1ee03a5-13fb-47e7-8712-ea31aed36643</entry>
Nov 17 03:00:57 user nova-compute[74898]:       <entry name="uuid">d1ee03a5-13fb-47e7-8712-ea31aed36643</entry>
Nov 17 03:00:57 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:00:57 user nova-compute[74898]:     </system>
Nov 17 03:00:57 user nova-compute[74898]:   </sysinfo>
Nov 17 03:00:57 user nova-compute[74898]:   <os>
Nov 17 03:00:57 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:00:57 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:00:57 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:00:57 user nova-compute[74898]:   </os>
Nov 17 03:00:57 user nova-compute[74898]:   <features>
Nov 17 03:00:57 user nova-compute[74898]:     <acpi/>
Nov 17 03:00:57 user nova-compute[74898]:     <apic/>
Nov 17 03:00:57 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:00:57 user nova-compute[74898]:   </features>
Nov 17 03:00:57 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:00:57 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:00:57 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:00:57 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:00:57 user nova-compute[74898]:   </clock>
Nov 17 03:00:57 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:00:57 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:00:57 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:00:57 user nova-compute[74898]:   </cpu>
Nov 17 03:00:57 user nova-compute[74898]:   <devices>
Nov 17 03:00:57 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:00:57 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:00:57 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk"/>
Nov 17 03:00:57 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:00:57 user nova-compute[74898]:     </disk>
Nov 17 03:00:57 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:00:57 user nova-compute[74898]:       <mac address="fa:16:3e:46:e0:47"/>
Nov 17 03:00:57 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:00:57 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:00:57 user nova-compute[74898]:       <target dev="tap4cfbdbfd-83"/>
Nov 17 03:00:57 user nova-compute[74898]:     </interface>
Nov 17 03:00:57 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:00:57 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/console.log" append="off"/>
Nov 17 03:00:57 user nova-compute[74898]:     </serial>
Nov 17 03:00:57 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:00:57 user nova-compute[74898]:     <video>
Nov 17 03:00:57 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:00:57 user nova-compute[74898]:     </video>
Nov 17 03:00:57 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:00:57 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:00:57 user nova-compute[74898]:     </rng>
Nov 17 03:00:57 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:00:57 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:00:57 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:00:57 user nova-compute[74898]:     </memballoon>
Nov 17 03:00:57 user nova-compute[74898]:   </devices>
Nov 17 03:00:57 user nova-compute[74898]: </domain>
Nov 17 03:00:57 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-518555806',display_name='tempest-TestMinimumBasicScenario-server-518555806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-518555806',id=12,image_ref='69542cfe-cdd4-48dc-9b63-061653d7cdc6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1EY5rCz2E3x/wAgxCKYUaqooziw3CyJR0nPDRdz0y4i4+yhrfN56ldStLgGItlqOV644u8QPrJzURL6gJ6sRaVxPODdWNcHba75nAX5V0fmckz29P2gUNRuvvbham3/Q==',key_name='tempest-TestMinimumBasicScenario-1952571884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3251ef4d69740409c9beec4f368bf72',ramdisk_id='',reservation_id='r-d70154jv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='69542cfe-cdd4-48dc-9b63-061653d7cdc6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1625508354',owner_user_name='tempest-TestMinimumBasicScenario-1625508354-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:00:55Z,user_data=None,user_id='8507fa418393437cbba167b470aa7dc1',uuid=d1ee03a5-13fb-47e7-8712-ea31aed36643,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "address": "fa:16:3e:46:e0:47", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cfbdbfd-83", "ovs_interfaceid": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Converting VIF {"id": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "address": "fa:16:3e:46:e0:47", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cfbdbfd-83", "ovs_interfaceid": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:e0:47,bridge_name='br-int',has_traffic_filtering=True,id=4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd,network=Network(7b139a66-9d14-40e3-b129-0febdd13b264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cfbdbfd-83') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG os_vif [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:e0:47,bridge_name='br-int',has_traffic_filtering=True,id=4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd,network=Network(7b139a66-9d14-40e3-b129-0febdd13b264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cfbdbfd-83') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '06f2c04e-2781-558e-8b15-51a59ec38f3e', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4cfbdbfd-83, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4cfbdbfd-83, col_values=(('qos', UUID('a0feb3d3-52bd-4f21-add9-ce872012198d')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4cfbdbfd-83, col_values=(('external_ids', {'iface-id': '4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:e0:47', 'vm-uuid': 'd1ee03a5-13fb-47e7-8712-ea31aed36643'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:00:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:57 user nova-compute[74898]: INFO os_vif [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:e0:47,bridge_name='br-int',has_traffic_filtering=True,id=4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd,network=Network(7b139a66-9d14-40e3-b129-0febdd13b264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cfbdbfd-83')
Nov 17 03:00:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:00:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] No VIF found with MAC fa:16:3e:46:e0:47, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:00:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:58 user nova-compute[74898]: DEBUG nova.network.neutron [req-57f9916a-3358-425c-a8b6-dd188b527341 req-6675de0f-0968-4274-a3b4-986a91e6d2fe service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Updated VIF entry in instance network info cache for port 4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:00:58 user nova-compute[74898]: DEBUG nova.network.neutron [req-57f9916a-3358-425c-a8b6-dd188b527341 req-6675de0f-0968-4274-a3b4-986a91e6d2fe service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Updating instance_info_cache with network_info: [{"id": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "address": "fa:16:3e:46:e0:47", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cfbdbfd-83", "ovs_interfaceid": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:00:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-57f9916a-3358-425c-a8b6-dd188b527341 req-6675de0f-0968-4274-a3b4-986a91e6d2fe service nova] Releasing lock "refresh_cache-d1ee03a5-13fb-47e7-8712-ea31aed36643" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:00:58 user nova-compute[74898]: DEBUG nova.compute.manager [req-5df9169b-9e09-4818-8dcd-26f3660c45da req-94887578-f846-4cbc-8af5-a428a4e07fc8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-plugged-e0003a9c-9202-4863-92aa-0fd29a026c8c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5df9169b-9e09-4818-8dcd-26f3660c45da req-94887578-f846-4cbc-8af5-a428a4e07fc8 service nova] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5df9169b-9e09-4818-8dcd-26f3660c45da req-94887578-f846-4cbc-8af5-a428a4e07fc8 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5df9169b-9e09-4818-8dcd-26f3660c45da req-94887578-f846-4cbc-8af5-a428a4e07fc8 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:58 user nova-compute[74898]: DEBUG nova.compute.manager [req-5df9169b-9e09-4818-8dcd-26f3660c45da req-94887578-f846-4cbc-8af5-a428a4e07fc8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] No waiting events found dispatching network-vif-plugged-e0003a9c-9202-4863-92aa-0fd29a026c8c {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:00:58 user nova-compute[74898]: WARNING nova.compute.manager [req-5df9169b-9e09-4818-8dcd-26f3660c45da req-94887578-f846-4cbc-8af5-a428a4e07fc8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received unexpected event network-vif-plugged-e0003a9c-9202-4863-92aa-0fd29a026c8c for instance with vm_state building and task_state spawning.
Nov 17 03:00:58 user nova-compute[74898]: DEBUG nova.compute.manager [req-5df9169b-9e09-4818-8dcd-26f3660c45da req-94887578-f846-4cbc-8af5-a428a4e07fc8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-plugged-7b0aade1-07ec-4744-b85c-d71ff8e10663 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5df9169b-9e09-4818-8dcd-26f3660c45da req-94887578-f846-4cbc-8af5-a428a4e07fc8 service nova] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5df9169b-9e09-4818-8dcd-26f3660c45da req-94887578-f846-4cbc-8af5-a428a4e07fc8 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5df9169b-9e09-4818-8dcd-26f3660c45da req-94887578-f846-4cbc-8af5-a428a4e07fc8 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:58 user nova-compute[74898]: DEBUG nova.compute.manager [req-5df9169b-9e09-4818-8dcd-26f3660c45da req-94887578-f846-4cbc-8af5-a428a4e07fc8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] No waiting events found dispatching network-vif-plugged-7b0aade1-07ec-4744-b85c-d71ff8e10663 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:00:58 user nova-compute[74898]: WARNING nova.compute.manager [req-5df9169b-9e09-4818-8dcd-26f3660c45da req-94887578-f846-4cbc-8af5-a428a4e07fc8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received unexpected event network-vif-plugged-7b0aade1-07ec-4744-b85c-d71ff8e10663 for instance with vm_state building and task_state spawning.
Nov 17 03:00:58 user nova-compute[74898]: DEBUG nova.compute.manager [req-5df9169b-9e09-4818-8dcd-26f3660c45da req-94887578-f846-4cbc-8af5-a428a4e07fc8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-plugged-7b0aade1-07ec-4744-b85c-d71ff8e10663 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5df9169b-9e09-4818-8dcd-26f3660c45da req-94887578-f846-4cbc-8af5-a428a4e07fc8 service nova] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5df9169b-9e09-4818-8dcd-26f3660c45da req-94887578-f846-4cbc-8af5-a428a4e07fc8 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5df9169b-9e09-4818-8dcd-26f3660c45da req-94887578-f846-4cbc-8af5-a428a4e07fc8 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:58 user nova-compute[74898]: DEBUG nova.compute.manager [req-5df9169b-9e09-4818-8dcd-26f3660c45da req-94887578-f846-4cbc-8af5-a428a4e07fc8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] No waiting events found dispatching network-vif-plugged-7b0aade1-07ec-4744-b85c-d71ff8e10663 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:00:58 user nova-compute[74898]: WARNING nova.compute.manager [req-5df9169b-9e09-4818-8dcd-26f3660c45da req-94887578-f846-4cbc-8af5-a428a4e07fc8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received unexpected event network-vif-plugged-7b0aade1-07ec-4744-b85c-d71ff8e10663 for instance with vm_state building and task_state spawning.
Nov 17 03:00:59 user nova-compute[74898]: DEBUG nova.compute.manager [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:00:59 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Instance spawned successfully.
Nov 17 03:00:59 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:00:59 user nova-compute[74898]: INFO nova.compute.manager [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Took 11.08 seconds to spawn the instance on the hypervisor.
Nov 17 03:00:59 user nova-compute[74898]: DEBUG nova.compute.manager [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:59 user nova-compute[74898]: INFO nova.compute.manager [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Took 34.45 seconds to build instance.
Nov 17 03:00:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6be6e29c-25f8-41e2-a0a9-4c6c15abc246 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "df13492d-d351-49c1-9755-7c30caae89f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.566s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-plugged-33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] No waiting events found dispatching network-vif-plugged-33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:00:59 user nova-compute[74898]: WARNING nova.compute.manager [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received unexpected event network-vif-plugged-33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5 for instance with vm_state active and task_state None.
Nov 17 03:00:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-plugged-c1a0a6a3-d445-4e76-b6ca-1183ae4b724f {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] No waiting events found dispatching network-vif-plugged-c1a0a6a3-d445-4e76-b6ca-1183ae4b724f {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:00:59 user nova-compute[74898]: WARNING nova.compute.manager [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received unexpected event network-vif-plugged-c1a0a6a3-d445-4e76-b6ca-1183ae4b724f for instance with vm_state active and task_state None.
Nov 17 03:00:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-plugged-c1a0a6a3-d445-4e76-b6ca-1183ae4b724f {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] No waiting events found dispatching network-vif-plugged-c1a0a6a3-d445-4e76-b6ca-1183ae4b724f {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:00:59 user nova-compute[74898]: WARNING nova.compute.manager [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received unexpected event network-vif-plugged-c1a0a6a3-d445-4e76-b6ca-1183ae4b724f for instance with vm_state active and task_state None.
Nov 17 03:00:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-plugged-e20d2c64-8b92-434c-84a4-d28453214349 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] No waiting events found dispatching network-vif-plugged-e20d2c64-8b92-434c-84a4-d28453214349 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:00:59 user nova-compute[74898]: WARNING nova.compute.manager [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received unexpected event network-vif-plugged-e20d2c64-8b92-434c-84a4-d28453214349 for instance with vm_state active and task_state None.
Nov 17 03:00:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-plugged-e20d2c64-8b92-434c-84a4-d28453214349 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] No waiting events found dispatching network-vif-plugged-e20d2c64-8b92-434c-84a4-d28453214349 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:00:59 user nova-compute[74898]: WARNING nova.compute.manager [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received unexpected event network-vif-plugged-e20d2c64-8b92-434c-84a4-d28453214349 for instance with vm_state active and task_state None.
Nov 17 03:00:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-plugged-207857d3-8c12-4e4f-b934-c69ed1f92961 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] No waiting events found dispatching network-vif-plugged-207857d3-8c12-4e4f-b934-c69ed1f92961 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:00:59 user nova-compute[74898]: WARNING nova.compute.manager [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received unexpected event network-vif-plugged-207857d3-8c12-4e4f-b934-c69ed1f92961 for instance with vm_state active and task_state None.
Nov 17 03:00:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-plugged-207857d3-8c12-4e4f-b934-c69ed1f92961 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] No waiting events found dispatching network-vif-plugged-207857d3-8c12-4e4f-b934-c69ed1f92961 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:00:59 user nova-compute[74898]: WARNING nova.compute.manager [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received unexpected event network-vif-plugged-207857d3-8c12-4e4f-b934-c69ed1f92961 for instance with vm_state active and task_state None.
Nov 17 03:00:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Received event network-vif-plugged-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] Acquiring lock "d1ee03a5-13fb-47e7-8712-ea31aed36643-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] Lock "d1ee03a5-13fb-47e7-8712-ea31aed36643-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] Lock "d1ee03a5-13fb-47e7-8712-ea31aed36643-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] No waiting events found dispatching network-vif-plugged-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:00:59 user nova-compute[74898]: WARNING nova.compute.manager [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Received unexpected event network-vif-plugged-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd for instance with vm_state building and task_state spawning.
Nov 17 03:00:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Received event network-vif-plugged-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] Acquiring lock "d1ee03a5-13fb-47e7-8712-ea31aed36643-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] Lock "d1ee03a5-13fb-47e7-8712-ea31aed36643-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] Lock "d1ee03a5-13fb-47e7-8712-ea31aed36643-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] No waiting events found dispatching network-vif-plugged-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:00:59 user nova-compute[74898]: WARNING nova.compute.manager [req-90be3b5a-a6b9-4f30-b94d-0aefb042250f req-4ba9eec5-c6ef-4b9b-a34f-8cf524680ae8 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Received unexpected event network-vif-plugged-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd for instance with vm_state building and task_state spawning.
Nov 17 03:00:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:00:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:01 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:01:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:01:01 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Instance spawned successfully.
Nov 17 03:01:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:01:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:01:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:01:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:01:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:01:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:01:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:01:01 user nova-compute[74898]: INFO nova.compute.manager [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Took 6.09 seconds to spawn the instance on the hypervisor.
Nov 17 03:01:01 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:01:01 user nova-compute[74898]: INFO nova.compute.manager [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Took 7.30 seconds to build instance.
Nov 17 03:01:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c028bda4-f2d2-42ff-84fb-fa68c18352e4 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "d1ee03a5-13fb-47e7-8712-ea31aed36643" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.400s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:01:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Acquiring lock "33dd1cff-39dc-4eba-ab39-c9239632cccc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:01:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lock "33dd1cff-39dc-4eba-ab39-c9239632cccc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:01:03 user nova-compute[74898]: DEBUG nova.objects.instance [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lazy-loading 'flavor' on Instance uuid 33dd1cff-39dc-4eba-ab39-c9239632cccc {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:01:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lock "33dd1cff-39dc-4eba-ab39-c9239632cccc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:01:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Acquiring lock "33dd1cff-39dc-4eba-ab39-c9239632cccc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:01:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lock "33dd1cff-39dc-4eba-ab39-c9239632cccc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:01:03 user nova-compute[74898]: INFO nova.compute.manager [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Attaching volume dcdf5475-666a-456a-b893-4fa4f9518c2c to /dev/vdb
Nov 17 03:01:03 user nova-compute[74898]: DEBUG os_brick.utils [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:01:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:03 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d1a9c6-5e70-49b9-8599-da7fab963afb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:03 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[722eb2e5-90ee-4b13-9c72-5721b592909a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:03 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5eef847-fc9a-479a-a047-d4f680530af0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:03 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe27e71-1bf3-4aec-b588-a86e08d319df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:01:03 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:01:04 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:04 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:01:04 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:01:04 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[71372581-959d-45cf-8311-7c5ff18f3664]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:04 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:01:04 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:01:04 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:01:04 user nova-compute[74898]: DEBUG os_brick.utils [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:01:04 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Updating existing volume attachment record: 4c651b54-8727-498d-8a43-4dae43a9ea98 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:01:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPvJpXaF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:01:09 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:01:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:01:09 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:01:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:01:09 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e604c8-ee0f-4751-ac23-94ffc73204bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:01:09 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7533e2-313f-4edf-a494-59a1e628deac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c] added
Nov 17 03:01:09 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f494fa9-9f6f-49a5-beae-49f5121dc7ea]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df45f64-933d-4ef0-8fab-41a77ed4173a]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QPvJpXaF {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QPvJpXaF" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a30a1a-72db-4760-94e2-e8eea53861b8]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QPvJpXaF'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[93439d55-14c0-46a1-8c2c-e84490425163]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f175a74-6731-4757-b884-37a39c9b9433]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:01:09 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:01:09 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:01:09 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:01:09 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:01:09 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:01:09 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[30be1a65-fb0f-42e6-89f1-bb1ba153fbc8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c, portal: 172.16.0.220,3260]
Nov 17 03:01:09 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c, portal: 172.16.0.220,3260] successful.
Nov 17 03:01:09 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f3d719-ab96-4114-8ede-08907a2e7505]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8687df53-03d7-4fae-b0ec-5ff16c0a1dbb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:01:09 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:01:09 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:01:09 user nova-compute[74898]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c (non-flash)
Nov 17 03:01:09 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:01:09 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:01:09 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:01:09 user nova-compute[74898]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c (non-flash)
Nov 17 03:01:09 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.030s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e725d3-dcc4-442e-84eb-7c32489f7dfa]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:01:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPvJpXaF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:01:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:01:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23735633266633436', 'path': '/dev/sde'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:01:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735633266633436', 'path': '/dev/sde'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:01:10 user nova-compute[74898]: DEBUG nova.objects.instance [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lazy-loading 'flavor' on Instance uuid 33dd1cff-39dc-4eba-ab39-c9239632cccc {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:01:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 03:01:10 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:01:10 user nova-compute[74898]:   <source dev="/dev/sde"/>
Nov 17 03:01:10 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:01:10 user nova-compute[74898]:   <serial>dcdf5475-666a-456a-b893-4fa4f9518c2c</serial>
Nov 17 03:01:10 user nova-compute[74898]: </disk>
Nov 17 03:01:10 user nova-compute[74898]:  {{(pid=74898) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 03:01:11 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:01:11 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:01:11 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] No VIF found with MAC fa:16:3e:f3:93:7f, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:01:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0f7ced1e-0a10-4fb3-b5d2-aa6e112f38ac tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lock "33dd1cff-39dc-4eba-ab39-c9239632cccc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.881s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:01:11 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:01:11 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:01:12 user nova-compute[74898]: INFO nova.compute.manager [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Rescuing
Nov 17 03:01:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "refresh_cache-e733574a-56ba-4e24-babd-855bcb5bda61" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:01:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquired lock "refresh_cache-e733574a-56ba-4e24-babd-855bcb5bda61" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:01:12 user nova-compute[74898]: DEBUG nova.network.neutron [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:01:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Acquiring lock "33dd1cff-39dc-4eba-ab39-c9239632cccc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:01:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lock "33dd1cff-39dc-4eba-ab39-c9239632cccc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:01:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Acquiring lock "33dd1cff-39dc-4eba-ab39-c9239632cccc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:01:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lock "33dd1cff-39dc-4eba-ab39-c9239632cccc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:01:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lock "33dd1cff-39dc-4eba-ab39-c9239632cccc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:01:12 user nova-compute[74898]: INFO nova.compute.manager [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Terminating instance
Nov 17 03:01:12 user nova-compute[74898]: DEBUG nova.compute.manager [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:01:12 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:01:12 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:01:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG nova.compute.manager [req-d6f255a2-d88d-461f-91f0-10bd4f36de8d req-fc946c35-6a2a-4aba-9caa-1cafa18d4ca7 service nova] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Received event network-vif-unplugged-f42f6852-a6ae-44cd-8ece-8d0d752c714c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d6f255a2-d88d-461f-91f0-10bd4f36de8d req-fc946c35-6a2a-4aba-9caa-1cafa18d4ca7 service nova] Acquiring lock "33dd1cff-39dc-4eba-ab39-c9239632cccc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d6f255a2-d88d-461f-91f0-10bd4f36de8d req-fc946c35-6a2a-4aba-9caa-1cafa18d4ca7 service nova] Lock "33dd1cff-39dc-4eba-ab39-c9239632cccc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d6f255a2-d88d-461f-91f0-10bd4f36de8d req-fc946c35-6a2a-4aba-9caa-1cafa18d4ca7 service nova] Lock "33dd1cff-39dc-4eba-ab39-c9239632cccc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG nova.compute.manager [req-d6f255a2-d88d-461f-91f0-10bd4f36de8d req-fc946c35-6a2a-4aba-9caa-1cafa18d4ca7 service nova] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] No waiting events found dispatching network-vif-unplugged-f42f6852-a6ae-44cd-8ece-8d0d752c714c {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG nova.compute.manager [req-d6f255a2-d88d-461f-91f0-10bd4f36de8d req-fc946c35-6a2a-4aba-9caa-1cafa18d4ca7 service nova] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Received event network-vif-unplugged-f42f6852-a6ae-44cd-8ece-8d0d752c714c for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG nova.network.neutron [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Updating instance_info_cache with network_info: [{"id": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "address": "fa:16:3e:8c:c0:06", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8bd92de-8e", "ovs_interfaceid": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Releasing lock "refresh_cache-e733574a-56ba-4e24-babd-855bcb5bda61" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:13 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Instance destroyed successfully.
Nov 17 03:01:13 user nova-compute[74898]: DEBUG nova.objects.instance [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lazy-loading 'resources' on Instance uuid 33dd1cff-39dc-4eba-ab39-c9239632cccc {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Updating instance_info_cache with network_info: [{"id": "78bdfbfa-3578-4ef5-b499-decd609cba62", "address": "fa:16:3e:b1:55:61", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78bdfbfa-35", "ovs_interfaceid": "78bdfbfa-3578-4ef5-b499-decd609cba62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:59:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1612996313',display_name='tempest-DeleteServersTestJSON-server-1612996313',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1612996313',id=1,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T02:59:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74586ad5235f439d8873accc42469cba',ramdisk_id='',reservation_id='r-4yd3k1dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1376179717',owner_user_name='tempest-DeleteServersTestJSON-1376179717-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T02:59:24Z,user_data=None,user_id='e0ef219cb36d4d68b589243315a4dc61',uuid=33dd1cff-39dc-4eba-ab39-c9239632cccc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f42f6852-a6ae-44cd-8ece-8d0d752c714c", "address": "fa:16:3e:f3:93:7f", "network": {"id": "b4d0cc21-8655-4c40-b432-138148a77dd1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1477483123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74586ad5235f439d8873accc42469cba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf42f6852-a6", "ovs_interfaceid": "f42f6852-a6ae-44cd-8ece-8d0d752c714c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Converting VIF {"id": "f42f6852-a6ae-44cd-8ece-8d0d752c714c", "address": "fa:16:3e:f3:93:7f", "network": {"id": "b4d0cc21-8655-4c40-b432-138148a77dd1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1477483123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74586ad5235f439d8873accc42469cba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf42f6852-a6", "ovs_interfaceid": "f42f6852-a6ae-44cd-8ece-8d0d752c714c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:93:7f,bridge_name='br-int',has_traffic_filtering=True,id=f42f6852-a6ae-44cd-8ece-8d0d752c714c,network=Network(b4d0cc21-8655-4c40-b432-138148a77dd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf42f6852-a6') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG os_vif [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:93:7f,bridge_name='br-int',has_traffic_filtering=True,id=f42f6852-a6ae-44cd-8ece-8d0d752c714c,network=Network(b4d0cc21-8655-4c40-b432-138148a77dd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf42f6852-a6') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf42f6852-a6, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eafaa5af-c83e-4b64-94dc-599ef3025455) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:01:13 user nova-compute[74898]: INFO os_vif [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:93:7f,bridge_name='br-int',has_traffic_filtering=True,id=f42f6852-a6ae-44cd-8ece-8d0d752c714c,network=Network(b4d0cc21-8655-4c40-b432-138148a77dd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf42f6852-a6')
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPvJpXaF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:01:13 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:01:13 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[76832fd8-f984-4201-a8d9-87a87f3baf01]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:01:13 user nova-compute[74898]: No targets found.
Nov 17 03:01:13 user nova-compute[74898]: iSNS:
Nov 17 03:01:13 user nova-compute[74898]: No targets found.
Nov 17 03:01:13 user nova-compute[74898]: STATIC:
Nov 17 03:01:13 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962
Nov 17 03:01:13 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:01:13 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:01:13 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1
Nov 17 03:01:13 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:01:13 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:01:13 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c
Nov 17 03:01:13 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:01:13 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:01:13 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd
Nov 17 03:01:13 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:01:13 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:01:13 user nova-compute[74898]: FIRMWARE:
Nov 17 03:01:13 user nova-compute[74898]: No targets found.
Nov 17 03:01:13 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:01:13 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:01:13 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c9bd8f-fc29-491d-8ee6-24dbf0ba1560]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d6c80f-d65e-46a1-99f8-f6069c36f01e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:01:13 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:01:13 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:01:13 user nova-compute[74898]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c (non-flash)
Nov 17 03:01:13 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:01:13 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:01:13 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:01:13 user nova-compute[74898]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c (non-flash)
Nov 17 03:01:13 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9c183276d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c'): ({'sde'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Removing single pathed devices sde {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0fabae-5a07-4800-8ded-aaffbc774509]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f042ae5-bd51-414e-b44c-1336ddf2059e]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Flushing IO for device /dev/sde {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[412f1a6e-b319-46f4-ac9f-a5e7729f2b16]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84f050c-8352-47fe-b428-e15ccbb0a0b5]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] SCSI volumes sde have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4afeed-96d4-4905-9d1a-de9cb92c6c65]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86c5a5e-3067-4514-9e70-f87d97315b3e]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c, portal: 172.16.0.220,3260]
Nov 17 03:01:14 user nova-compute[74898]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c, portal: 172.16.0.220,3260] successful.
Nov 17 03:01:14 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:14 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Instance destroyed successfully.
Nov 17 03:01:14 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Attempting rescue
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74898) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Instance directory exists: not creating {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 17 03:01:14 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Creating image(s)
Nov 17 03:01:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "/opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "/opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "/opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.objects.instance [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lazy-loading 'trusted_certs' on Instance uuid e733574a-56ba-4e24-babd-855bcb5bda61 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcdf5475-666a-456a-b893-4fa4f9518c2c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[003c84f9-dd87-48da-86e7-4a7e5b4e768c]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] <== disconnect_volume: return (375ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:01:14 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Deleting instance files /opt/stack/data/nova/instances/33dd1cff-39dc-4eba-ab39-c9239632cccc_del
Nov 17 03:01:14 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Deletion of /opt/stack/data/nova/instances/33dd1cff-39dc-4eba-ab39-c9239632cccc_del complete
Nov 17 03:01:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74898) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 17 03:01:14 user nova-compute[74898]: INFO nova.virt.libvirt.host [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] UEFI support detected
Nov 17 03:01:14 user nova-compute[74898]: INFO nova.compute.manager [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Took 1.47 seconds to destroy the instance on the hypervisor.
Nov 17 03:01:14 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.171s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue" returned: 0 in 0.051s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.objects.instance [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lazy-loading 'migration_context' on Instance uuid e733574a-56ba-4e24-babd-855bcb5bda61 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.objects.base [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Object Instance<e733574a-56ba-4e24-babd-855bcb5bda61> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Start _get_guest_xml network_info=[{"id": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "address": "fa:16:3e:8c:c0:06", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "vif_mac": "fa:16:3e:8c:c0:06"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8bd92de-8e", "ovs_interfaceid": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.objects.instance [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lazy-loading 'resources' on Instance uuid e733574a-56ba-4e24-babd-855bcb5bda61 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.objects.base [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Object Instance<e733574a-56ba-4e24-babd-855bcb5bda61> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.objects.instance [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lazy-loading 'numa_topology' on Instance uuid e733574a-56ba-4e24-babd-855bcb5bda61 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.objects.base [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Object Instance<e733574a-56ba-4e24-babd-855bcb5bda61> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:01:14 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:01:14 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.objects.instance [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lazy-loading 'vcpu_model' on Instance uuid e733574a-56ba-4e24-babd-855bcb5bda61 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.objects.base [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Object Instance<e733574a-56ba-4e24-babd-855bcb5bda61> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1355402387',display_name='tempest-ServerRescueNegativeTestJSON-server-1355402387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1355402387',id=3,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T02:59:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9ccd434df9e458f80e5524c5c4c7a1f',ramdisk_id='',reservation_id='r-pqa7cvtw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1788589536',owner_user_name='tempest-ServerRescueNegativeTestJSON-1788589536-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T02:59:40Z,user_data=None,user_id='303dca207b5f4da297e8ab1fc41ff466',uuid=e733574a-56ba-4e24-babd-855bcb5bda61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "address": "fa:16:3e:8c:c0:06", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "vif_mac": "fa:16:3e:8c:c0:06"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8bd92de-8e", "ovs_interfaceid": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Converting VIF {"id": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "address": "fa:16:3e:8c:c0:06", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "vif_mac": "fa:16:3e:8c:c0:06"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8bd92de-8e", "ovs_interfaceid": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:c0:06,bridge_name='br-int',has_traffic_filtering=True,id=f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75,network=Network(c153042b-16a0-4676-b024-f4583be62f74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8bd92de-8e') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.objects.instance [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lazy-loading 'pci_devices' on Instance uuid e733574a-56ba-4e24-babd-855bcb5bda61 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.objects.base [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Object Instance<e733574a-56ba-4e24-babd-855bcb5bda61> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:01:14 user nova-compute[74898]:   <uuid>e733574a-56ba-4e24-babd-855bcb5bda61</uuid>
Nov 17 03:01:14 user nova-compute[74898]:   <name>instance-00000003</name>
Nov 17 03:01:14 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:01:14 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:01:14 user nova-compute[74898]:   <metadata>
Nov 17 03:01:14 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:01:14 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:01:14 user nova-compute[74898]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1355402387</nova:name>
Nov 17 03:01:14 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:01:14</nova:creationTime>
Nov 17 03:01:14 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:01:14 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:01:14 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:01:14 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:01:14 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:01:14 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:01:14 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:01:14 user nova-compute[74898]:       <nova:owner>
Nov 17 03:01:14 user nova-compute[74898]:         <nova:user uuid="303dca207b5f4da297e8ab1fc41ff466">tempest-ServerRescueNegativeTestJSON-1788589536-project-member</nova:user>
Nov 17 03:01:14 user nova-compute[74898]:         <nova:project uuid="f9ccd434df9e458f80e5524c5c4c7a1f">tempest-ServerRescueNegativeTestJSON-1788589536</nova:project>
Nov 17 03:01:14 user nova-compute[74898]:       </nova:owner>
Nov 17 03:01:14 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:01:14 user nova-compute[74898]:       <nova:ports>
Nov 17 03:01:14 user nova-compute[74898]:         <nova:port uuid="f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75">
Nov 17 03:01:14 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 17 03:01:14 user nova-compute[74898]:         </nova:port>
Nov 17 03:01:14 user nova-compute[74898]:       </nova:ports>
Nov 17 03:01:14 user nova-compute[74898]:     </nova:instance>
Nov 17 03:01:14 user nova-compute[74898]:   </metadata>
Nov 17 03:01:14 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:01:14 user nova-compute[74898]:     <system>
Nov 17 03:01:14 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:01:14 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:01:14 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:01:14 user nova-compute[74898]:       <entry name="serial">e733574a-56ba-4e24-babd-855bcb5bda61</entry>
Nov 17 03:01:14 user nova-compute[74898]:       <entry name="uuid">e733574a-56ba-4e24-babd-855bcb5bda61</entry>
Nov 17 03:01:14 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:01:14 user nova-compute[74898]:     </system>
Nov 17 03:01:14 user nova-compute[74898]:   </sysinfo>
Nov 17 03:01:14 user nova-compute[74898]:   <os>
Nov 17 03:01:14 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:01:14 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:01:14 user nova-compute[74898]:   </os>
Nov 17 03:01:14 user nova-compute[74898]:   <features>
Nov 17 03:01:14 user nova-compute[74898]:     <acpi/>
Nov 17 03:01:14 user nova-compute[74898]:     <apic/>
Nov 17 03:01:14 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:01:14 user nova-compute[74898]:   </features>
Nov 17 03:01:14 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:01:14 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:01:14 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:01:14 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:01:14 user nova-compute[74898]:   </clock>
Nov 17 03:01:14 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:01:14 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:01:14 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:01:14 user nova-compute[74898]:   </cpu>
Nov 17 03:01:14 user nova-compute[74898]:   <devices>
Nov 17 03:01:14 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:01:14 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:01:14 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue"/>
Nov 17 03:01:14 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:01:14 user nova-compute[74898]:     </disk>
Nov 17 03:01:14 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:01:14 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:01:14 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk"/>
Nov 17 03:01:14 user nova-compute[74898]:       <target dev="vdb" bus="virtio"/>
Nov 17 03:01:14 user nova-compute[74898]:     </disk>
Nov 17 03:01:14 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:01:14 user nova-compute[74898]:       <mac address="fa:16:3e:8c:c0:06"/>
Nov 17 03:01:14 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:01:14 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:01:14 user nova-compute[74898]:       <target dev="tapf8bd92de-8e"/>
Nov 17 03:01:14 user nova-compute[74898]:     </interface>
Nov 17 03:01:14 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:01:14 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/console.log" append="off"/>
Nov 17 03:01:14 user nova-compute[74898]:     </serial>
Nov 17 03:01:14 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:01:14 user nova-compute[74898]:     <video>
Nov 17 03:01:14 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:01:14 user nova-compute[74898]:     </video>
Nov 17 03:01:14 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:01:14 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:01:14 user nova-compute[74898]:     </rng>
Nov 17 03:01:14 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:01:14 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:01:14 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:01:14 user nova-compute[74898]:     </memballoon>
Nov 17 03:01:14 user nova-compute[74898]:   </devices>
Nov 17 03:01:14 user nova-compute[74898]: </domain>
Nov 17 03:01:14 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:01:14 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Instance destroyed successfully.
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] No VIF found with MAC fa:16:3e:8c:c0:06, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:01:14 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Took 0.59 seconds to deallocate network for instance.
Nov 17 03:01:14 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.compute.manager [req-276415e7-2893-4865-87b6-619c97bcea74 req-26bdbb4a-bd09-4ebf-a5c5-81d88fd02716 service nova] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Received event network-vif-deleted-f42f6852-a6ae-44cd-8ece-8d0d752c714c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.compute.manager [req-7e9a3398-259d-4d7c-a8e9-8a0cbcc785a5 req-b80e4211-a914-4548-b27d-6707522c6098 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received event network-changed-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.compute.manager [req-7e9a3398-259d-4d7c-a8e9-8a0cbcc785a5 req-b80e4211-a914-4548-b27d-6707522c6098 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Refreshing instance network info cache due to event network-changed-7f2d1282-0400-4c1e-890d-46a51040a8b5. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7e9a3398-259d-4d7c-a8e9-8a0cbcc785a5 req-b80e4211-a914-4548-b27d-6707522c6098 service nova] Acquiring lock "refresh_cache-11704034-7afe-475c-ae43-1324b40f0d92" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7e9a3398-259d-4d7c-a8e9-8a0cbcc785a5 req-b80e4211-a914-4548-b27d-6707522c6098 service nova] Acquired lock "refresh_cache-11704034-7afe-475c-ae43-1324b40f0d92" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:01:14 user nova-compute[74898]: DEBUG nova.network.neutron [req-7e9a3398-259d-4d7c-a8e9-8a0cbcc785a5 req-b80e4211-a914-4548-b27d-6707522c6098 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Refreshing network info cache for port 7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:01:15 user nova-compute[74898]: DEBUG nova.compute.manager [req-c2d528ec-1472-4cee-bc14-8d480174dcff req-2db693ff-6ee5-4da3-9532-c27290160280 service nova] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Received event network-vif-plugged-f42f6852-a6ae-44cd-8ece-8d0d752c714c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:01:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c2d528ec-1472-4cee-bc14-8d480174dcff req-2db693ff-6ee5-4da3-9532-c27290160280 service nova] Acquiring lock "33dd1cff-39dc-4eba-ab39-c9239632cccc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:01:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c2d528ec-1472-4cee-bc14-8d480174dcff req-2db693ff-6ee5-4da3-9532-c27290160280 service nova] Lock "33dd1cff-39dc-4eba-ab39-c9239632cccc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:01:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c2d528ec-1472-4cee-bc14-8d480174dcff req-2db693ff-6ee5-4da3-9532-c27290160280 service nova] Lock "33dd1cff-39dc-4eba-ab39-c9239632cccc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:01:15 user nova-compute[74898]: DEBUG nova.compute.manager [req-c2d528ec-1472-4cee-bc14-8d480174dcff req-2db693ff-6ee5-4da3-9532-c27290160280 service nova] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] No waiting events found dispatching network-vif-plugged-f42f6852-a6ae-44cd-8ece-8d0d752c714c {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:01:15 user nova-compute[74898]: WARNING nova.compute.manager [req-c2d528ec-1472-4cee-bc14-8d480174dcff req-2db693ff-6ee5-4da3-9532-c27290160280 service nova] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Received unexpected event network-vif-plugged-f42f6852-a6ae-44cd-8ece-8d0d752c714c for instance with vm_state active and task_state deleting.
Nov 17 03:01:15 user nova-compute[74898]: DEBUG nova.compute.manager [req-c2d528ec-1472-4cee-bc14-8d480174dcff req-2db693ff-6ee5-4da3-9532-c27290160280 service nova] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Received event network-vif-unplugged-f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:01:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c2d528ec-1472-4cee-bc14-8d480174dcff req-2db693ff-6ee5-4da3-9532-c27290160280 service nova] Acquiring lock "e733574a-56ba-4e24-babd-855bcb5bda61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:01:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c2d528ec-1472-4cee-bc14-8d480174dcff req-2db693ff-6ee5-4da3-9532-c27290160280 service nova] Lock "e733574a-56ba-4e24-babd-855bcb5bda61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:01:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c2d528ec-1472-4cee-bc14-8d480174dcff req-2db693ff-6ee5-4da3-9532-c27290160280 service nova] Lock "e733574a-56ba-4e24-babd-855bcb5bda61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:01:15 user nova-compute[74898]: DEBUG nova.compute.manager [req-c2d528ec-1472-4cee-bc14-8d480174dcff req-2db693ff-6ee5-4da3-9532-c27290160280 service nova] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] No waiting events found dispatching network-vif-unplugged-f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:01:15 user nova-compute[74898]: WARNING nova.compute.manager [req-c2d528ec-1472-4cee-bc14-8d480174dcff req-2db693ff-6ee5-4da3-9532-c27290160280 service nova] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Received unexpected event network-vif-unplugged-f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75 for instance with vm_state active and task_state rescuing.
Nov 17 03:01:15 user nova-compute[74898]: DEBUG nova.compute.manager [req-c2d528ec-1472-4cee-bc14-8d480174dcff req-2db693ff-6ee5-4da3-9532-c27290160280 service nova] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Received event network-vif-plugged-f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:01:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c2d528ec-1472-4cee-bc14-8d480174dcff req-2db693ff-6ee5-4da3-9532-c27290160280 service nova] Acquiring lock "e733574a-56ba-4e24-babd-855bcb5bda61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:01:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c2d528ec-1472-4cee-bc14-8d480174dcff req-2db693ff-6ee5-4da3-9532-c27290160280 service nova] Lock "e733574a-56ba-4e24-babd-855bcb5bda61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:01:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c2d528ec-1472-4cee-bc14-8d480174dcff req-2db693ff-6ee5-4da3-9532-c27290160280 service nova] Lock "e733574a-56ba-4e24-babd-855bcb5bda61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:01:15 user nova-compute[74898]: DEBUG nova.compute.manager [req-c2d528ec-1472-4cee-bc14-8d480174dcff req-2db693ff-6ee5-4da3-9532-c27290160280 service nova] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] No waiting events found dispatching network-vif-plugged-f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:01:15 user nova-compute[74898]: WARNING nova.compute.manager [req-c2d528ec-1472-4cee-bc14-8d480174dcff req-2db693ff-6ee5-4da3-9532-c27290160280 service nova] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Received unexpected event network-vif-plugged-f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75 for instance with vm_state active and task_state rescuing.
Nov 17 03:01:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:15 user nova-compute[74898]: DEBUG nova.network.neutron [req-7e9a3398-259d-4d7c-a8e9-8a0cbcc785a5 req-b80e4211-a914-4548-b27d-6707522c6098 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Updated VIF entry in instance network info cache for port 7f2d1282-0400-4c1e-890d-46a51040a8b5. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:01:15 user nova-compute[74898]: DEBUG nova.network.neutron [req-7e9a3398-259d-4d7c-a8e9-8a0cbcc785a5 req-b80e4211-a914-4548-b27d-6707522c6098 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Updating instance_info_cache with network_info: [{"id": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "address": "fa:16:3e:98:61:d2", "network": {"id": "ff76f13f-ae63-4dd0-a219-894c6ae65c00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1502020482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b79304b161b748c4b105640273979318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d1282-04", "ovs_interfaceid": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:01:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7e9a3398-259d-4d7c-a8e9-8a0cbcc785a5 req-b80e4211-a914-4548-b27d-6707522c6098 service nova] Releasing lock "refresh_cache-11704034-7afe-475c-ae43-1324b40f0d92" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:01:15 user nova-compute[74898]: INFO nova.compute.manager [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] [instance: 33dd1cff-39dc-4eba-ab39-c9239632cccc] Took 1.08 seconds to detach 1 volumes for instance.
Nov 17 03:01:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:01:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:01:16 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:16 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:16 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:16 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:16 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:16 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:16 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:16 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:01:16 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:01:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.462s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:01:16 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Deleted allocations for instance 33dd1cff-39dc-4eba-ab39-c9239632cccc
Nov 17 03:01:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8593297f-86f2-464c-8620-8fb8532bc27c tempest-DeleteServersTestJSON-1376179717 tempest-DeleteServersTestJSON-1376179717-project-member] Lock "33dd1cff-39dc-4eba-ab39-c9239632cccc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.908s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:01:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:17 user nova-compute[74898]: DEBUG nova.compute.manager [req-803e043f-a301-4b7e-ba18-ff70f6e37075 req-fbb1d4d1-3a6b-4cac-83cf-c33dc8835546 service nova] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Received event network-vif-plugged-f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:01:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-803e043f-a301-4b7e-ba18-ff70f6e37075 req-fbb1d4d1-3a6b-4cac-83cf-c33dc8835546 service nova] Acquiring lock "e733574a-56ba-4e24-babd-855bcb5bda61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:01:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-803e043f-a301-4b7e-ba18-ff70f6e37075 req-fbb1d4d1-3a6b-4cac-83cf-c33dc8835546 service nova] Lock "e733574a-56ba-4e24-babd-855bcb5bda61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:01:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-803e043f-a301-4b7e-ba18-ff70f6e37075 req-fbb1d4d1-3a6b-4cac-83cf-c33dc8835546 service nova] Lock "e733574a-56ba-4e24-babd-855bcb5bda61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:01:17 user nova-compute[74898]: DEBUG nova.compute.manager [req-803e043f-a301-4b7e-ba18-ff70f6e37075 req-fbb1d4d1-3a6b-4cac-83cf-c33dc8835546 service nova] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] No waiting events found dispatching network-vif-plugged-f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:01:17 user nova-compute[74898]: WARNING nova.compute.manager [req-803e043f-a301-4b7e-ba18-ff70f6e37075 req-fbb1d4d1-3a6b-4cac-83cf-c33dc8835546 service nova] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Received unexpected event network-vif-plugged-f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75 for instance with vm_state active and task_state rescuing.
Nov 17 03:01:17 user nova-compute[74898]: DEBUG nova.compute.manager [req-803e043f-a301-4b7e-ba18-ff70f6e37075 req-fbb1d4d1-3a6b-4cac-83cf-c33dc8835546 service nova] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Received event network-vif-plugged-f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:01:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-803e043f-a301-4b7e-ba18-ff70f6e37075 req-fbb1d4d1-3a6b-4cac-83cf-c33dc8835546 service nova] Acquiring lock "e733574a-56ba-4e24-babd-855bcb5bda61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:01:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-803e043f-a301-4b7e-ba18-ff70f6e37075 req-fbb1d4d1-3a6b-4cac-83cf-c33dc8835546 service nova] Lock "e733574a-56ba-4e24-babd-855bcb5bda61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:01:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-803e043f-a301-4b7e-ba18-ff70f6e37075 req-fbb1d4d1-3a6b-4cac-83cf-c33dc8835546 service nova] Lock "e733574a-56ba-4e24-babd-855bcb5bda61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:01:17 user nova-compute[74898]: DEBUG nova.compute.manager [req-803e043f-a301-4b7e-ba18-ff70f6e37075 req-fbb1d4d1-3a6b-4cac-83cf-c33dc8835546 service nova] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] No waiting events found dispatching network-vif-plugged-f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:01:17 user nova-compute[74898]: WARNING nova.compute.manager [req-803e043f-a301-4b7e-ba18-ff70f6e37075 req-fbb1d4d1-3a6b-4cac-83cf-c33dc8835546 service nova] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Received unexpected event network-vif-plugged-f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75 for instance with vm_state active and task_state rescuing.
Nov 17 03:01:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b869a55-acf6-4550-9354-2480273a4ee2/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b869a55-acf6-4550-9354-2480273a4ee2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b869a55-acf6-4550-9354-2480273a4ee2/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b869a55-acf6-4550-9354-2480273a4ee2/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:01:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:01:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:01:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5885526-e2d0-41d4-8da1-b3440d243a19/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5885526-e2d0-41d4-8da1-b3440d243a19/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5885526-e2d0-41d4-8da1-b3440d243a19/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5885526-e2d0-41d4-8da1-b3440d243a19/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:18 user nova-compute[74898]: DEBUG nova.compute.manager [None req-d8708b69-3a03-4c05-9cf4-507891c9cc14 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:01:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:19 user nova-compute[74898]: DEBUG nova.compute.manager [req-4f1ca1aa-52bd-4605-bd19-e66c65939e74 req-1365d767-076d-4022-871a-524131ef32f8 service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Received event network-changed-9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:01:19 user nova-compute[74898]: DEBUG nova.compute.manager [req-4f1ca1aa-52bd-4605-bd19-e66c65939e74 req-1365d767-076d-4022-871a-524131ef32f8 service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Refreshing instance network info cache due to event network-changed-9d80c52a-1fc2-43ca-bed1-126c6b8e204f. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:01:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4f1ca1aa-52bd-4605-bd19-e66c65939e74 req-1365d767-076d-4022-871a-524131ef32f8 service nova] Acquiring lock "refresh_cache-015ff42a-4d69-4f60-b86c-c6bd68d23c99" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:01:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4f1ca1aa-52bd-4605-bd19-e66c65939e74 req-1365d767-076d-4022-871a-524131ef32f8 service nova] Acquired lock "refresh_cache-015ff42a-4d69-4f60-b86c-c6bd68d23c99" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:01:19 user nova-compute[74898]: DEBUG nova.network.neutron [req-4f1ca1aa-52bd-4605-bd19-e66c65939e74 req-1365d767-076d-4022-871a-524131ef32f8 service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Refreshing network info cache for port 9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:01:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c6c8ae-ef3d-428b-a6d5-1683eba214d9/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c6c8ae-ef3d-428b-a6d5-1683eba214d9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c6c8ae-ef3d-428b-a6d5-1683eba214d9/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20c6c8ae-ef3d-428b-a6d5-1683eba214d9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:19 user nova-compute[74898]: DEBUG nova.network.neutron [req-4f1ca1aa-52bd-4605-bd19-e66c65939e74 req-1365d767-076d-4022-871a-524131ef32f8 service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Updated VIF entry in instance network info cache for port 9d80c52a-1fc2-43ca-bed1-126c6b8e204f. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:01:19 user nova-compute[74898]: DEBUG nova.network.neutron [req-4f1ca1aa-52bd-4605-bd19-e66c65939e74 req-1365d767-076d-4022-871a-524131ef32f8 service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Updating instance_info_cache with network_info: [{"id": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "address": "fa:16:3e:88:21:6c", "network": {"id": "bf964a06-b5fd-41c4-9dfe-5d485019bbdd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-848964430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74014d7708574848bee4da7056ab1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d80c52a-1f", "ovs_interfaceid": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:01:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4f1ca1aa-52bd-4605-bd19-e66c65939e74 req-1365d767-076d-4022-871a-524131ef32f8 service nova] Releasing lock "refresh_cache-015ff42a-4d69-4f60-b86c-c6bd68d23c99" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:01:20 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e43e2082-0c46-48f2-b296-2ea72344a37a tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:01:20 user nova-compute[74898]: INFO nova.compute.manager [None req-e43e2082-0c46-48f2-b296-2ea72344a37a tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] instance snapshotting
Nov 17 03:01:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:20 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-e43e2082-0c46-48f2-b296-2ea72344a37a tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Beginning live snapshot process
Nov 17 03:01:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e43e2082-0c46-48f2-b296-2ea72344a37a tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json -f qcow2 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e43e2082-0c46-48f2-b296-2ea72344a37a tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e43e2082-0c46-48f2-b296-2ea72344a37a tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json -f qcow2 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e43e2082-0c46-48f2-b296-2ea72344a37a tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e43e2082-0c46-48f2-b296-2ea72344a37a tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e43e2082-0c46-48f2-b296-2ea72344a37a tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.203s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e43e2082-0c46-48f2-b296-2ea72344a37a tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp3r7yl0cx/847816f067214d8382bc0d34db1337d1.delta 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e43e2082-0c46-48f2-b296-2ea72344a37a tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp3r7yl0cx/847816f067214d8382bc0d34db1337d1.delta 1073741824" returned: 0 in 0.046s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:21 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-e43e2082-0c46-48f2-b296-2ea72344a37a tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 17 03:01:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-e43e2082-0c46-48f2-b296-2ea72344a37a tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74898) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 03:01:22 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:01:22 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:01:22 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=6913MB free_disk=25.598148345947266GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:01:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:01:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:01:22 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-e43e2082-0c46-48f2-b296-2ea72344a37a tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 17 03:01:22 user nova-compute[74898]: DEBUG nova.privsep.utils [None req-e43e2082-0c46-48f2-b296-2ea72344a37a tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74898) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 03:01:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e43e2082-0c46-48f2-b296-2ea72344a37a tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp3r7yl0cx/847816f067214d8382bc0d34db1337d1.delta /opt/stack/data/nova/instances/snapshots/tmp3r7yl0cx/847816f067214d8382bc0d34db1337d1 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:22 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:01:22 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance e733574a-56ba-4e24-babd-855bcb5bda61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:01:22 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 11704034-7afe-475c-ae43-1324b40f0d92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:01:22 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 015ff42a-4d69-4f60-b86c-c6bd68d23c99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:01:22 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:01:22 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance b886ada4-5bcb-4b2a-b69e-80edefdd2119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:01:22 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 20c6c8ae-ef3d-428b-a6d5-1683eba214d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:01:22 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance e5885526-e2d0-41d4-8da1-b3440d243a19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:01:22 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance df13492d-d351-49c1-9755-7c30caae89f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:01:22 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 4b869a55-acf6-4550-9354-2480273a4ee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:01:22 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance d1ee03a5-13fb-47e7-8712-ea31aed36643 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:01:22 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:01:22 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:01:23 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:01:23 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:01:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e43e2082-0c46-48f2-b296-2ea72344a37a tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp3r7yl0cx/847816f067214d8382bc0d34db1337d1.delta /opt/stack/data/nova/instances/snapshots/tmp3r7yl0cx/847816f067214d8382bc0d34db1337d1" returned: 0 in 0.436s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:23 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-e43e2082-0c46-48f2-b296-2ea72344a37a tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Snapshot extracted, beginning image upload
Nov 17 03:01:23 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:01:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.580s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:01:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:25 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:01:25 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:01:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:26 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-e43e2082-0c46-48f2-b296-2ea72344a37a tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Snapshot image upload complete
Nov 17 03:01:26 user nova-compute[74898]: INFO nova.compute.manager [None req-e43e2082-0c46-48f2-b296-2ea72344a37a tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Took 6.09 seconds to snapshot the instance on the hypervisor.
Nov 17 03:01:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:30 user nova-compute[74898]: DEBUG nova.compute.manager [req-0ead5dc6-25c7-40e1-8dd6-fed7042428fd req-30dd953e-c8b0-4c37-83f8-b6b745de42ae service nova] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Received event network-changed-ba899c72-f082-46fe-9a32-b548a4d653e2 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:01:30 user nova-compute[74898]: DEBUG nova.compute.manager [req-0ead5dc6-25c7-40e1-8dd6-fed7042428fd req-30dd953e-c8b0-4c37-83f8-b6b745de42ae service nova] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Refreshing instance network info cache due to event network-changed-ba899c72-f082-46fe-9a32-b548a4d653e2. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:01:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0ead5dc6-25c7-40e1-8dd6-fed7042428fd req-30dd953e-c8b0-4c37-83f8-b6b745de42ae service nova] Acquiring lock "refresh_cache-9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:01:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0ead5dc6-25c7-40e1-8dd6-fed7042428fd req-30dd953e-c8b0-4c37-83f8-b6b745de42ae service nova] Acquired lock "refresh_cache-9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:01:30 user nova-compute[74898]: DEBUG nova.network.neutron [req-0ead5dc6-25c7-40e1-8dd6-fed7042428fd req-30dd953e-c8b0-4c37-83f8-b6b745de42ae service nova] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Refreshing network info cache for port ba899c72-f082-46fe-9a32-b548a4d653e2 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:01:30 user nova-compute[74898]: DEBUG nova.network.neutron [req-0ead5dc6-25c7-40e1-8dd6-fed7042428fd req-30dd953e-c8b0-4c37-83f8-b6b745de42ae service nova] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Updated VIF entry in instance network info cache for port ba899c72-f082-46fe-9a32-b548a4d653e2. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:01:30 user nova-compute[74898]: DEBUG nova.network.neutron [req-0ead5dc6-25c7-40e1-8dd6-fed7042428fd req-30dd953e-c8b0-4c37-83f8-b6b745de42ae service nova] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Updating instance_info_cache with network_info: [{"id": "ba899c72-f082-46fe-9a32-b548a4d653e2", "address": "fa:16:3e:95:22:a1", "network": {"id": "7ed585ab-8901-4ced-a881-2dd15371baa7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-738644687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d29dfc5e055942b4af680a17e5b1de13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba899c72-f0", "ovs_interfaceid": "ba899c72-f082-46fe-9a32-b548a4d653e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:01:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0ead5dc6-25c7-40e1-8dd6-fed7042428fd req-30dd953e-c8b0-4c37-83f8-b6b745de42ae service nova] Releasing lock "refresh_cache-9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Acquiring lock "9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG nova.objects.instance [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lazy-loading 'flavor' on Instance uuid 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG nova.compute.manager [req-2c449a33-9578-4d97-9d97-18cb1174c48a req-51e252b1-1717-4467-8ebf-c54a5ebd416d service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Received event network-changed-bd3b73ca-0068-42f4-8cf3-f84932dee960 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG nova.compute.manager [req-2c449a33-9578-4d97-9d97-18cb1174c48a req-51e252b1-1717-4467-8ebf-c54a5ebd416d service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Refreshing instance network info cache due to event network-changed-bd3b73ca-0068-42f4-8cf3-f84932dee960. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-2c449a33-9578-4d97-9d97-18cb1174c48a req-51e252b1-1717-4467-8ebf-c54a5ebd416d service nova] Acquiring lock "refresh_cache-b886ada4-5bcb-4b2a-b69e-80edefdd2119" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-2c449a33-9578-4d97-9d97-18cb1174c48a req-51e252b1-1717-4467-8ebf-c54a5ebd416d service nova] Acquired lock "refresh_cache-b886ada4-5bcb-4b2a-b69e-80edefdd2119" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG nova.network.neutron [req-2c449a33-9578-4d97-9d97-18cb1174c48a req-51e252b1-1717-4467-8ebf-c54a5ebd416d service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Refreshing network info cache for port bd3b73ca-0068-42f4-8cf3-f84932dee960 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Acquiring lock "9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:01:33 user nova-compute[74898]: INFO nova.compute.manager [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Attaching volume e6f1aa5a-a845-491c-b71f-07e1817a6460 to /dev/vdb
Nov 17 03:01:33 user nova-compute[74898]: DEBUG os_brick.utils [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cbf8d5-43ef-4b70-9700-b64981191246]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbd0ede-aef9-43df-9eae-b4dfbe43c76e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6700c9b-b156-4cb1-b998-beec52061f1e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99a4056-8efc-4e96-998c-2d845b408535]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:01:33 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:01:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3a5a39-3366-4e9b-aa1a-5221b02c7f48]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG os_brick.utils [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Updating existing volume attachment record: 5f17d7df-aaec-43f9-98e2-b76bff82b650 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4caae7b9-10ed-42b3-9260-e323023c113e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Acquiring lock "interface-b886ada4-5bcb-4b2a-b69e-80edefdd2119-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4caae7b9-10ed-42b3-9260-e323023c113e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "interface-b886ada4-5bcb-4b2a-b69e-80edefdd2119-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG nova.objects.instance [None req-4caae7b9-10ed-42b3-9260-e323023c113e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lazy-loading 'flavor' on Instance uuid b886ada4-5bcb-4b2a-b69e-80edefdd2119 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG nova.network.neutron [req-2c449a33-9578-4d97-9d97-18cb1174c48a req-51e252b1-1717-4467-8ebf-c54a5ebd416d service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Updated VIF entry in instance network info cache for port bd3b73ca-0068-42f4-8cf3-f84932dee960. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG nova.network.neutron [req-2c449a33-9578-4d97-9d97-18cb1174c48a req-51e252b1-1717-4467-8ebf-c54a5ebd416d service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Updating instance_info_cache with network_info: [{"id": "bd3b73ca-0068-42f4-8cf3-f84932dee960", "address": "fa:16:3e:2d:e6:07", "network": {"id": "a432562d-92fd-4786-944f-3a082f5146e8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1288851087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c45541cf5bd44c2a34d5a31f04e2a2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3b73ca-00", "ovs_interfaceid": "bd3b73ca-0068-42f4-8cf3-f84932dee960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:01:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-2c449a33-9578-4d97-9d97-18cb1174c48a req-51e252b1-1717-4467-8ebf-c54a5ebd416d service nova] Releasing lock "refresh_cache-b886ada4-5bcb-4b2a-b69e-80edefdd2119" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:01:34 user nova-compute[74898]: DEBUG nova.objects.instance [None req-4caae7b9-10ed-42b3-9260-e323023c113e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lazy-loading 'pci_requests' on Instance uuid b886ada4-5bcb-4b2a-b69e-80edefdd2119 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:01:34 user nova-compute[74898]: DEBUG nova.objects.base [None req-4caae7b9-10ed-42b3-9260-e323023c113e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Object Instance<b886ada4-5bcb-4b2a-b69e-80edefdd2119> lazy-loaded attributes: flavor,pci_requests {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:01:34 user nova-compute[74898]: DEBUG nova.network.neutron [None req-4caae7b9-10ed-42b3-9260-e323023c113e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:01:34 user nova-compute[74898]: DEBUG nova.policy [None req-4caae7b9-10ed-42b3-9260-e323023c113e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f7c4ed2ec81a411c95b2be4dcfb9859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c45541cf5bd44c2a34d5a31f04e2a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:01:34 user nova-compute[74898]: DEBUG nova.network.neutron [None req-4caae7b9-10ed-42b3-9260-e323023c113e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Successfully created port: 91e750ca-9d66-4a01-927f-43eace319a06 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:01:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:35 user nova-compute[74898]: DEBUG nova.network.neutron [None req-4caae7b9-10ed-42b3-9260-e323023c113e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Successfully updated port: 91e750ca-9d66-4a01-927f-43eace319a06 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:01:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4caae7b9-10ed-42b3-9260-e323023c113e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Acquiring lock "refresh_cache-b886ada4-5bcb-4b2a-b69e-80edefdd2119" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:01:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4caae7b9-10ed-42b3-9260-e323023c113e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Acquired lock "refresh_cache-b886ada4-5bcb-4b2a-b69e-80edefdd2119" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:01:35 user nova-compute[74898]: DEBUG nova.network.neutron [None req-4caae7b9-10ed-42b3-9260-e323023c113e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:01:35 user nova-compute[74898]: DEBUG nova.compute.manager [req-1bd5e6b5-f297-4677-9c9f-20612946d0c8 req-1b6591df-ad03-441c-8633-c568fbc44aee service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Received event network-changed-91e750ca-9d66-4a01-927f-43eace319a06 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:01:35 user nova-compute[74898]: DEBUG nova.compute.manager [req-1bd5e6b5-f297-4677-9c9f-20612946d0c8 req-1b6591df-ad03-441c-8633-c568fbc44aee service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Refreshing instance network info cache due to event network-changed-91e750ca-9d66-4a01-927f-43eace319a06. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:01:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1bd5e6b5-f297-4677-9c9f-20612946d0c8 req-1b6591df-ad03-441c-8633-c568fbc44aee service nova] Acquiring lock "refresh_cache-b886ada4-5bcb-4b2a-b69e-80edefdd2119" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG nova.network.neutron [None req-4caae7b9-10ed-42b3-9260-e323023c113e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Updating instance_info_cache with network_info: [{"id": "bd3b73ca-0068-42f4-8cf3-f84932dee960", "address": "fa:16:3e:2d:e6:07", "network": {"id": "a432562d-92fd-4786-944f-3a082f5146e8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1288851087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c45541cf5bd44c2a34d5a31f04e2a2a", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3b73ca-00", "ovs_interfaceid": "bd3b73ca-0068-42f4-8cf3-f84932dee960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "91e750ca-9d66-4a01-927f-43eace319a06", "address": "fa:16:3e:31:0f:fd", "network": {"id": "c40bf74e-2312-450f-ae66-15e481af3230", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1183652464", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8c45541cf5bd44c2a34d5a31f04e2a2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e750ca-9d", "ovs_interfaceid": "91e750ca-9d66-4a01-927f-43eace319a06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4caae7b9-10ed-42b3-9260-e323023c113e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Releasing lock "refresh_cache-b886ada4-5bcb-4b2a-b69e-80edefdd2119" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1bd5e6b5-f297-4677-9c9f-20612946d0c8 req-1b6591df-ad03-441c-8633-c568fbc44aee service nova] Acquired lock "refresh_cache-b886ada4-5bcb-4b2a-b69e-80edefdd2119" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG nova.network.neutron [req-1bd5e6b5-f297-4677-9c9f-20612946d0c8 req-1b6591df-ad03-441c-8633-c568fbc44aee service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Refreshing network info cache for port 91e750ca-9d66-4a01-927f-43eace319a06 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-4caae7b9-10ed-42b3-9260-e323023c113e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T02:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1059772796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1059772796',id=7,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbRzMswcys+QI6rLi6X0vGsy7XfMvLPPyHl7k0Ny6Kbzn4mYAR49YTYPPYUhsJ7Wj7VjaU+vGFbOCukOTayflDVlC4cnZKPAPKbqPCeENy+82k6vfJ0ZQpQ1EY3m67/9g==',key_name='tempest-keypair-1533313292',keypairs=<?>,launch_index=0,launched_at=2023-11-17T02:59:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8c45541cf5bd44c2a34d5a31f04e2a2a',ramdisk_id='',reservation_id='r-ftctsg18',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1966129795',owner_user_name='tempest-TaggedAttachmentsTest-1966129795-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T02:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7c4ed2ec81a411c95b2be4dcfb9859d',uuid=b886ada4-5bcb-4b2a-b69e-80edefdd2119,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91e750ca-9d66-4a01-927f-43eace319a06", "address": "fa:16:3e:31:0f:fd", "network": {"id": "c40bf74e-2312-450f-ae66-15e481af3230", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1183652464", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8c45541cf5bd44c2a34d5a31f04e2a2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e750ca-9d", "ovs_interfaceid": "91e750ca-9d66-4a01-927f-43eace319a06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-4caae7b9-10ed-42b3-9260-e323023c113e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Converting VIF {"id": "91e750ca-9d66-4a01-927f-43eace319a06", "address": "fa:16:3e:31:0f:fd", "network": {"id": "c40bf74e-2312-450f-ae66-15e481af3230", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1183652464", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8c45541cf5bd44c2a34d5a31f04e2a2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e750ca-9d", "ovs_interfaceid": "91e750ca-9d66-4a01-927f-43eace319a06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-4caae7b9-10ed-42b3-9260-e323023c113e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:0f:fd,bridge_name='br-int',has_traffic_filtering=True,id=91e750ca-9d66-4a01-927f-43eace319a06,network=Network(c40bf74e-2312-450f-ae66-15e481af3230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e750ca-9d') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG os_vif [None req-4caae7b9-10ed-42b3-9260-e323023c113e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:0f:fd,bridge_name='br-int',has_traffic_filtering=True,id=91e750ca-9d66-4a01-927f-43eace319a06,network=Network(c40bf74e-2312-450f-ae66-15e481af3230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e750ca-9d') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c03fa427-b733-59fc-b06d-a41394dac164', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91e750ca-9d, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap91e750ca-9d, col_values=(('qos', UUID('17040311-fe26-44d4-9b22-84c0985662ef')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap91e750ca-9d, col_values=(('external_ids', {'iface-id': '91e750ca-9d66-4a01-927f-43eace319a06', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:0f:fd', 'vm-uuid': 'b886ada4-5bcb-4b2a-b69e-80edefdd2119'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:36 user nova-compute[74898]: INFO os_vif [None req-4caae7b9-10ed-42b3-9260-e323023c113e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:0f:fd,bridge_name='br-int',has_traffic_filtering=True,id=91e750ca-9d66-4a01-927f-43eace319a06,network=Network(c40bf74e-2312-450f-ae66-15e481af3230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e750ca-9d')
Nov 17 03:01:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-4caae7b9-10ed-42b3-9260-e323023c113e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T02:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1059772796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1059772796',id=7,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbRzMswcys+QI6rLi6X0vGsy7XfMvLPPyHl7k0Ny6Kbzn4mYAR49YTYPPYUhsJ7Wj7VjaU+vGFbOCukOTayflDVlC4cnZKPAPKbqPCeENy+82k6vfJ0ZQpQ1EY3m67/9g==',key_name='tempest-keypair-1533313292',keypairs=<?>,launch_index=0,launched_at=2023-11-17T02:59:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8c45541cf5bd44c2a34d5a31f04e2a2a',ramdisk_id='',reservation_id='r-ftctsg18',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1966129795',owner_user_name='tempest-TaggedAttachmentsTest-1966129795-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T02:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7c4ed2ec81a411c95b2be4dcfb9859d',uuid=b886ada4-5bcb-4b2a-b69e-80edefdd2119,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91e750ca-9d66-4a01-927f-43eace319a06", "address": "fa:16:3e:31:0f:fd", "network": {"id": "c40bf74e-2312-450f-ae66-15e481af3230", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1183652464", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8c45541cf5bd44c2a34d5a31f04e2a2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e750ca-9d", "ovs_interfaceid": "91e750ca-9d66-4a01-927f-43eace319a06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-4caae7b9-10ed-42b3-9260-e323023c113e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Converting VIF {"id": "91e750ca-9d66-4a01-927f-43eace319a06", "address": "fa:16:3e:31:0f:fd", "network": {"id": "c40bf74e-2312-450f-ae66-15e481af3230", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1183652464", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8c45541cf5bd44c2a34d5a31f04e2a2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e750ca-9d", "ovs_interfaceid": "91e750ca-9d66-4a01-927f-43eace319a06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-4caae7b9-10ed-42b3-9260-e323023c113e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:0f:fd,bridge_name='br-int',has_traffic_filtering=True,id=91e750ca-9d66-4a01-927f-43eace319a06,network=Network(c40bf74e-2312-450f-ae66-15e481af3230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e750ca-9d') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-4caae7b9-10ed-42b3-9260-e323023c113e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] attach device xml: <interface type="ethernet">
Nov 17 03:01:36 user nova-compute[74898]:   <mac address="fa:16:3e:31:0f:fd"/>
Nov 17 03:01:36 user nova-compute[74898]:   <model type="virtio"/>
Nov 17 03:01:36 user nova-compute[74898]:   <mtu size="1442"/>
Nov 17 03:01:36 user nova-compute[74898]:   <target dev="tap91e750ca-9d"/>
Nov 17 03:01:36 user nova-compute[74898]: </interface>
Nov 17 03:01:36 user nova-compute[74898]:  {{(pid=74898) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG nova.compute.manager [req-0d61be19-aae1-4650-b2bd-fe574b423398 req-db0b6e13-d2ad-4992-802d-dedd8e3b9b5b service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Received event network-vif-plugged-91e750ca-9d66-4a01-927f-43eace319a06 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0d61be19-aae1-4650-b2bd-fe574b423398 req-db0b6e13-d2ad-4992-802d-dedd8e3b9b5b service nova] Acquiring lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0d61be19-aae1-4650-b2bd-fe574b423398 req-db0b6e13-d2ad-4992-802d-dedd8e3b9b5b service nova] Lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0d61be19-aae1-4650-b2bd-fe574b423398 req-db0b6e13-d2ad-4992-802d-dedd8e3b9b5b service nova] Lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG nova.compute.manager [req-0d61be19-aae1-4650-b2bd-fe574b423398 req-db0b6e13-d2ad-4992-802d-dedd8e3b9b5b service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] No waiting events found dispatching network-vif-plugged-91e750ca-9d66-4a01-927f-43eace319a06 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:01:36 user nova-compute[74898]: WARNING nova.compute.manager [req-0d61be19-aae1-4650-b2bd-fe574b423398 req-db0b6e13-d2ad-4992-802d-dedd8e3b9b5b service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Received unexpected event network-vif-plugged-91e750ca-9d66-4a01-927f-43eace319a06 for instance with vm_state active and task_state None.
Nov 17 03:01:36 user nova-compute[74898]: DEBUG nova.network.neutron [req-1bd5e6b5-f297-4677-9c9f-20612946d0c8 req-1b6591df-ad03-441c-8633-c568fbc44aee service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Updated VIF entry in instance network info cache for port 91e750ca-9d66-4a01-927f-43eace319a06. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG nova.network.neutron [req-1bd5e6b5-f297-4677-9c9f-20612946d0c8 req-1b6591df-ad03-441c-8633-c568fbc44aee service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Updating instance_info_cache with network_info: [{"id": "bd3b73ca-0068-42f4-8cf3-f84932dee960", "address": "fa:16:3e:2d:e6:07", "network": {"id": "a432562d-92fd-4786-944f-3a082f5146e8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1288851087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c45541cf5bd44c2a34d5a31f04e2a2a", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3b73ca-00", "ovs_interfaceid": "bd3b73ca-0068-42f4-8cf3-f84932dee960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "91e750ca-9d66-4a01-927f-43eace319a06", "address": "fa:16:3e:31:0f:fd", "network": {"id": "c40bf74e-2312-450f-ae66-15e481af3230", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1183652464", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8c45541cf5bd44c2a34d5a31f04e2a2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e750ca-9d", "ovs_interfaceid": "91e750ca-9d66-4a01-927f-43eace319a06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1bd5e6b5-f297-4677-9c9f-20612946d0c8 req-1b6591df-ad03-441c-8633-c568fbc44aee service nova] Releasing lock "refresh_cache-b886ada4-5bcb-4b2a-b69e-80edefdd2119" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4caae7b9-10ed-42b3-9260-e323023c113e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4caae7b9-10ed-42b3-9260-e323023c113e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] No BDM found with device name hda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:01:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4caae7b9-10ed-42b3-9260-e323023c113e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] No VIF found with MAC fa:16:3e:2d:e6:07, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-4caae7b9-10ed-42b3-9260-e323023c113e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:01:37 user nova-compute[74898]:   <nova:package version="0.0.0"/>
Nov 17 03:01:37 user nova-compute[74898]:   <nova:name>tempest-device-tagging-server-1059772796</nova:name>
Nov 17 03:01:37 user nova-compute[74898]:   <nova:creationTime>2023-11-17 03:01:37</nova:creationTime>
Nov 17 03:01:37 user nova-compute[74898]:   <nova:flavor name="m1.tiny">
Nov 17 03:01:37 user nova-compute[74898]:     <nova:memory>512</nova:memory>
Nov 17 03:01:37 user nova-compute[74898]:     <nova:disk>1</nova:disk>
Nov 17 03:01:37 user nova-compute[74898]:     <nova:swap>0</nova:swap>
Nov 17 03:01:37 user nova-compute[74898]:     <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:01:37 user nova-compute[74898]:     <nova:vcpus>1</nova:vcpus>
Nov 17 03:01:37 user nova-compute[74898]:   </nova:flavor>
Nov 17 03:01:37 user nova-compute[74898]:   <nova:owner>
Nov 17 03:01:37 user nova-compute[74898]:     <nova:user uuid="f7c4ed2ec81a411c95b2be4dcfb9859d">tempest-TaggedAttachmentsTest-1966129795-project-member</nova:user>
Nov 17 03:01:37 user nova-compute[74898]:     <nova:project uuid="8c45541cf5bd44c2a34d5a31f04e2a2a">tempest-TaggedAttachmentsTest-1966129795</nova:project>
Nov 17 03:01:37 user nova-compute[74898]:   </nova:owner>
Nov 17 03:01:37 user nova-compute[74898]:   <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:01:37 user nova-compute[74898]:   <nova:ports>
Nov 17 03:01:37 user nova-compute[74898]:     <nova:port uuid="bd3b73ca-0068-42f4-8cf3-f84932dee960">
Nov 17 03:01:37 user nova-compute[74898]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 17 03:01:37 user nova-compute[74898]:     </nova:port>
Nov 17 03:01:37 user nova-compute[74898]:     <nova:port uuid="91e750ca-9d66-4a01-927f-43eace319a06">
Nov 17 03:01:37 user nova-compute[74898]:       <nova:ip type="fixed" address="10.10.10.218" ipVersion="4"/>
Nov 17 03:01:37 user nova-compute[74898]:     </nova:port>
Nov 17 03:01:37 user nova-compute[74898]:   </nova:ports>
Nov 17 03:01:37 user nova-compute[74898]: </nova:instance>
Nov 17 03:01:37 user nova-compute[74898]:  {{(pid=74898) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4caae7b9-10ed-42b3-9260-e323023c113e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "interface-b886ada4-5bcb-4b2a-b69e-80edefdd2119-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.276s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Acquiring lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG nova.objects.instance [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lazy-loading 'flavor' on Instance uuid b886ada4-5bcb-4b2a-b69e-80edefdd2119 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Acquiring lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:01:37 user nova-compute[74898]: INFO nova.compute.manager [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Attaching volume 3b20e564-82db-4825-951d-6e368bb89669 to /dev/vdb
Nov 17 03:01:37 user nova-compute[74898]: DEBUG os_brick.utils [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dca97bc-9a7a-460b-92a1-bac305724b57]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[854fd952-ac83-482a-8d90-dd491eb6a966]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5c7254-f738-4e01-9e30-6e4bbeb1cb4b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93e9f25-64a6-4172-a958-0033e5228733]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:01:37 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:01:37 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5366b8af-9fad-4faa-bbc7-6b65a6226043]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG os_brick.utils [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:01:37 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Updating existing volume attachment record: 1d849805-27bc-4f46-b574-1deef5d669b7 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:01:38 user nova-compute[74898]: DEBUG nova.compute.manager [req-d1957b1e-7700-42a4-a445-a2187edb85bc req-f458be30-caba-4cb0-a800-20c21a4ea547 service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Received event network-vif-plugged-91e750ca-9d66-4a01-927f-43eace319a06 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:01:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d1957b1e-7700-42a4-a445-a2187edb85bc req-f458be30-caba-4cb0-a800-20c21a4ea547 service nova] Acquiring lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:01:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d1957b1e-7700-42a4-a445-a2187edb85bc req-f458be30-caba-4cb0-a800-20c21a4ea547 service nova] Lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:01:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d1957b1e-7700-42a4-a445-a2187edb85bc req-f458be30-caba-4cb0-a800-20c21a4ea547 service nova] Lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:01:38 user nova-compute[74898]: DEBUG nova.compute.manager [req-d1957b1e-7700-42a4-a445-a2187edb85bc req-f458be30-caba-4cb0-a800-20c21a4ea547 service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] No waiting events found dispatching network-vif-plugged-91e750ca-9d66-4a01-927f-43eace319a06 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:01:38 user nova-compute[74898]: WARNING nova.compute.manager [req-d1957b1e-7700-42a4-a445-a2187edb85bc req-f458be30-caba-4cb0-a800-20c21a4ea547 service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Received unexpected event network-vif-plugged-91e750ca-9d66-4a01-927f-43eace319a06 for instance with vm_state active and task_state None.
Nov 17 03:01:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSqRIrxC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:01:39 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:01:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:01:39 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:01:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:01:39 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 -p 172.16.0.220:3260" returned: 21 in 0.062s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5f8cdf-cf20-4d1b-b264-d97e316ad08f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:01:39 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b24e75-0e35-47a9-aca4-2ee5f446f301]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460] added
Nov 17 03:01:39 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cc09c1-4859-4f9e-96e0-40542b30d103]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf60457-238c-48e4-a55a-642e56c0c65c]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KSqRIrxC {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KSqRIrxC" returned: 0 in 0.037s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea708e5a-3f49-49ef-85ac-de13d60c0f59]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KSqRIrxC'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb6e05d-abe6-4bfb-a18e-32017f227607]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22d47e0-c91d-4b94-90b9-4a8866f34a7a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:01:39 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:01:39 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:01:39 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:01:39 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:01:39 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:01:39 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[771fbafd-b966-4057-aee5-22ab36b21e54]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460, portal: 172.16.0.220,3260]
Nov 17 03:01:39 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460, portal: 172.16.0.220,3260] successful.
Nov 17 03:01:39 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0f5537-b4a0-4382-bfb7-ac3f4595a180]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[add38ef0-0f97-4fc5-8830-ec0a000a3fea]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:01:39 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:01:39 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:01:39 user nova-compute[74898]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 (non-flash)
Nov 17 03:01:39 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:01:39 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:01:39 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:01:39 user nova-compute[74898]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 (non-flash)
Nov 17 03:01:39 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[739aac20-c6fb-40f6-a68a-59e3303c3004]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:01:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSqRIrxC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:01:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:01:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '23639656165663136', 'path': '/dev/sde'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:01:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639656165663136', 'path': '/dev/sde'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:01:40 user nova-compute[74898]: DEBUG nova.objects.instance [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lazy-loading 'flavor' on Instance uuid 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:01:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 03:01:40 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:01:40 user nova-compute[74898]:   <source dev="/dev/sde"/>
Nov 17 03:01:40 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:01:40 user nova-compute[74898]:   <serial>e6f1aa5a-a845-491c-b71f-07e1817a6460</serial>
Nov 17 03:01:40 user nova-compute[74898]: </disk>
Nov 17 03:01:40 user nova-compute[74898]:  {{(pid=74898) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 03:01:40 user nova-compute[74898]: DEBUG nova.compute.manager [req-9d660e66-7f45-4608-b8cc-da2a7dfdd646 req-9c0b6167-3850-448a-85ab-7d33d7a39d17 service nova] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Received event network-changed-1bfa5db9-9200-4130-9007-fca16f7064c4 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:01:40 user nova-compute[74898]: DEBUG nova.compute.manager [req-9d660e66-7f45-4608-b8cc-da2a7dfdd646 req-9c0b6167-3850-448a-85ab-7d33d7a39d17 service nova] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Refreshing instance network info cache due to event network-changed-1bfa5db9-9200-4130-9007-fca16f7064c4. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:01:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9d660e66-7f45-4608-b8cc-da2a7dfdd646 req-9c0b6167-3850-448a-85ab-7d33d7a39d17 service nova] Acquiring lock "refresh_cache-20c6c8ae-ef3d-428b-a6d5-1683eba214d9" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:01:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9d660e66-7f45-4608-b8cc-da2a7dfdd646 req-9c0b6167-3850-448a-85ab-7d33d7a39d17 service nova] Acquired lock "refresh_cache-20c6c8ae-ef3d-428b-a6d5-1683eba214d9" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:01:40 user nova-compute[74898]: DEBUG nova.network.neutron [req-9d660e66-7f45-4608-b8cc-da2a7dfdd646 req-9c0b6167-3850-448a-85ab-7d33d7a39d17 service nova] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Refreshing network info cache for port 1bfa5db9-9200-4130-9007-fca16f7064c4 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:01:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:01:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:01:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] No VIF found with MAC fa:16:3e:95:22:a1, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:01:41 user nova-compute[74898]: DEBUG nova.network.neutron [req-9d660e66-7f45-4608-b8cc-da2a7dfdd646 req-9c0b6167-3850-448a-85ab-7d33d7a39d17 service nova] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Updated VIF entry in instance network info cache for port 1bfa5db9-9200-4130-9007-fca16f7064c4. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:01:41 user nova-compute[74898]: DEBUG nova.network.neutron [req-9d660e66-7f45-4608-b8cc-da2a7dfdd646 req-9c0b6167-3850-448a-85ab-7d33d7a39d17 service nova] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Updating instance_info_cache with network_info: [{"id": "1bfa5db9-9200-4130-9007-fca16f7064c4", "address": "fa:16:3e:17:ef:99", "network": {"id": "52541a68-fc4e-4d45-8811-e55912d0ceec", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-194171318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29c2ce1c558846ac83600108cc07750d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bfa5db9-92", "ovs_interfaceid": "1bfa5db9-9200-4130-9007-fca16f7064c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:01:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9d660e66-7f45-4608-b8cc-da2a7dfdd646 req-9c0b6167-3850-448a-85ab-7d33d7a39d17 service nova] Releasing lock "refresh_cache-20c6c8ae-ef3d-428b-a6d5-1683eba214d9" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:01:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-342df6cf-bb6d-44cf-ba86-967ffe1df0fb tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.969s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:01:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Acquiring lock "20c6c8ae-ef3d-428b-a6d5-1683eba214d9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:01:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lock "20c6c8ae-ef3d-428b-a6d5-1683eba214d9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:01:42 user nova-compute[74898]: DEBUG nova.objects.instance [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lazy-loading 'flavor' on Instance uuid 20c6c8ae-ef3d-428b-a6d5-1683eba214d9 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:01:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lock "20c6c8ae-ef3d-428b-a6d5-1683eba214d9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Acquiring lock "20c6c8ae-ef3d-428b-a6d5-1683eba214d9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lock "20c6c8ae-ef3d-428b-a6d5-1683eba214d9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:01:43 user nova-compute[74898]: INFO nova.compute.manager [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Attaching volume b38aaffe-4ad0-4477-925f-ee7685100520 to /dev/sdc
Nov 17 03:01:43 user nova-compute[74898]: DEBUG os_brick.utils [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[837eb33e-9e6d-4b4e-9845-098e1619995e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e956ae6-8c64-4b6a-8198-83e2891fc3f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3d5a1d-651b-464e-a923-2ffbc32c9808]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a0ffa7-752b-4648-941c-242a4e6d5464]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:01:43 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0463129-7853-4836-ac46-074fecd3676f]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG os_brick.utils [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Updating existing volume attachment record: 21562edf-afb9-45ff-8055-7e54a195b654 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Acquiring lock "9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFIQiLrX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:01:43 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:01:43 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:01:43 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:01:43 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:01:43 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:43 user nova-compute[74898]: INFO nova.compute.manager [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Detaching volume e6f1aa5a-a845-491c-b71f-07e1817a6460
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d26d3fc-37cd-41bd-984f-7b1e0ca44129]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:01:43 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cce9af5-0d5d-4c6a-88b2-de264be165aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669] added
Nov 17 03:01:43 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:43 user nova-compute[74898]: INFO nova.virt.block_device [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Attempting to driver detach volume e6f1aa5a-a845-491c-b71f-07e1817a6460 from mountpoint /dev/vdb
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b05626-85ec-4978-bcee-5eae0a039f35]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Attempting to detach device vdb from instance 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d from the persistent domain config. {{(pid=74898) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:01:43 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:01:43 user nova-compute[74898]:   <source dev="/dev/sde"/>
Nov 17 03:01:43 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:01:43 user nova-compute[74898]:   <serial>e6f1aa5a-a845-491c-b71f-07e1817a6460</serial>
Nov 17 03:01:43 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:01:43 user nova-compute[74898]: </disk>
Nov 17 03:01:43 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:01:43 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Successfully detached device vdb from instance 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d from the persistent domain config.
Nov 17 03:01:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d from the live domain config. {{(pid=74898) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:01:43 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:01:43 user nova-compute[74898]:   <source dev="/dev/sde"/>
Nov 17 03:01:43 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:01:43 user nova-compute[74898]:   <serial>e6f1aa5a-a845-491c-b71f-07e1817a6460</serial>
Nov 17 03:01:43 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:01:43 user nova-compute[74898]: </disk>
Nov 17 03:01:43 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e544a441-f518-4c68-9e36-558f83b24d70]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eFIQiLrX {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eFIQiLrX" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2deea9-d80d-429c-bef6-156bd2bab548]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eFIQiLrX'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2220020d-9ad8-4335-b939-6e95a0c7d9a8]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbacfd35-9c67-4898-9efa-689a49158517]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:01:43 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:01:43 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:01:43 user nova-compute[74898]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 (non-flash)
Nov 17 03:01:43 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:01:43 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:01:43 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:01:43 user nova-compute[74898]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 (non-flash)
Nov 17 03:01:43 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec28b04-1666-415b-ad86-7e4426c8564c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669, portal: 172.16.0.220,3260]
Nov 17 03:01:43 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669, portal: 172.16.0.220,3260] successful.
Nov 17 03:01:43 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b7879e-db8e-4dfb-a2ed-87d330f946ae]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f401db-4da0-4035-b418-a37556b580ca]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:01:43 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:01:43 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:01:43 user nova-compute[74898]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 (non-flash)
Nov 17 03:01:43 user nova-compute[74898]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 (non-flash)
Nov 17 03:01:43 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:01:43 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:01:43 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:01:43 user nova-compute[74898]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 (non-flash)
Nov 17 03:01:43 user nova-compute[74898]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 (non-flash)
Nov 17 03:01:43 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a621ea-75d1-4f46-b127-4a523b0ebfab]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFIQiLrX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:01:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d {{(pid=74898) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 03:01:44 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:01:44 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23263623535346432', 'path': '/dev/sdf'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:01:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263623535346432', 'path': '/dev/sdf'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:01:44 user nova-compute[74898]: DEBUG nova.objects.instance [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lazy-loading 'flavor' on Instance uuid b886ada4-5bcb-4b2a-b69e-80edefdd2119 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:01:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 03:01:44 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:01:44 user nova-compute[74898]:   <source dev="/dev/sdf"/>
Nov 17 03:01:44 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:01:44 user nova-compute[74898]:   <serial>3b20e564-82db-4825-951d-6e368bb89669</serial>
Nov 17 03:01:44 user nova-compute[74898]: </disk>
Nov 17 03:01:44 user nova-compute[74898]:  {{(pid=74898) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 03:01:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:01:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] No BDM found with device name hda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:01:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] No VIF found with MAC fa:16:3e:2d:e6:07, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:01:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6a8f4432-b5e0-4436-8a4f-7659d7b4c9e8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.774s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG nova.compute.manager [req-07d0a359-8157-4ecd-96b2-2a012ac9903e req-be6a49e6-44ea-43ac-b66f-7b17be6a03c3 service nova] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Received event network-changed-9bcfc458-e33f-4119-91dc-af8a29f214e8 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG nova.compute.manager [req-07d0a359-8157-4ecd-96b2-2a012ac9903e req-be6a49e6-44ea-43ac-b66f-7b17be6a03c3 service nova] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Refreshing instance network info cache due to event network-changed-9bcfc458-e33f-4119-91dc-af8a29f214e8. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-07d0a359-8157-4ecd-96b2-2a012ac9903e req-be6a49e6-44ea-43ac-b66f-7b17be6a03c3 service nova] Acquiring lock "refresh_cache-e5885526-e2d0-41d4-8da1-b3440d243a19" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-07d0a359-8157-4ecd-96b2-2a012ac9903e req-be6a49e6-44ea-43ac-b66f-7b17be6a03c3 service nova] Acquired lock "refresh_cache-e5885526-e2d0-41d4-8da1-b3440d243a19" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG nova.network.neutron [req-07d0a359-8157-4ecd-96b2-2a012ac9903e req-be6a49e6-44ea-43ac-b66f-7b17be6a03c3 service nova] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Refreshing network info cache for port 9bcfc458-e33f-4119-91dc-af8a29f214e8 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Acquiring lock "e5885526-e2d0-41d4-8da1-b3440d243a19" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Lock "e5885526-e2d0-41d4-8da1-b3440d243a19" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG nova.objects.instance [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Lazy-loading 'flavor' on Instance uuid e5885526-e2d0-41d4-8da1-b3440d243a19 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Lock "e5885526-e2d0-41d4-8da1-b3440d243a19" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG nova.network.neutron [req-07d0a359-8157-4ecd-96b2-2a012ac9903e req-be6a49e6-44ea-43ac-b66f-7b17be6a03c3 service nova] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Updated VIF entry in instance network info cache for port 9bcfc458-e33f-4119-91dc-af8a29f214e8. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG nova.network.neutron [req-07d0a359-8157-4ecd-96b2-2a012ac9903e req-be6a49e6-44ea-43ac-b66f-7b17be6a03c3 service nova] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Updating instance_info_cache with network_info: [{"id": "9bcfc458-e33f-4119-91dc-af8a29f214e8", "address": "fa:16:3e:15:7a:74", "network": {"id": "8084ece6-42d8-412f-841a-f0a2b78991fa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1363926162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08934f3952aa4f01809ed58e16905fd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bcfc458-e3", "ovs_interfaceid": "9bcfc458-e33f-4119-91dc-af8a29f214e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Acquiring lock "e5885526-e2d0-41d4-8da1-b3440d243a19" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Lock "e5885526-e2d0-41d4-8da1-b3440d243a19" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:01:46 user nova-compute[74898]: INFO nova.compute.manager [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Attaching volume 901e5ad4-a90e-4942-a576-3887e229ccfb to /dev/vdb
Nov 17 03:01:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-07d0a359-8157-4ecd-96b2-2a012ac9903e req-be6a49e6-44ea-43ac-b66f-7b17be6a03c3 service nova] Releasing lock "refresh_cache-e5885526-e2d0-41d4-8da1-b3440d243a19" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG os_brick.utils [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f111a12-928e-465d-8af0-b55904688ebc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d942db61-4c24-4ea8-8d30-df4aee7e1fab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[187307f5-6774-4304-b2bc-d696b8311311]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0727c4-e558-4622-9cc0-08a700ca8f94]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:01:46 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:01:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfb8d42-1737-4558-a066-00d533479eaf]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG os_brick.utils [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Updating existing volume attachment record: 3f2300ff-b821-4339-b743-8655a9bd1bb6 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Acquiring lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:01:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:01:46 user nova-compute[74898]: INFO nova.compute.manager [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Detaching volume 3b20e564-82db-4825-951d-6e368bb89669
Nov 17 03:01:47 user nova-compute[74898]: INFO nova.virt.block_device [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Attempting to driver detach volume 3b20e564-82db-4825-951d-6e368bb89669 from mountpoint /dev/vdb
Nov 17 03:01:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Attempting to detach device vdb from instance b886ada4-5bcb-4b2a-b69e-80edefdd2119 from the persistent domain config. {{(pid=74898) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 03:01:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:01:47 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:01:47 user nova-compute[74898]:   <source dev="/dev/sdf"/>
Nov 17 03:01:47 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:01:47 user nova-compute[74898]:   <serial>3b20e564-82db-4825-951d-6e368bb89669</serial>
Nov 17 03:01:47 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 17 03:01:47 user nova-compute[74898]: </disk>
Nov 17 03:01:47 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:01:47 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Successfully detached device vdb from instance b886ada4-5bcb-4b2a-b69e-80edefdd2119 from the persistent domain config.
Nov 17 03:01:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b886ada4-5bcb-4b2a-b69e-80edefdd2119 from the live domain config. {{(pid=74898) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 03:01:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:01:47 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:01:47 user nova-compute[74898]:   <source dev="/dev/sdf"/>
Nov 17 03:01:47 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:01:47 user nova-compute[74898]:   <serial>3b20e564-82db-4825-951d-6e368bb89669</serial>
Nov 17 03:01:47 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 17 03:01:47 user nova-compute[74898]: </disk>
Nov 17 03:01:47 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:01:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b886ada4-5bcb-4b2a-b69e-80edefdd2119 {{(pid=74898) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKjGJadx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:01:48 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:01:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:01:48 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:01:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:01:48 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:01:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2719a897-f2ac-49ef-8fe0-6eee638b1b27]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:01:48 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f333be-cb65-4321-ad0f-0474454a1fb6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520] added
Nov 17 03:01:48 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff481c01-ba05-4b26-a02f-970624d1aca0]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f692c4-478e-42c5-8ab4-6ae3c2e81e33]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tKjGJadx {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tKjGJadx" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddf8595-aa26-40b5-a6bc-81108f7341f3]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tKjGJadx'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[806b2de4-83c5-4b28-ba23-48325d203207]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b92ed5-15de-402a-92f7-1db1080c7121]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:01:48 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:01:48 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:01:48 user nova-compute[74898]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 (non-flash)
Nov 17 03:01:48 user nova-compute[74898]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 (non-flash)
Nov 17 03:01:48 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:01:48 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:01:48 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:01:48 user nova-compute[74898]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 (non-flash)
Nov 17 03:01:48 user nova-compute[74898]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 (non-flash)
Nov 17 03:01:48 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:01:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:49 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cb8322-d5eb-4b92-9a2e-3dc30e91eab4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:49 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520, portal: 172.16.0.220,3260]
Nov 17 03:01:49 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520, portal: 172.16.0.220,3260] successful.
Nov 17 03:01:49 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:49 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fbd964-0af7-4472-8d25-4316e1395249]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:49 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:49 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6e2f03-a4dd-4cc2-aefc-d1672a1b3395]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:49 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:01:49 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:01:49 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:01:49 user nova-compute[74898]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 (non-flash)
Nov 17 03:01:49 user nova-compute[74898]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 (non-flash)
Nov 17 03:01:49 user nova-compute[74898]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 (non-flash)
Nov 17 03:01:49 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:01:49 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:01:49 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:01:49 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:01:49 user nova-compute[74898]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 (non-flash)
Nov 17 03:01:49 user nova-compute[74898]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 (non-flash)
Nov 17 03:01:49 user nova-compute[74898]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 (non-flash)
Nov 17 03:01:49 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:01:49 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:01:49 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:01:49 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:01:49 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:01:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:49 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bef0c6-14a7-4497-9120-e58024f463a9]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:49 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:01:49 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKjGJadx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:01:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:01:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23635353034613662', 'path': '/dev/sdg'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:01:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635353034613662', 'path': '/dev/sdg'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:01:50 user nova-compute[74898]: DEBUG nova.objects.instance [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lazy-loading 'flavor' on Instance uuid 20c6c8ae-ef3d-428b-a6d5-1683eba214d9 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:01:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 03:01:50 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:01:50 user nova-compute[74898]:   <source dev="/dev/sdg"/>
Nov 17 03:01:50 user nova-compute[74898]:   <target dev="sdc" bus="scsi"/>
Nov 17 03:01:50 user nova-compute[74898]:   <serial>b38aaffe-4ad0-4477-925f-ee7685100520</serial>
Nov 17 03:01:50 user nova-compute[74898]:   <address type="drive" controller="0" unit="2"/>
Nov 17 03:01:50 user nova-compute[74898]: </disk>
Nov 17 03:01:50 user nova-compute[74898]:  {{(pid=74898) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 03:01:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] No BDM found with device name sda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:01:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:01:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:01:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] No VIF found with MAC fa:16:3e:17:ef:99, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:01:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-02a21290-c193-4bec-b07e-3d8e3dd4e60d tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lock "20c6c8ae-ef3d-428b-a6d5-1683eba214d9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.822s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:01:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Acquiring lock "20c6c8ae-ef3d-428b-a6d5-1683eba214d9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:01:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lock "20c6c8ae-ef3d-428b-a6d5-1683eba214d9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:01:51 user nova-compute[74898]: INFO nova.compute.manager [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Detaching volume b38aaffe-4ad0-4477-925f-ee7685100520
Nov 17 03:01:52 user nova-compute[74898]: INFO nova.virt.block_device [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Attempting to driver detach volume b38aaffe-4ad0-4477-925f-ee7685100520 from mountpoint /dev/sdc
Nov 17 03:01:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Attempting to detach device sdc from instance 20c6c8ae-ef3d-428b-a6d5-1683eba214d9 from the persistent domain config. {{(pid=74898) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:01:52 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:01:52 user nova-compute[74898]:   <source dev="/dev/sdg"/>
Nov 17 03:01:52 user nova-compute[74898]:   <target dev="sdc" bus="scsi"/>
Nov 17 03:01:52 user nova-compute[74898]:   <serial>b38aaffe-4ad0-4477-925f-ee7685100520</serial>
Nov 17 03:01:52 user nova-compute[74898]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 17 03:01:52 user nova-compute[74898]: </disk>
Nov 17 03:01:52 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:01:52 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Successfully detached device sdc from instance 20c6c8ae-ef3d-428b-a6d5-1683eba214d9 from the persistent domain config.
Nov 17 03:01:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 20c6c8ae-ef3d-428b-a6d5-1683eba214d9 from the live domain config. {{(pid=74898) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:01:52 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:01:52 user nova-compute[74898]:   <source dev="/dev/sdg"/>
Nov 17 03:01:52 user nova-compute[74898]:   <target dev="sdc" bus="scsi"/>
Nov 17 03:01:52 user nova-compute[74898]:   <serial>b38aaffe-4ad0-4477-925f-ee7685100520</serial>
Nov 17 03:01:52 user nova-compute[74898]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 17 03:01:52 user nova-compute[74898]: </disk>
Nov 17 03:01:52 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VKwQnzgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:01:52 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:01:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:01:52 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:01:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:01:52 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b138d4-a553-4ebc-82cf-3f24c823937e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:01:52 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c649b362-d21a-4425-b077-fcc3e80bb28c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb] added
Nov 17 03:01:52 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75e4eb5-8632-42ca-bb97-f631c6c6d75f]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7feb5f7-2ebe-4ae0-98a3-af174d34e727]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VKwQnzgy {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VKwQnzgy" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85be51b-3f98-424b-99e7-df97b7c92efa]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VKwQnzgy'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab36516e-6d11-4d3e-a277-9acce2c29144]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[341e3437-a3b9-44be-b933-cd47edb72bf9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:01:52 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:01:52 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:01:52 user nova-compute[74898]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 (non-flash)
Nov 17 03:01:52 user nova-compute[74898]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 (non-flash)
Nov 17 03:01:52 user nova-compute[74898]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 (non-flash)
Nov 17 03:01:52 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:01:52 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:01:52 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:01:52 user nova-compute[74898]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 (non-flash)
Nov 17 03:01:52 user nova-compute[74898]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 (non-flash)
Nov 17 03:01:52 user nova-compute[74898]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 (non-flash)
Nov 17 03:01:52 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 20c6c8ae-ef3d-428b-a6d5-1683eba214d9 {{(pid=74898) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2199799-0d77-4a29-bb0d-12e0ce12c592]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb, portal: 172.16.0.220,3260]
Nov 17 03:01:52 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb, portal: 172.16.0.220,3260] successful.
Nov 17 03:01:52 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba12bfa-44d7-421c-a74c-211178ef81c5]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b6edcf-2192-484a-8b50-4fce9d01b53f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:01:52 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:01:52 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:01:52 user nova-compute[74898]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 (non-flash)
Nov 17 03:01:52 user nova-compute[74898]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 (non-flash)
Nov 17 03:01:52 user nova-compute[74898]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 (non-flash)
Nov 17 03:01:52 user nova-compute[74898]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb (non-flash)
Nov 17 03:01:52 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:01:52 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:01:52 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:01:52 user nova-compute[74898]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 (non-flash)
Nov 17 03:01:52 user nova-compute[74898]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 (non-flash)
Nov 17 03:01:52 user nova-compute[74898]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 (non-flash)
Nov 17 03:01:52 user nova-compute[74898]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb (non-flash)
Nov 17 03:01:52 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[47842df6-7e4f-4c94-9e43-a074e8a84b06]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:01:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VKwQnzgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:01:53 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:01:53 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23235343032373264', 'path': '/dev/sdh'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:01:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235343032373264', 'path': '/dev/sdh'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:01:53 user nova-compute[74898]: DEBUG nova.objects.instance [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Lazy-loading 'flavor' on Instance uuid e5885526-e2d0-41d4-8da1-b3440d243a19 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:01:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] attach device xml: <disk type="block" device="disk">
Nov 17 03:01:53 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:01:53 user nova-compute[74898]:   <source dev="/dev/sdh"/>
Nov 17 03:01:53 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:01:53 user nova-compute[74898]:   <serial>901e5ad4-a90e-4942-a576-3887e229ccfb</serial>
Nov 17 03:01:53 user nova-compute[74898]: </disk>
Nov 17 03:01:53 user nova-compute[74898]:  {{(pid=74898) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 03:01:54 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:01:54 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:01:54 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] No VIF found with MAC fa:16:3e:15:7a:74, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:01:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6d024c94-37d6-4c16-aa4e-a0f84c231aca tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Lock "e5885526-e2d0-41d4-8da1-b3440d243a19" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.702s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:01:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:01:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-19846107-6e83-4600-83b4-a92b4f6cf114 tempest-VolumesAssistedSnapshotsTest-2131163573 tempest-VolumesAssistedSnapshotsTest-2131163573-project] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] volume_snapshot_create: create_info: {'snapshot_id': '3f336b37-06d7-4c8f-ae11-f764b8884318', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74898) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 17 03:01:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-19846107-6e83-4600-83b4-a92b4f6cf114 tempest-VolumesAssistedSnapshotsTest-2131163573 tempest-VolumesAssistedSnapshotsTest-2131163573-project] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] snap xml: <domainsnapshot>
Nov 17 03:01:55 user nova-compute[74898]:   <disks>
Nov 17 03:01:55 user nova-compute[74898]:     <disk name="/dev/sdh" snapshot="external" type="file">
Nov 17 03:01:55 user nova-compute[74898]:       <source file="/dev/new_file"/>
Nov 17 03:01:55 user nova-compute[74898]:     </disk>
Nov 17 03:01:55 user nova-compute[74898]:     <disk name="vda" snapshot="no"/>
Nov 17 03:01:55 user nova-compute[74898]:   </disks>
Nov 17 03:01:55 user nova-compute[74898]: </domainsnapshot>
Nov 17 03:01:55 user nova-compute[74898]:  {{(pid=74898) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 17 03:01:55 user nova-compute[74898]: DEBUG nova.objects.instance [None req-19846107-6e83-4600-83b4-a92b4f6cf114 tempest-VolumesAssistedSnapshotsTest-2131163573 tempest-VolumesAssistedSnapshotsTest-2131163573-project] Lazy-loading 'system_metadata' on Instance uuid e5885526-e2d0-41d4-8da1-b3440d243a19 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:01:55 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-19846107-6e83-4600-83b4-a92b4f6cf114 tempest-VolumesAssistedSnapshotsTest-2131163573 tempest-VolumesAssistedSnapshotsTest-2131163573-project] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [None req-19846107-6e83-4600-83b4-a92b4f6cf114 tempest-VolumesAssistedSnapshotsTest-2131163573 tempest-VolumesAssistedSnapshotsTest-2131163573-project] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Traceback (most recent call last):
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]     rv = execute(f, *args, **kwargs)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]     six.reraise(c, e, tb)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]     raise value
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]     rv = meth(*args, **kwargs)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] 
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [None req-19846107-6e83-4600-83b4-a92b4f6cf114 tempest-VolumesAssistedSnapshotsTest-2131163573 tempest-VolumesAssistedSnapshotsTest-2131163573-project] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Traceback (most recent call last):
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]     self._volume_snapshot_create(context, instance, guest,
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]     rv = execute(f, *args, **kwargs)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]     six.reraise(c, e, tb)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]     raise value
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]     rv = meth(*args, **kwargs)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] 
Nov 17 03:01:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3ac07beb-2a2a-4f88-a4d4-036be7508513 tempest-VolumesAssistedSnapshotsTest-2131163573 tempest-VolumesAssistedSnapshotsTest-2131163573-project] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] volume_snapshot_delete: delete_info: {'volume_id': '901e5ad4-a90e-4942-a576-3887e229ccfb'} {{(pid=74898) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [None req-3ac07beb-2a2a-4f88-a4d4-036be7508513 tempest-VolumesAssistedSnapshotsTest-2131163573 tempest-VolumesAssistedSnapshotsTest-2131163573-project] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Traceback (most recent call last):
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19]     if delete_info['type'] != 'qcow2':
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] KeyError: 'type'
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] 
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [None req-3ac07beb-2a2a-4f88-a4d4-036be7508513 tempest-VolumesAssistedSnapshotsTest-2131163573 tempest-VolumesAssistedSnapshotsTest-2131163573-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver 
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver 
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-138c66c9-5b56-4da7-a9b2-765cc56afa30)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver 
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver 
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver 
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver [None req-19846107-6e83-4600-83b4-a92b4f6cf114 tempest-VolumesAssistedSnapshotsTest-2131163573 tempest-VolumesAssistedSnapshotsTest-2131163573-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 3f336b37-06d7-4c8f-ae11-f764b8884318 could not be found.
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     raise value
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver 
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver 
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 3f336b37-06d7-4c8f-ae11-f764b8884318 could not be found. (HTTP 404) (Request-ID: req-9a96f438-8d40-40b7-aeff-d039b00ba909)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver 
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver 
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 3f336b37-06d7-4c8f-ae11-f764b8884318 could not be found.
Nov 17 03:01:55 user nova-compute[74898]: ERROR nova.virt.libvirt.driver 
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server [None req-3ac07beb-2a2a-4f88-a4d4-036be7508513 tempest-VolumesAssistedSnapshotsTest-2131163573 tempest-VolumesAssistedSnapshotsTest-2131163573-project] Exception during message handling: KeyError: 'type'
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server 
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server [None req-19846107-6e83-4600-83b4-a92b4f6cf114 tempest-VolumesAssistedSnapshotsTest-2131163573 tempest-VolumesAssistedSnapshotsTest-2131163573-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     raise value
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 17 03:01:55 user nova-compute[74898]: ERROR oslo_messaging.rpc.server 
Nov 17 03:01:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Acquiring lock "e5885526-e2d0-41d4-8da1-b3440d243a19" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:01:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Lock "e5885526-e2d0-41d4-8da1-b3440d243a19" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:01:55 user nova-compute[74898]: INFO nova.compute.manager [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Detaching volume 901e5ad4-a90e-4942-a576-3887e229ccfb
Nov 17 03:01:55 user nova-compute[74898]: INFO nova.virt.block_device [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Attempting to driver detach volume 901e5ad4-a90e-4942-a576-3887e229ccfb from mountpoint /dev/vdb
Nov 17 03:01:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Attempting to detach device vdb from instance e5885526-e2d0-41d4-8da1-b3440d243a19 from the persistent domain config. {{(pid=74898) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 03:01:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] detach device xml: <disk type="block" device="disk">
Nov 17 03:01:55 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:01:55 user nova-compute[74898]:   <source dev="/dev/sdh"/>
Nov 17 03:01:55 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:01:55 user nova-compute[74898]:   <serial>901e5ad4-a90e-4942-a576-3887e229ccfb</serial>
Nov 17 03:01:55 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:01:55 user nova-compute[74898]: </disk>
Nov 17 03:01:55 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:01:55 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Successfully detached device vdb from instance e5885526-e2d0-41d4-8da1-b3440d243a19 from the persistent domain config.
Nov 17 03:01:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e5885526-e2d0-41d4-8da1-b3440d243a19 from the live domain config. {{(pid=74898) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 03:01:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] detach device xml: <disk type="block" device="disk">
Nov 17 03:01:55 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:01:55 user nova-compute[74898]:   <source dev="/dev/sdh"/>
Nov 17 03:01:55 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:01:55 user nova-compute[74898]:   <serial>901e5ad4-a90e-4942-a576-3887e229ccfb</serial>
Nov 17 03:01:55 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:01:55 user nova-compute[74898]: </disk>
Nov 17 03:01:55 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:01:56 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e5885526-e2d0-41d4-8da1-b3440d243a19 {{(pid=74898) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 03:01:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:03 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d is timed out.
Nov 17 03:02:03 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Successfully detached device vdb from instance 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d from the live domain config.
Nov 17 03:02:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:02:03 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSqRIrxC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:02:03 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:02:03 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:02:03 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:02:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:03 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1802801e-a9f2-4845-ba79-22783426a52a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:03 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:02:03 user nova-compute[74898]: No targets found.
Nov 17 03:02:03 user nova-compute[74898]: iSNS:
Nov 17 03:02:03 user nova-compute[74898]: No targets found.
Nov 17 03:02:03 user nova-compute[74898]: STATIC:
Nov 17 03:02:03 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520
Nov 17 03:02:03 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:02:03 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:02:03 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962
Nov 17 03:02:03 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:02:03 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:02:03 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1
Nov 17 03:02:03 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:02:03 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:02:03 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb
Nov 17 03:02:03 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:02:03 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:02:03 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd
Nov 17 03:02:03 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:02:03 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:02:03 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460
Nov 17 03:02:03 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:02:03 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:02:03 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669
Nov 17 03:02:03 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:02:03 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:02:03 user nova-compute[74898]: FIRMWARE:
Nov 17 03:02:03 user nova-compute[74898]: No targets found.
Nov 17 03:02:03 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:02:03 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:02:03 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:02:03 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:02:03 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:02:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:03 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[229dc945-0280-45d1-bde0-1302007b9a33]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:03 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb90e1ad-43ec-4373-9f94-2311ea69cd1d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:03 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:02:03 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:02:03 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:02:03 user nova-compute[74898]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 (non-flash)
Nov 17 03:02:03 user nova-compute[74898]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 (non-flash)
Nov 17 03:02:03 user nova-compute[74898]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 (non-flash)
Nov 17 03:02:03 user nova-compute[74898]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb (non-flash)
Nov 17 03:02:03 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:02:03 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:02:03 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:02:03 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:02:03 user nova-compute[74898]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 (non-flash)
Nov 17 03:02:03 user nova-compute[74898]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 (non-flash)
Nov 17 03:02:03 user nova-compute[74898]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 (non-flash)
Nov 17 03:02:03 user nova-compute[74898]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb (non-flash)
Nov 17 03:02:03 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:02:03 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf8694040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460'): ({'sde'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:02:03 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Removing single pathed devices sde {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:02:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[61878fe1-9571-4dcf-a813-746b67f2adae]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9832beaa-c3c8-4d8f-9225-36d453a66454]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Flushing IO for device /dev/sde {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2a6997-a7b9-4d3d-9b65-3c2ae6c8684a]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7948f955-e9b2-40f9-b1b8-6f9121e305c4]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] SCSI volumes sde have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73839b9-426f-4f36-ac35-307a366742c4]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a94f630-2a4c-468e-aaf2-eeddf983f5c4]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460, portal: 172.16.0.220,3260]
Nov 17 03:02:04 user nova-compute[74898]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460, portal: 172.16.0.220,3260] successful.
Nov 17 03:02:04 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f1aa5a-a845-491c-b71f-07e1817a6460 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f768049-b73b-43b5-af28-9124305ff31d]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] <== disconnect_volume: return (327ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:02:04 user nova-compute[74898]: DEBUG nova.objects.instance [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lazy-loading 'flavor' on Instance uuid 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:02:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-226a9c07-096e-4354-8df8-f0ea2f482180 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.671s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:07 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b886ada4-5bcb-4b2a-b69e-80edefdd2119 is timed out.
Nov 17 03:02:07 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Successfully detached device vdb from instance b886ada4-5bcb-4b2a-b69e-80edefdd2119 from the live domain config.
Nov 17 03:02:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFIQiLrX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:02:07 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:02:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[61077d8d-05a4-4dbb-9cad-0f8ae48c617a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:02:07 user nova-compute[74898]: No targets found.
Nov 17 03:02:07 user nova-compute[74898]: iSNS:
Nov 17 03:02:07 user nova-compute[74898]: No targets found.
Nov 17 03:02:07 user nova-compute[74898]: STATIC:
Nov 17 03:02:07 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520
Nov 17 03:02:07 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:02:07 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:02:07 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962
Nov 17 03:02:07 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:02:07 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:02:07 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1
Nov 17 03:02:07 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:02:07 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:02:07 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb
Nov 17 03:02:07 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:02:07 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:02:07 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd
Nov 17 03:02:07 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:02:07 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:02:07 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669
Nov 17 03:02:07 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:02:07 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:02:07 user nova-compute[74898]: FIRMWARE:
Nov 17 03:02:07 user nova-compute[74898]: No targets found.
Nov 17 03:02:07 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:02:07 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:02:07 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[52647367-d987-4e53-b4e6-bd1c72a4a8e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7fb34f-b837-40cb-b6a5-2974f2e3ac00]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:02:07 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:02:07 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:02:07 user nova-compute[74898]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 (non-flash)
Nov 17 03:02:07 user nova-compute[74898]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 (non-flash)
Nov 17 03:02:07 user nova-compute[74898]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb (non-flash)
Nov 17 03:02:07 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:02:07 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:02:07 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:02:07 user nova-compute[74898]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 (non-flash)
Nov 17 03:02:07 user nova-compute[74898]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 (non-flash)
Nov 17 03:02:07 user nova-compute[74898]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb (non-flash)
Nov 17 03:02:07 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9c1854dcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669'): ({'sdf'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Removing single pathed devices sdf {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[37befbee-4196-48ad-8094-7ecfd8771a8a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[724cdd91-bec7-416c-88e7-aca001cf1625]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Flushing IO for device /dev/sdf {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e833a9-95c3-438f-baf9-17c41e8952ea]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[122f1f4c-08ef-4a63-af63-4c6e3b476a4b]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] SCSI volumes sdf have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[46139c4b-3ffa-43c9-bf30-aceb5a83590d]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[add8ea43-b249-48e7-960b-26d5ed53de4a]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669, portal: 172.16.0.220,3260]
Nov 17 03:02:07 user nova-compute[74898]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669, portal: 172.16.0.220,3260] successful.
Nov 17 03:02:07 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b20e564-82db-4825-951d-6e368bb89669 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcd1b7b-db98-4c8c-a179-4a57846dcecb]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] <== disconnect_volume: return (334ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:02:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:02:08 user nova-compute[74898]: DEBUG nova.objects.instance [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lazy-loading 'flavor' on Instance uuid b886ada4-5bcb-4b2a-b69e-80edefdd2119 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:02:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0b063f0b-b708-4f1f-8712-cc0bf656244e tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.775s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Acquiring lock "interface-b886ada4-5bcb-4b2a-b69e-80edefdd2119-91e750ca-9d66-4a01-927f-43eace319a06" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "interface-b886ada4-5bcb-4b2a-b69e-80edefdd2119-91e750ca-9d66-4a01-927f-43eace319a06" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:09 user nova-compute[74898]: DEBUG nova.objects.instance [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lazy-loading 'flavor' on Instance uuid b886ada4-5bcb-4b2a-b69e-80edefdd2119 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:02:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T02:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1059772796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1059772796',id=7,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbRzMswcys+QI6rLi6X0vGsy7XfMvLPPyHl7k0Ny6Kbzn4mYAR49YTYPPYUhsJ7Wj7VjaU+vGFbOCukOTayflDVlC4cnZKPAPKbqPCeENy+82k6vfJ0ZQpQ1EY3m67/9g==',key_name='tempest-keypair-1533313292',keypairs=<?>,launch_index=0,launched_at=2023-11-17T02:59:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c45541cf5bd44c2a34d5a31f04e2a2a',ramdisk_id='',reservation_id='r-ftctsg18',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1966129795',owner_user_name='tempest-TaggedAttachmentsTest-1966129795-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T02:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7c4ed2ec81a411c95b2be4dcfb9859d',uuid=b886ada4-5bcb-4b2a-b69e-80edefdd2119,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91e750ca-9d66-4a01-927f-43eace319a06", "address": "fa:16:3e:31:0f:fd", "network": {"id": "c40bf74e-2312-450f-ae66-15e481af3230", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1183652464", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8c45541cf5bd44c2a34d5a31f04e2a2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e750ca-9d", "ovs_interfaceid": "91e750ca-9d66-4a01-927f-43eace319a06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:02:09 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Converting VIF {"id": "91e750ca-9d66-4a01-927f-43eace319a06", "address": "fa:16:3e:31:0f:fd", "network": {"id": "c40bf74e-2312-450f-ae66-15e481af3230", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1183652464", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8c45541cf5bd44c2a34d5a31f04e2a2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e750ca-9d", "ovs_interfaceid": "91e750ca-9d66-4a01-927f-43eace319a06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:02:09 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:0f:fd,bridge_name='br-int',has_traffic_filtering=True,id=91e750ca-9d66-4a01-927f-43eace319a06,network=Network(c40bf74e-2312-450f-ae66-15e481af3230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e750ca-9d') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:02:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:31:0f:fd"/><model type="virtio"/><mtu size="1442"/><target dev="tap91e750ca-9d"/></interface> {{(pid=74898) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 17 03:02:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:31:0f:fd"/><model type="virtio"/><mtu size="1442"/><target dev="tap91e750ca-9d"/></interface> {{(pid=74898) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 17 03:02:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Attempting to detach device tap91e750ca-9d from instance b886ada4-5bcb-4b2a-b69e-80edefdd2119 from the persistent domain config. {{(pid=74898) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 03:02:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] detach device xml: <interface type="ethernet">
Nov 17 03:02:09 user nova-compute[74898]:   <mac address="fa:16:3e:31:0f:fd"/>
Nov 17 03:02:09 user nova-compute[74898]:   <model type="virtio"/>
Nov 17 03:02:09 user nova-compute[74898]:   <mtu size="1442"/>
Nov 17 03:02:09 user nova-compute[74898]:   <target dev="tap91e750ca-9d"/>
Nov 17 03:02:09 user nova-compute[74898]: </interface>
Nov 17 03:02:09 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:02:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:31:0f:fd"/><model type="virtio"/><mtu size="1442"/><target dev="tap91e750ca-9d"/></interface> {{(pid=74898) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 17 03:02:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:31:0f:fd"/><model type="virtio"/><mtu size="1442"/><target dev="tap91e750ca-9d"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 17 03:02:09 user nova-compute[74898]:   <name>instance-00000007</name>
Nov 17 03:02:09 user nova-compute[74898]:   <uuid>b886ada4-5bcb-4b2a-b69e-80edefdd2119</uuid>
Nov 17 03:02:09 user nova-compute[74898]:   <metadata>
Nov 17 03:02:09 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:02:09 user nova-compute[74898]:   <nova:package version="0.0.0"/>
Nov 17 03:02:09 user nova-compute[74898]:   <nova:name>tempest-device-tagging-server-1059772796</nova:name>
Nov 17 03:02:09 user nova-compute[74898]:   <nova:creationTime>2023-11-17 03:01:37</nova:creationTime>
Nov 17 03:02:09 user nova-compute[74898]:   <nova:flavor name="m1.tiny">
Nov 17 03:02:09 user nova-compute[74898]:     <nova:memory>512</nova:memory>
Nov 17 03:02:09 user nova-compute[74898]:     <nova:disk>1</nova:disk>
Nov 17 03:02:09 user nova-compute[74898]:     <nova:swap>0</nova:swap>
Nov 17 03:02:09 user nova-compute[74898]:     <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:02:09 user nova-compute[74898]:     <nova:vcpus>1</nova:vcpus>
Nov 17 03:02:09 user nova-compute[74898]:   </nova:flavor>
Nov 17 03:02:09 user nova-compute[74898]:   <nova:owner>
Nov 17 03:02:09 user nova-compute[74898]:     <nova:user uuid="f7c4ed2ec81a411c95b2be4dcfb9859d">tempest-TaggedAttachmentsTest-1966129795-project-member</nova:user>
Nov 17 03:02:09 user nova-compute[74898]:     <nova:project uuid="8c45541cf5bd44c2a34d5a31f04e2a2a">tempest-TaggedAttachmentsTest-1966129795</nova:project>
Nov 17 03:02:09 user nova-compute[74898]:   </nova:owner>
Nov 17 03:02:09 user nova-compute[74898]:   <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:02:09 user nova-compute[74898]:   <nova:ports>
Nov 17 03:02:09 user nova-compute[74898]:     <nova:port uuid="bd3b73ca-0068-42f4-8cf3-f84932dee960">
Nov 17 03:02:09 user nova-compute[74898]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 17 03:02:09 user nova-compute[74898]:     </nova:port>
Nov 17 03:02:09 user nova-compute[74898]:     <nova:port uuid="91e750ca-9d66-4a01-927f-43eace319a06">
Nov 17 03:02:09 user nova-compute[74898]:       <nova:ip type="fixed" address="10.10.10.218" ipVersion="4"/>
Nov 17 03:02:09 user nova-compute[74898]:     </nova:port>
Nov 17 03:02:09 user nova-compute[74898]:   </nova:ports>
Nov 17 03:02:09 user nova-compute[74898]: </nova:instance>
Nov 17 03:02:09 user nova-compute[74898]:   </metadata>
Nov 17 03:02:09 user nova-compute[74898]:   <memory unit='KiB'>524288</memory>
Nov 17 03:02:09 user nova-compute[74898]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 17 03:02:09 user nova-compute[74898]:   <vcpu placement='static'>1</vcpu>
Nov 17 03:02:09 user nova-compute[74898]:   <resource>
Nov 17 03:02:09 user nova-compute[74898]:     <partition>/machine</partition>
Nov 17 03:02:09 user nova-compute[74898]:   </resource>
Nov 17 03:02:09 user nova-compute[74898]:   <sysinfo type='smbios'>
Nov 17 03:02:09 user nova-compute[74898]:     <system>
Nov 17 03:02:09 user nova-compute[74898]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 17 03:02:09 user nova-compute[74898]:       <entry name='product'>OpenStack Nova</entry>
Nov 17 03:02:09 user nova-compute[74898]:       <entry name='version'>0.0.0</entry>
Nov 17 03:02:09 user nova-compute[74898]:       <entry name='serial'>b886ada4-5bcb-4b2a-b69e-80edefdd2119</entry>
Nov 17 03:02:09 user nova-compute[74898]:       <entry name='uuid'>b886ada4-5bcb-4b2a-b69e-80edefdd2119</entry>
Nov 17 03:02:09 user nova-compute[74898]:       <entry name='family'>Virtual Machine</entry>
Nov 17 03:02:09 user nova-compute[74898]:     </system>
Nov 17 03:02:09 user nova-compute[74898]:   </sysinfo>
Nov 17 03:02:09 user nova-compute[74898]:   <os>
Nov 17 03:02:09 user nova-compute[74898]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 17 03:02:09 user nova-compute[74898]:     <boot dev='hd'/>
Nov 17 03:02:09 user nova-compute[74898]:     <smbios mode='sysinfo'/>
Nov 17 03:02:09 user nova-compute[74898]:   </os>
Nov 17 03:02:09 user nova-compute[74898]:   <features>
Nov 17 03:02:09 user nova-compute[74898]:     <acpi/>
Nov 17 03:02:09 user nova-compute[74898]:     <apic/>
Nov 17 03:02:09 user nova-compute[74898]:     <vmcoreinfo state='on'/>
Nov 17 03:02:09 user nova-compute[74898]:   </features>
Nov 17 03:02:09 user nova-compute[74898]:   <cpu mode='custom' match='exact' check='full'>
Nov 17 03:02:09 user nova-compute[74898]:     <model fallback='forbid'>Nehalem</model>
Nov 17 03:02:09 user nova-compute[74898]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 17 03:02:09 user nova-compute[74898]:     <feature policy='require' name='vme'/>
Nov 17 03:02:09 user nova-compute[74898]:     <feature policy='require' name='x2apic'/>
Nov 17 03:02:09 user nova-compute[74898]:     <feature policy='require' name='hypervisor'/>
Nov 17 03:02:09 user nova-compute[74898]:   </cpu>
Nov 17 03:02:09 user nova-compute[74898]:   <clock offset='utc'>
Nov 17 03:02:09 user nova-compute[74898]:     <timer name='pit' tickpolicy='delay'/>
Nov 17 03:02:09 user nova-compute[74898]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 17 03:02:09 user nova-compute[74898]:     <timer name='hpet' present='no'/>
Nov 17 03:02:09 user nova-compute[74898]:   </clock>
Nov 17 03:02:09 user nova-compute[74898]:   <on_poweroff>destroy</on_poweroff>
Nov 17 03:02:09 user nova-compute[74898]:   <on_reboot>restart</on_reboot>
Nov 17 03:02:09 user nova-compute[74898]:   <on_crash>destroy</on_crash>
Nov 17 03:02:09 user nova-compute[74898]:   <devices>
Nov 17 03:02:09 user nova-compute[74898]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 17 03:02:09 user nova-compute[74898]:     <disk type='file' device='disk'>
Nov 17 03:02:09 user nova-compute[74898]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 17 03:02:09 user nova-compute[74898]:       <source file='/opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk' index='2'/>
Nov 17 03:02:09 user nova-compute[74898]:       <backingStore type='file' index='3'>
Nov 17 03:02:09 user nova-compute[74898]:         <format type='raw'/>
Nov 17 03:02:09 user nova-compute[74898]:         <source file='/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372'/>
Nov 17 03:02:09 user nova-compute[74898]:         <backingStore/>
Nov 17 03:02:09 user nova-compute[74898]:       </backingStore>
Nov 17 03:02:09 user nova-compute[74898]:       <target dev='vda' bus='virtio'/>
Nov 17 03:02:09 user nova-compute[74898]:       <alias name='virtio-disk0'/>
Nov 17 03:02:09 user nova-compute[74898]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 17 03:02:09 user nova-compute[74898]:     </disk>
Nov 17 03:02:09 user nova-compute[74898]:     <disk type='file' device='cdrom'>
Nov 17 03:02:09 user nova-compute[74898]:       <driver name='qemu' type='raw' cache='none'/>
Nov 17 03:02:09 user nova-compute[74898]:       <source file='/opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk.config' index='1'/>
Nov 17 03:02:09 user nova-compute[74898]:       <backingStore/>
Nov 17 03:02:09 user nova-compute[74898]:       <target dev='hda' bus='ide'/>
Nov 17 03:02:09 user nova-compute[74898]:       <readonly/>
Nov 17 03:02:09 user nova-compute[74898]:       <alias name='ide0-0-0'/>
Nov 17 03:02:09 user nova-compute[74898]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 17 03:02:09 user nova-compute[74898]:     </disk>
Nov 17 03:02:09 user nova-compute[74898]:     <controller type='usb' index='0' model='none'>
Nov 17 03:02:09 user nova-compute[74898]:       <alias name='usb'/>
Nov 17 03:02:09 user nova-compute[74898]:     </controller>
Nov 17 03:02:09 user nova-compute[74898]:     <controller type='pci' index='0' model='pci-root'>
Nov 17 03:02:09 user nova-compute[74898]:       <alias name='pci.0'/>
Nov 17 03:02:09 user nova-compute[74898]:     </controller>
Nov 17 03:02:09 user nova-compute[74898]:     <controller type='ide' index='0'>
Nov 17 03:02:09 user nova-compute[74898]:       <alias name='ide'/>
Nov 17 03:02:09 user nova-compute[74898]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 17 03:02:09 user nova-compute[74898]:     </controller>
Nov 17 03:02:09 user nova-compute[74898]:     <interface type='ethernet'>
Nov 17 03:02:09 user nova-compute[74898]:       <mac address='fa:16:3e:2d:e6:07'/>
Nov 17 03:02:09 user nova-compute[74898]:       <target dev='tapbd3b73ca-00'/>
Nov 17 03:02:09 user nova-compute[74898]:       <model type='virtio'/>
Nov 17 03:02:09 user nova-compute[74898]:       <mtu size='1442'/>
Nov 17 03:02:09 user nova-compute[74898]:       <alias name='net0'/>
Nov 17 03:02:09 user nova-compute[74898]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 17 03:02:09 user nova-compute[74898]:     </interface>
Nov 17 03:02:09 user nova-compute[74898]:     <interface type='ethernet'>
Nov 17 03:02:09 user nova-compute[74898]:       <mac address='fa:16:3e:31:0f:fd'/>
Nov 17 03:02:09 user nova-compute[74898]:       <target dev='tap91e750ca-9d'/>
Nov 17 03:02:09 user nova-compute[74898]:       <model type='virtio'/>
Nov 17 03:02:09 user nova-compute[74898]:       <mtu size='1442'/>
Nov 17 03:02:09 user nova-compute[74898]:       <alias name='net1'/>
Nov 17 03:02:09 user nova-compute[74898]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 17 03:02:09 user nova-compute[74898]:     </interface>
Nov 17 03:02:09 user nova-compute[74898]:     <serial type='pty'>
Nov 17 03:02:09 user nova-compute[74898]:       <source path='/dev/pts/6'/>
Nov 17 03:02:09 user nova-compute[74898]:       <log file='/opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/console.log' append='off'/>
Nov 17 03:02:09 user nova-compute[74898]:       <target type='isa-serial' port='0'>
Nov 17 03:02:09 user nova-compute[74898]:         <model name='isa-serial'/>
Nov 17 03:02:09 user nova-compute[74898]:       </target>
Nov 17 03:02:09 user nova-compute[74898]:       <alias name='serial0'/>
Nov 17 03:02:09 user nova-compute[74898]:     </serial>
Nov 17 03:02:09 user nova-compute[74898]:     <console type='pty' tty='/dev/pts/6'>
Nov 17 03:02:09 user nova-compute[74898]:       <source path='/dev/pts/6'/>
Nov 17 03:02:09 user nova-compute[74898]:       <log file='/opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/console.log' append='off'/>
Nov 17 03:02:09 user nova-compute[74898]:       <target type='serial' port='0'/>
Nov 17 03:02:09 user nova-compute[74898]:       <alias name='serial0'/>
Nov 17 03:02:09 user nova-compute[74898]:     </console>
Nov 17 03:02:09 user nova-compute[74898]:     <input type='mouse' bus='ps2'>
Nov 17 03:02:09 user nova-compute[74898]:       <alias name='input0'/>
Nov 17 03:02:09 user nova-compute[74898]:     </input>
Nov 17 03:02:09 user nova-compute[74898]:     <input type='keyboard' bus='ps2'>
Nov 17 03:02:09 user nova-compute[74898]:       <alias name='input1'/>
Nov 17 03:02:09 user nova-compute[74898]:     </input>
Nov 17 03:02:09 user nova-compute[74898]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 17 03:02:09 user nova-compute[74898]:       <listen type='address' address='0.0.0.0'/>
Nov 17 03:02:09 user nova-compute[74898]:     </graphics>
Nov 17 03:02:09 user nova-compute[74898]:     <audio id='1' type='none'/>
Nov 17 03:02:09 user nova-compute[74898]:     <video>
Nov 17 03:02:09 user nova-compute[74898]:       <model type='virtio' heads='1' primary='yes'/>
Nov 17 03:02:09 user nova-compute[74898]:       <alias name='video0'/>
Nov 17 03:02:09 user nova-compute[74898]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 17 03:02:09 user nova-compute[74898]:     </video>
Nov 17 03:02:09 user nova-compute[74898]:     <memballoon model='virtio'>
Nov 17 03:02:09 user nova-compute[74898]:       <stats period='10'/>
Nov 17 03:02:09 user nova-compute[74898]:       <alias name='balloon0'/>
Nov 17 03:02:09 user nova-compute[74898]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 17 03:02:09 user nova-compute[74898]:     </memballoon>
Nov 17 03:02:09 user nova-compute[74898]:     <rng model='virtio'>
Nov 17 03:02:09 user nova-compute[74898]:       <backend model='random'>/dev/urandom</backend>
Nov 17 03:02:09 user nova-compute[74898]:       <alias name='rng0'/>
Nov 17 03:02:09 user nova-compute[74898]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 17 03:02:09 user nova-compute[74898]:     </rng>
Nov 17 03:02:09 user nova-compute[74898]:   </devices>
Nov 17 03:02:09 user nova-compute[74898]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 17 03:02:09 user nova-compute[74898]:     <label>libvirt-b886ada4-5bcb-4b2a-b69e-80edefdd2119</label>
Nov 17 03:02:09 user nova-compute[74898]:     <imagelabel>libvirt-b886ada4-5bcb-4b2a-b69e-80edefdd2119</imagelabel>
Nov 17 03:02:09 user nova-compute[74898]:   </seclabel>
Nov 17 03:02:09 user nova-compute[74898]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 17 03:02:09 user nova-compute[74898]:     <label>+64055:+108</label>
Nov 17 03:02:09 user nova-compute[74898]:     <imagelabel>+64055:+108</imagelabel>
Nov 17 03:02:09 user nova-compute[74898]:   </seclabel>
Nov 17 03:02:09 user nova-compute[74898]: </domain>
Nov 17 03:02:09 user nova-compute[74898]:  {{(pid=74898) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 17 03:02:09 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Successfully detached device tap91e750ca-9d from instance b886ada4-5bcb-4b2a-b69e-80edefdd2119 from the persistent domain config.
Nov 17 03:02:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] (1/8): Attempting to detach device tap91e750ca-9d with device alias net1 from instance b886ada4-5bcb-4b2a-b69e-80edefdd2119 from the live domain config. {{(pid=74898) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 03:02:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] detach device xml: <interface type="ethernet">
Nov 17 03:02:09 user nova-compute[74898]:   <mac address="fa:16:3e:31:0f:fd"/>
Nov 17 03:02:09 user nova-compute[74898]:   <model type="virtio"/>
Nov 17 03:02:09 user nova-compute[74898]:   <mtu size="1442"/>
Nov 17 03:02:09 user nova-compute[74898]:   <target dev="tap91e750ca-9d"/>
Nov 17 03:02:09 user nova-compute[74898]: </interface>
Nov 17 03:02:09 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:02:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Start waiting for the detach event from libvirt for device tap91e750ca-9d with device alias net1 for instance b886ada4-5bcb-4b2a-b69e-80edefdd2119 {{(pid=74898) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 03:02:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:10 user nova-compute[74898]: DEBUG nova.compute.manager [req-43522e0d-8afc-4d74-9b24-004b0600051c req-b7772be0-377f-4382-84eb-a8bca5980c8c service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Received event network-vif-unplugged-91e750ca-9d66-4a01-927f-43eace319a06 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-43522e0d-8afc-4d74-9b24-004b0600051c req-b7772be0-377f-4382-84eb-a8bca5980c8c service nova] Acquiring lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-43522e0d-8afc-4d74-9b24-004b0600051c req-b7772be0-377f-4382-84eb-a8bca5980c8c service nova] Lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-43522e0d-8afc-4d74-9b24-004b0600051c req-b7772be0-377f-4382-84eb-a8bca5980c8c service nova] Lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:10 user nova-compute[74898]: DEBUG nova.compute.manager [req-43522e0d-8afc-4d74-9b24-004b0600051c req-b7772be0-377f-4382-84eb-a8bca5980c8c service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] No waiting events found dispatching network-vif-unplugged-91e750ca-9d66-4a01-927f-43eace319a06 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:02:10 user nova-compute[74898]: WARNING nova.compute.manager [req-43522e0d-8afc-4d74-9b24-004b0600051c req-b7772be0-377f-4382-84eb-a8bca5980c8c service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Received unexpected event network-vif-unplugged-91e750ca-9d66-4a01-927f-43eace319a06 for instance with vm_state active and task_state None.
Nov 17 03:02:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:11 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:02:11 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG nova.compute.manager [req-d49f0a50-fc50-4a9b-bc8f-69d9ee44736e req-411d968d-2243-4197-a94f-c8bfca16257f service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Received event network-vif-plugged-91e750ca-9d66-4a01-927f-43eace319a06 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d49f0a50-fc50-4a9b-bc8f-69d9ee44736e req-411d968d-2243-4197-a94f-c8bfca16257f service nova] Acquiring lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d49f0a50-fc50-4a9b-bc8f-69d9ee44736e req-411d968d-2243-4197-a94f-c8bfca16257f service nova] Lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d49f0a50-fc50-4a9b-bc8f-69d9ee44736e req-411d968d-2243-4197-a94f-c8bfca16257f service nova] Lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG nova.compute.manager [req-d49f0a50-fc50-4a9b-bc8f-69d9ee44736e req-411d968d-2243-4197-a94f-c8bfca16257f service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] No waiting events found dispatching network-vif-plugged-91e750ca-9d66-4a01-927f-43eace319a06 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:02:12 user nova-compute[74898]: WARNING nova.compute.manager [req-d49f0a50-fc50-4a9b-bc8f-69d9ee44736e req-411d968d-2243-4197-a94f-c8bfca16257f service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Received unexpected event network-vif-plugged-91e750ca-9d66-4a01-927f-43eace319a06 for instance with vm_state active and task_state None.
Nov 17 03:02:12 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 20c6c8ae-ef3d-428b-a6d5-1683eba214d9 is timed out.
Nov 17 03:02:12 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Successfully detached device sdc from instance 20c6c8ae-ef3d-428b-a6d5-1683eba214d9 from the live domain config.
Nov 17 03:02:12 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKjGJadx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:02:12 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:02:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fe8b18-e909-4ab2-ab73-ce41d2188ed5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:02:12 user nova-compute[74898]: No targets found.
Nov 17 03:02:12 user nova-compute[74898]: iSNS:
Nov 17 03:02:12 user nova-compute[74898]: No targets found.
Nov 17 03:02:12 user nova-compute[74898]: STATIC:
Nov 17 03:02:12 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520
Nov 17 03:02:12 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:02:12 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:02:12 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962
Nov 17 03:02:12 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:02:12 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:02:12 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1
Nov 17 03:02:12 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:02:12 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:02:12 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb
Nov 17 03:02:12 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:02:12 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:02:12 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd
Nov 17 03:02:12 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:02:12 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:02:12 user nova-compute[74898]: FIRMWARE:
Nov 17 03:02:12 user nova-compute[74898]: No targets found.
Nov 17 03:02:12 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:02:12 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:02:12 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1d6acf-0769-474d-8501-da5588f6273c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[170a6352-db8f-48c3-8e94-8d4e3425a74d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:02:12 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:02:12 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:02:12 user nova-compute[74898]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 (non-flash)
Nov 17 03:02:12 user nova-compute[74898]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb (non-flash)
Nov 17 03:02:12 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:02:12 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:02:12 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:02:12 user nova-compute[74898]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 (non-flash)
Nov 17 03:02:12 user nova-compute[74898]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb (non-flash)
Nov 17 03:02:12 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9c1865b7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520'): ({'sdg'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Removing single pathed devices sdg {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[078d6cb0-26eb-4b93-88a2-f27d2e608222]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[83318aef-d1b2-452c-aac3-a6e6bf132a61]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Flushing IO for device /dev/sdg {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c4c5b0-7f52-4162-85c2-c961c0979eb4]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[08799ab8-3bd5-4a02-baab-e8e01d316ab2]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] SCSI volumes sdg have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c674a1-b211-4d20-a4d3-1577afc914c7]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aae2eef-b878-4063-935f-d3679b260a3b]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520, portal: 172.16.0.220,3260]
Nov 17 03:02:12 user nova-compute[74898]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520, portal: 172.16.0.220,3260] successful.
Nov 17 03:02:12 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38aaffe-4ad0-4477-925f-ee7685100520 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[17db3011-8c82-4651-b8d5-ef923a25f798]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] <== disconnect_volume: return (298ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:02:12 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:02:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:13 user nova-compute[74898]: DEBUG nova.objects.instance [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lazy-loading 'flavor' on Instance uuid 20c6c8ae-ef3d-428b-a6d5-1683eba214d9 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:02:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-79b5e839-bcf5-438c-8806-7a18ec3c54aa tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lock "20c6c8ae-ef3d-428b-a6d5-1683eba214d9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.582s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:13 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:02:13 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:02:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-e733574a-56ba-4e24-babd-855bcb5bda61" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:02:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-e733574a-56ba-4e24-babd-855bcb5bda61" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:02:14 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:02:14 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:14 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Updating instance_info_cache with network_info: [{"id": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "address": "fa:16:3e:8c:c0:06", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8bd92de-8e", "ovs_interfaceid": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:02:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-e733574a-56ba-4e24-babd-855bcb5bda61" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:02:14 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:02:14 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:02:14 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:02:14 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:02:14 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:02:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6eaf0fad-7000-491e-9995-95776e4b0e05 tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Acquiring lock "20c6c8ae-ef3d-428b-a6d5-1683eba214d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6eaf0fad-7000-491e-9995-95776e4b0e05 tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lock "20c6c8ae-ef3d-428b-a6d5-1683eba214d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6eaf0fad-7000-491e-9995-95776e4b0e05 tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Acquiring lock "20c6c8ae-ef3d-428b-a6d5-1683eba214d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6eaf0fad-7000-491e-9995-95776e4b0e05 tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lock "20c6c8ae-ef3d-428b-a6d5-1683eba214d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6eaf0fad-7000-491e-9995-95776e4b0e05 tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lock "20c6c8ae-ef3d-428b-a6d5-1683eba214d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:14 user nova-compute[74898]: INFO nova.compute.manager [None req-6eaf0fad-7000-491e-9995-95776e4b0e05 tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Terminating instance
Nov 17 03:02:14 user nova-compute[74898]: DEBUG nova.compute.manager [None req-6eaf0fad-7000-491e-9995-95776e4b0e05 tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:02:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:15 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Instance destroyed successfully.
Nov 17 03:02:15 user nova-compute[74898]: DEBUG nova.objects.instance [None req-6eaf0fad-7000-491e-9995-95776e4b0e05 tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lazy-loading 'resources' on Instance uuid 20c6c8ae-ef3d-428b-a6d5-1683eba214d9 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:02:15 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-6eaf0fad-7000-491e-9995-95776e4b0e05 tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T02:59:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-525249058',display_name='tempest-AttachSCSIVolumeTestJSON-server-525249058',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-525249058',id=8,image_ref='d17d827f-e97e-4f7f-8606-3d2a5e536d29',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhquSVpuUc4Lnyn71oZdv7LCTpwVaU0y4W814wwRvXuttXu9htmzLQSuLM1plYQEtuhbRhH+cmcpLV8VbIcZdSn+h5wwrVA0tLiEdkUofkCi7VJMXrxRrFB9TDpyWV9bg==',key_name='tempest-keypair-561746567',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:00:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29c2ce1c558846ac83600108cc07750d',ramdisk_id='',reservation_id='r-cu0oqpp5',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d17d827f-e97e-4f7f-8606-3d2a5e536d29',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-647753812',owner_user_name='tempest-AttachSCSIVolumeTestJSON-647753812-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cda65a1c72304a9dbdeaa6bf3ea9da0d',uuid=20c6c8ae-ef3d-428b-a6d5-1683eba214d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bfa5db9-9200-4130-9007-fca16f7064c4", "address": "fa:16:3e:17:ef:99", "network": {"id": "52541a68-fc4e-4d45-8811-e55912d0ceec", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-194171318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29c2ce1c558846ac83600108cc07750d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bfa5db9-92", "ovs_interfaceid": "1bfa5db9-9200-4130-9007-fca16f7064c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:02:15 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6eaf0fad-7000-491e-9995-95776e4b0e05 tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Converting VIF {"id": "1bfa5db9-9200-4130-9007-fca16f7064c4", "address": "fa:16:3e:17:ef:99", "network": {"id": "52541a68-fc4e-4d45-8811-e55912d0ceec", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-194171318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29c2ce1c558846ac83600108cc07750d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bfa5db9-92", "ovs_interfaceid": "1bfa5db9-9200-4130-9007-fca16f7064c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:02:15 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6eaf0fad-7000-491e-9995-95776e4b0e05 tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:ef:99,bridge_name='br-int',has_traffic_filtering=True,id=1bfa5db9-9200-4130-9007-fca16f7064c4,network=Network(52541a68-fc4e-4d45-8811-e55912d0ceec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bfa5db9-92') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:02:15 user nova-compute[74898]: DEBUG os_vif [None req-6eaf0fad-7000-491e-9995-95776e4b0e05 tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:ef:99,bridge_name='br-int',has_traffic_filtering=True,id=1bfa5db9-9200-4130-9007-fca16f7064c4,network=Network(52541a68-fc4e-4d45-8811-e55912d0ceec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bfa5db9-92') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:02:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1bfa5db9-92, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:02:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bdfc0f5c-1547-44d4-b277-2a33d055b1da) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:02:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:15 user nova-compute[74898]: INFO os_vif [None req-6eaf0fad-7000-491e-9995-95776e4b0e05 tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:ef:99,bridge_name='br-int',has_traffic_filtering=True,id=1bfa5db9-9200-4130-9007-fca16f7064c4,network=Network(52541a68-fc4e-4d45-8811-e55912d0ceec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bfa5db9-92')
Nov 17 03:02:15 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-6eaf0fad-7000-491e-9995-95776e4b0e05 tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Deleting instance files /opt/stack/data/nova/instances/20c6c8ae-ef3d-428b-a6d5-1683eba214d9_del
Nov 17 03:02:15 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-6eaf0fad-7000-491e-9995-95776e4b0e05 tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Deletion of /opt/stack/data/nova/instances/20c6c8ae-ef3d-428b-a6d5-1683eba214d9_del complete
Nov 17 03:02:15 user nova-compute[74898]: INFO nova.compute.manager [None req-6eaf0fad-7000-491e-9995-95776e4b0e05 tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 17 03:02:15 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-6eaf0fad-7000-491e-9995-95776e4b0e05 tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:02:15 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:02:15 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:02:16 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e5885526-e2d0-41d4-8da1-b3440d243a19 is timed out.
Nov 17 03:02:16 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Successfully detached device vdb from instance e5885526-e2d0-41d4-8da1-b3440d243a19 from the live domain config.
Nov 17 03:02:16 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VKwQnzgy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:02:16 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:02:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b4ab32-42ba-442f-98ec-6b7af5e205c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:02:16 user nova-compute[74898]: No targets found.
Nov 17 03:02:16 user nova-compute[74898]: iSNS:
Nov 17 03:02:16 user nova-compute[74898]: No targets found.
Nov 17 03:02:16 user nova-compute[74898]: STATIC:
Nov 17 03:02:16 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962
Nov 17 03:02:16 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:02:16 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:02:16 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1
Nov 17 03:02:16 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:02:16 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:02:16 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb
Nov 17 03:02:16 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:02:16 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:02:16 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd
Nov 17 03:02:16 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:02:16 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:02:16 user nova-compute[74898]: FIRMWARE:
Nov 17 03:02:16 user nova-compute[74898]: No targets found.
Nov 17 03:02:16 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:02:16 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:02:16 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcdf92d-834b-4547-994a-f1815485948d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e879c4b3-108a-45c1-8558-4055c9bc6682]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:02:16 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:02:16 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:02:16 user nova-compute[74898]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb (non-flash)
Nov 17 03:02:16 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:02:16 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:02:16 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:02:16 user nova-compute[74898]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb (non-flash)
Nov 17 03:02:16 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9c186589d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb'): ({'sdh'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Removing single pathed devices sdh {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5100ebd-dd4c-4c42-bb9d-5aefea111655]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6982153-556e-468a-9f97-c3b547b2408e]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Flushing IO for device /dev/sdh {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[116ae66f-9468-4484-9038-a1d90f1e83fa]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.037s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[054b5ce4-7f8b-4287-b089-e698b3414a5d]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] SCSI volumes sdh have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9f84a2-2fd9-4735-8d7a-48d6e4d859f6]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ed5252-6f11-4e6f-9518-da5f2d447ff3]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb, portal: 172.16.0.220,3260]
Nov 17 03:02:16 user nova-compute[74898]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb, portal: 172.16.0.220,3260] successful.
Nov 17 03:02:16 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:901e5ad4-a90e-4942-a576-3887e229ccfb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac1807f-7acd-483c-8097-e6808d8151fd]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] <== disconnect_volume: return (316ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG nova.compute.manager [req-ee304e26-dceb-48b3-a9fe-c1a276262216 req-1b6957dc-adb4-49e9-8c40-cafcd1cfff37 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-changed-33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG nova.compute.manager [req-ee304e26-dceb-48b3-a9fe-c1a276262216 req-1b6957dc-adb4-49e9-8c40-cafcd1cfff37 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Refreshing instance network info cache due to event network-changed-33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ee304e26-dceb-48b3-a9fe-c1a276262216 req-1b6957dc-adb4-49e9-8c40-cafcd1cfff37 service nova] Acquiring lock "refresh_cache-df13492d-d351-49c1-9755-7c30caae89f1" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ee304e26-dceb-48b3-a9fe-c1a276262216 req-1b6957dc-adb4-49e9-8c40-cafcd1cfff37 service nova] Acquired lock "refresh_cache-df13492d-d351-49c1-9755-7c30caae89f1" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG nova.network.neutron [req-ee304e26-dceb-48b3-a9fe-c1a276262216 req-1b6957dc-adb4-49e9-8c40-cafcd1cfff37 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Refreshing network info cache for port 33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:16 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:02:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:17 user nova-compute[74898]: DEBUG nova.objects.instance [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Lazy-loading 'flavor' on Instance uuid e5885526-e2d0-41d4-8da1-b3440d243a19 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:02:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b869a55-acf6-4550-9354-2480273a4ee2/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-64ac582e-725a-4436-aaa6-342715a56b4b tempest-VolumesAssistedSnapshotsTest-1610949957 tempest-VolumesAssistedSnapshotsTest-1610949957-project-admin] Lock "e5885526-e2d0-41d4-8da1-b3440d243a19" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.733s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:17 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:02:17 user nova-compute[74898]: DEBUG nova.compute.manager [req-6305224c-9437-43b3-bf4d-ce2b7d2e1a55 req-2913f785-6b5e-4771-8c9b-bc5b63dd222f service nova] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Received event network-vif-deleted-1bfa5db9-9200-4130-9007-fca16f7064c4 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:17 user nova-compute[74898]: INFO nova.compute.manager [req-6305224c-9437-43b3-bf4d-ce2b7d2e1a55 req-2913f785-6b5e-4771-8c9b-bc5b63dd222f service nova] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Neutron deleted interface 1bfa5db9-9200-4130-9007-fca16f7064c4; detaching it from the instance and deleting it from the info cache
Nov 17 03:02:17 user nova-compute[74898]: DEBUG nova.network.neutron [req-6305224c-9437-43b3-bf4d-ce2b7d2e1a55 req-2913f785-6b5e-4771-8c9b-bc5b63dd222f service nova] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:02:17 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Took 1.59 seconds to deallocate network for instance.
Nov 17 03:02:17 user nova-compute[74898]: DEBUG nova.compute.manager [req-6305224c-9437-43b3-bf4d-ce2b7d2e1a55 req-2913f785-6b5e-4771-8c9b-bc5b63dd222f service nova] [instance: 20c6c8ae-ef3d-428b-a6d5-1683eba214d9] Detach interface failed, port_id=1bfa5db9-9200-4130-9007-fca16f7064c4, reason: Instance 20c6c8ae-ef3d-428b-a6d5-1683eba214d9 could not be found. {{(pid=74898) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 03:02:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6eaf0fad-7000-491e-9995-95776e4b0e05 tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6eaf0fad-7000-491e-9995-95776e4b0e05 tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b869a55-acf6-4550-9354-2480273a4ee2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b869a55-acf6-4550-9354-2480273a4ee2/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:17 user nova-compute[74898]: DEBUG nova.network.neutron [req-ee304e26-dceb-48b3-a9fe-c1a276262216 req-1b6957dc-adb4-49e9-8c40-cafcd1cfff37 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Updated VIF entry in instance network info cache for port 33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:02:17 user nova-compute[74898]: DEBUG nova.network.neutron [req-ee304e26-dceb-48b3-a9fe-c1a276262216 req-1b6957dc-adb4-49e9-8c40-cafcd1cfff37 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Updating instance_info_cache with network_info: [{"id": "33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5", "address": "fa:16:3e:62:7a:e1", "network": {"id": "97f8611a-f601-4395-8871-1fc8bd7801af", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-548653871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33c1e7b3-fb", "ovs_interfaceid": "33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1a0a6a3-d445-4e76-b6ca-1183ae4b724f", "address": "fa:16:3e:6d:37:0c", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a0a6a3-d4", "ovs_interfaceid": "c1a0a6a3-d445-4e76-b6ca-1183ae4b724f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d59452b9-ad23-4cfd-810a-776bb572d493", "address": "fa:16:3e:86:66:f2", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59452b9-ad", "ovs_interfaceid": "d59452b9-ad23-4cfd-810a-776bb572d493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e20d2c64-8b92-434c-84a4-d28453214349", "address": "fa:16:3e:e1:f4:1c", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape20d2c64-8b", "ovs_interfaceid": "e20d2c64-8b92-434c-84a4-d28453214349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0003a9c-9202-4863-92aa-0fd29a026c8c", "address": "fa:16:3e:8f:4e:96", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0003a9c-92", "ovs_interfaceid": "e0003a9c-9202-4863-92aa-0fd29a026c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "207857d3-8c12-4e4f-b934-c69ed1f92961", "address": "fa:16:3e:ca:ec:13", "network": {"id": "86a58fdf-5837-4342-b488-23f43f0c8db6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1066442327", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207857d3-8c", "ovs_interfaceid": "207857d3-8c12-4e4f-b934-c69ed1f92961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b0aade1-07ec-4744-b85c-d71ff8e10663", "address": "fa:16:3e:07:d7:07", "network": {"id": "86a58fdf-5837-4342-b488-23f43f0c8db6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1066442327", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b0aade1-07", "ovs_interfaceid": "7b0aade1-07ec-4744-b85c-d71ff8e10663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:02:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ee304e26-dceb-48b3-a9fe-c1a276262216 req-1b6957dc-adb4-49e9-8c40-cafcd1cfff37 service nova] Releasing lock "refresh_cache-df13492d-d351-49c1-9755-7c30caae89f1" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:02:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b869a55-acf6-4550-9354-2480273a4ee2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:02:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:02:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:02:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5885526-e2d0-41d4-8da1-b3440d243a19/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:17 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-6eaf0fad-7000-491e-9995-95776e4b0e05 tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:02:17 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-6eaf0fad-7000-491e-9995-95776e4b0e05 tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:02:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6eaf0fad-7000-491e-9995-95776e4b0e05 tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5885526-e2d0-41d4-8da1-b3440d243a19/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5885526-e2d0-41d4-8da1-b3440d243a19/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:18 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-6eaf0fad-7000-491e-9995-95776e4b0e05 tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Deleted allocations for instance 20c6c8ae-ef3d-428b-a6d5-1683eba214d9
Nov 17 03:02:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6eaf0fad-7000-491e-9995-95776e4b0e05 tempest-AttachSCSIVolumeTestJSON-647753812 tempest-AttachSCSIVolumeTestJSON-647753812-project-member] Lock "20c6c8ae-ef3d-428b-a6d5-1683eba214d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.158s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5885526-e2d0-41d4-8da1-b3440d243a19/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "df13492d-d351-49c1-9755-7c30caae89f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:19 user nova-compute[74898]: INFO nova.compute.manager [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Terminating instance
Nov 17 03:02:19 user nova-compute[74898]: DEBUG nova.compute.manager [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:02:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG nova.compute.manager [req-f4462738-dab7-4f1a-a120-a0962b25deda req-a165494a-c13b-4411-b591-bda07c052aa0 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-unplugged-d59452b9-ad23-4cfd-810a-776bb572d493 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f4462738-dab7-4f1a-a120-a0962b25deda req-a165494a-c13b-4411-b591-bda07c052aa0 service nova] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f4462738-dab7-4f1a-a120-a0962b25deda req-a165494a-c13b-4411-b591-bda07c052aa0 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f4462738-dab7-4f1a-a120-a0962b25deda req-a165494a-c13b-4411-b591-bda07c052aa0 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG nova.compute.manager [req-f4462738-dab7-4f1a-a120-a0962b25deda req-a165494a-c13b-4411-b591-bda07c052aa0 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] No waiting events found dispatching network-vif-unplugged-d59452b9-ad23-4cfd-810a-776bb572d493 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG nova.compute.manager [req-f4462738-dab7-4f1a-a120-a0962b25deda req-a165494a-c13b-4411-b591-bda07c052aa0 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-unplugged-d59452b9-ad23-4cfd-810a-776bb572d493 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG nova.compute.manager [req-d390b874-f01a-4bc4-9685-a82ebe78a964 req-b105c6ac-163a-4f66-9b0f-1a2243db4de5 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-unplugged-e0003a9c-9202-4863-92aa-0fd29a026c8c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d390b874-f01a-4bc4-9685-a82ebe78a964 req-b105c6ac-163a-4f66-9b0f-1a2243db4de5 service nova] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d390b874-f01a-4bc4-9685-a82ebe78a964 req-b105c6ac-163a-4f66-9b0f-1a2243db4de5 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d390b874-f01a-4bc4-9685-a82ebe78a964 req-b105c6ac-163a-4f66-9b0f-1a2243db4de5 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG nova.compute.manager [req-d390b874-f01a-4bc4-9685-a82ebe78a964 req-b105c6ac-163a-4f66-9b0f-1a2243db4de5 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] No waiting events found dispatching network-vif-unplugged-e0003a9c-9202-4863-92aa-0fd29a026c8c {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG nova.compute.manager [req-d390b874-f01a-4bc4-9685-a82ebe78a964 req-b105c6ac-163a-4f66-9b0f-1a2243db4de5 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-unplugged-e0003a9c-9202-4863-92aa-0fd29a026c8c for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:21 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Instance destroyed successfully.
Nov 17 03:02:21 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:02:21 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:02:21 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=7157MB free_disk=25.526123046875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG nova.objects.instance [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lazy-loading 'resources' on Instance uuid df13492d-d351-49c1-9755-7c30caae89f1 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759658847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759658847',id=10,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9l33pWbZQh9MlgJ0c526xiqvNHClwgljKX0oW5Ns00va7Ih1kDjLTORglU0E8d91/kOyn6EwD4XGWP+H2+9W1xPbcpyJIBbpTxN1SZ9Q8W3RAxUoEhXIJ97lxsaeV5EQ==',key_name='tempest-keypair-1177168277',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:00:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d06ab04c365d49639386a4c40620f735',ramdisk_id='',reservation_id='r-hg4z88r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1407862931',owner_user_name='tempest-TaggedBootDevicesTest-1407862931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:00:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c9a303c92cc4937a595f49417224e46',uuid=df13492d-d351-49c1-9755-7c30caae89f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5", "address": "fa:16:3e:62:7a:e1", "network": {"id": "97f8611a-f601-4395-8871-1fc8bd7801af", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-548653871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33c1e7b3-fb", "ovs_interfaceid": "33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converting VIF {"id": "33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5", "address": "fa:16:3e:62:7a:e1", "network": {"id": "97f8611a-f601-4395-8871-1fc8bd7801af", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-548653871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33c1e7b3-fb", "ovs_interfaceid": "33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:7a:e1,bridge_name='br-int',has_traffic_filtering=True,id=33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5,network=Network(97f8611a-f601-4395-8871-1fc8bd7801af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33c1e7b3-fb') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG os_vif [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:7a:e1,bridge_name='br-int',has_traffic_filtering=True,id=33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5,network=Network(97f8611a-f601-4395-8871-1fc8bd7801af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33c1e7b3-fb') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33c1e7b3-fb, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c61e1d26-6253-43c4-a531-578a6860327d) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance e733574a-56ba-4e24-babd-855bcb5bda61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 11704034-7afe-475c-ae43-1324b40f0d92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 015ff42a-4d69-4f60-b86c-c6bd68d23c99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance b886ada4-5bcb-4b2a-b69e-80edefdd2119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance e5885526-e2d0-41d4-8da1-b3440d243a19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance df13492d-d351-49c1-9755-7c30caae89f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 4b869a55-acf6-4550-9354-2480273a4ee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance d1ee03a5-13fb-47e7-8712-ea31aed36643 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG nova.compute.manager [req-1a1cf6c3-6e8c-4201-89fd-6079147893bd req-ccda13dc-022e-4c23-b6bf-6d212c17c732 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-unplugged-33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1a1cf6c3-6e8c-4201-89fd-6079147893bd req-ccda13dc-022e-4c23-b6bf-6d212c17c732 service nova] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1a1cf6c3-6e8c-4201-89fd-6079147893bd req-ccda13dc-022e-4c23-b6bf-6d212c17c732 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1a1cf6c3-6e8c-4201-89fd-6079147893bd req-ccda13dc-022e-4c23-b6bf-6d212c17c732 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG nova.compute.manager [req-1a1cf6c3-6e8c-4201-89fd-6079147893bd req-ccda13dc-022e-4c23-b6bf-6d212c17c732 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] No waiting events found dispatching network-vif-unplugged-33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG nova.compute.manager [req-1a1cf6c3-6e8c-4201-89fd-6079147893bd req-ccda13dc-022e-4c23-b6bf-6d212c17c732 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-unplugged-33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:21 user nova-compute[74898]: INFO os_vif [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:7a:e1,bridge_name='br-int',has_traffic_filtering=True,id=33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5,network=Network(97f8611a-f601-4395-8871-1fc8bd7801af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33c1e7b3-fb')
Nov 17 03:02:21 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759658847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759658847',id=10,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9l33pWbZQh9MlgJ0c526xiqvNHClwgljKX0oW5Ns00va7Ih1kDjLTORglU0E8d91/kOyn6EwD4XGWP+H2+9W1xPbcpyJIBbpTxN1SZ9Q8W3RAxUoEhXIJ97lxsaeV5EQ==',key_name='tempest-keypair-1177168277',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:00:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d06ab04c365d49639386a4c40620f735',ramdisk_id='',reservation_id='r-hg4z88r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1407862931',owner_user_name='tempest-TaggedBootDevicesTest-1407862931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:00:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c9a303c92cc4937a595f49417224e46',uuid=df13492d-d351-49c1-9755-7c30caae89f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1a0a6a3-d445-4e76-b6ca-1183ae4b724f", "address": "fa:16:3e:6d:37:0c", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a0a6a3-d4", "ovs_interfaceid": "c1a0a6a3-d445-4e76-b6ca-1183ae4b724f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converting VIF {"id": "c1a0a6a3-d445-4e76-b6ca-1183ae4b724f", "address": "fa:16:3e:6d:37:0c", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a0a6a3-d4", "ovs_interfaceid": "c1a0a6a3-d445-4e76-b6ca-1183ae4b724f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:37:0c,bridge_name='br-int',has_traffic_filtering=True,id=c1a0a6a3-d445-4e76-b6ca-1183ae4b724f,network=Network(a1111cf3-2ce5-4e9c-a5d1-7468a768f08e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc1a0a6a3-d4') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG os_vif [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:37:0c,bridge_name='br-int',has_traffic_filtering=True,id=c1a0a6a3-d445-4e76-b6ca-1183ae4b724f,network=Network(a1111cf3-2ce5-4e9c-a5d1-7468a768f08e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc1a0a6a3-d4') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1a0a6a3-d4, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=070782f7-ebc0-4926-a567-b1d6ba83980d) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:21 user nova-compute[74898]: INFO os_vif [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:37:0c,bridge_name='br-int',has_traffic_filtering=True,id=c1a0a6a3-d445-4e76-b6ca-1183ae4b724f,network=Network(a1111cf3-2ce5-4e9c-a5d1-7468a768f08e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc1a0a6a3-d4')
Nov 17 03:02:21 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759658847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759658847',id=10,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9l33pWbZQh9MlgJ0c526xiqvNHClwgljKX0oW5Ns00va7Ih1kDjLTORglU0E8d91/kOyn6EwD4XGWP+H2+9W1xPbcpyJIBbpTxN1SZ9Q8W3RAxUoEhXIJ97lxsaeV5EQ==',key_name='tempest-keypair-1177168277',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:00:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d06ab04c365d49639386a4c40620f735',ramdisk_id='',reservation_id='r-hg4z88r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1407862931',owner_user_name='tempest-TaggedBootDevicesTest-1407862931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:00:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c9a303c92cc4937a595f49417224e46',uuid=df13492d-d351-49c1-9755-7c30caae89f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d59452b9-ad23-4cfd-810a-776bb572d493", "address": "fa:16:3e:86:66:f2", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59452b9-ad", "ovs_interfaceid": "d59452b9-ad23-4cfd-810a-776bb572d493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converting VIF {"id": "d59452b9-ad23-4cfd-810a-776bb572d493", "address": "fa:16:3e:86:66:f2", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59452b9-ad", "ovs_interfaceid": "d59452b9-ad23-4cfd-810a-776bb572d493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:66:f2,bridge_name='br-int',has_traffic_filtering=True,id=d59452b9-ad23-4cfd-810a-776bb572d493,network=Network(a1111cf3-2ce5-4e9c-a5d1-7468a768f08e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd59452b9-ad') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG os_vif [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:66:f2,bridge_name='br-int',has_traffic_filtering=True,id=d59452b9-ad23-4cfd-810a-776bb572d493,network=Network(a1111cf3-2ce5-4e9c-a5d1-7468a768f08e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd59452b9-ad') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd59452b9-ad, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea173f02-9874-489c-8c73-cfa56b2d1014) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:21 user nova-compute[74898]: INFO os_vif [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:66:f2,bridge_name='br-int',has_traffic_filtering=True,id=d59452b9-ad23-4cfd-810a-776bb572d493,network=Network(a1111cf3-2ce5-4e9c-a5d1-7468a768f08e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd59452b9-ad')
Nov 17 03:02:21 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759658847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759658847',id=10,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9l33pWbZQh9MlgJ0c526xiqvNHClwgljKX0oW5Ns00va7Ih1kDjLTORglU0E8d91/kOyn6EwD4XGWP+H2+9W1xPbcpyJIBbpTxN1SZ9Q8W3RAxUoEhXIJ97lxsaeV5EQ==',key_name='tempest-keypair-1177168277',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:00:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d06ab04c365d49639386a4c40620f735',ramdisk_id='',reservation_id='r-hg4z88r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1407862931',owner_user_name='tempest-TaggedBootDevicesTest-1407862931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:00:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c9a303c92cc4937a595f49417224e46',uuid=df13492d-d351-49c1-9755-7c30caae89f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e20d2c64-8b92-434c-84a4-d28453214349", "address": "fa:16:3e:e1:f4:1c", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape20d2c64-8b", "ovs_interfaceid": "e20d2c64-8b92-434c-84a4-d28453214349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converting VIF {"id": "e20d2c64-8b92-434c-84a4-d28453214349", "address": "fa:16:3e:e1:f4:1c", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape20d2c64-8b", "ovs_interfaceid": "e20d2c64-8b92-434c-84a4-d28453214349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f4:1c,bridge_name='br-int',has_traffic_filtering=True,id=e20d2c64-8b92-434c-84a4-d28453214349,network=Network(a1111cf3-2ce5-4e9c-a5d1-7468a768f08e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape20d2c64-8b') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG os_vif [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f4:1c,bridge_name='br-int',has_traffic_filtering=True,id=e20d2c64-8b92-434c-84a4-d28453214349,network=Network(a1111cf3-2ce5-4e9c-a5d1-7468a768f08e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape20d2c64-8b') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape20d2c64-8b, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=284b0abb-219d-43f5-abcc-3beb3967e6c5) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:22 user nova-compute[74898]: INFO os_vif [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f4:1c,bridge_name='br-int',has_traffic_filtering=True,id=e20d2c64-8b92-434c-84a4-d28453214349,network=Network(a1111cf3-2ce5-4e9c-a5d1-7468a768f08e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape20d2c64-8b')
Nov 17 03:02:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759658847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759658847',id=10,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9l33pWbZQh9MlgJ0c526xiqvNHClwgljKX0oW5Ns00va7Ih1kDjLTORglU0E8d91/kOyn6EwD4XGWP+H2+9W1xPbcpyJIBbpTxN1SZ9Q8W3RAxUoEhXIJ97lxsaeV5EQ==',key_name='tempest-keypair-1177168277',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:00:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d06ab04c365d49639386a4c40620f735',ramdisk_id='',reservation_id='r-hg4z88r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1407862931',owner_user_name='tempest-TaggedBootDevicesTest-1407862931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:00:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c9a303c92cc4937a595f49417224e46',uuid=df13492d-d351-49c1-9755-7c30caae89f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0003a9c-9202-4863-92aa-0fd29a026c8c", "address": "fa:16:3e:8f:4e:96", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0003a9c-92", "ovs_interfaceid": "e0003a9c-9202-4863-92aa-0fd29a026c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converting VIF {"id": "e0003a9c-9202-4863-92aa-0fd29a026c8c", "address": "fa:16:3e:8f:4e:96", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0003a9c-92", "ovs_interfaceid": "e0003a9c-9202-4863-92aa-0fd29a026c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4e:96,bridge_name='br-int',has_traffic_filtering=True,id=e0003a9c-9202-4863-92aa-0fd29a026c8c,network=Network(a1111cf3-2ce5-4e9c-a5d1-7468a768f08e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0003a9c-92') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_vif [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4e:96,bridge_name='br-int',has_traffic_filtering=True,id=e0003a9c-9202-4863-92aa-0fd29a026c8c,network=Network(a1111cf3-2ce5-4e9c-a5d1-7468a768f08e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0003a9c-92') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.502s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0003a9c-92, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c2556061-37d3-497d-872d-96869e76be4c) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:22 user nova-compute[74898]: INFO os_vif [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4e:96,bridge_name='br-int',has_traffic_filtering=True,id=e0003a9c-9202-4863-92aa-0fd29a026c8c,network=Network(a1111cf3-2ce5-4e9c-a5d1-7468a768f08e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0003a9c-92')
Nov 17 03:02:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759658847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759658847',id=10,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9l33pWbZQh9MlgJ0c526xiqvNHClwgljKX0oW5Ns00va7Ih1kDjLTORglU0E8d91/kOyn6EwD4XGWP+H2+9W1xPbcpyJIBbpTxN1SZ9Q8W3RAxUoEhXIJ97lxsaeV5EQ==',key_name='tempest-keypair-1177168277',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:00:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d06ab04c365d49639386a4c40620f735',ramdisk_id='',reservation_id='r-hg4z88r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1407862931',owner_user_name='tempest-TaggedBootDevicesTest-1407862931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:00:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c9a303c92cc4937a595f49417224e46',uuid=df13492d-d351-49c1-9755-7c30caae89f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "207857d3-8c12-4e4f-b934-c69ed1f92961", "address": "fa:16:3e:ca:ec:13", "network": {"id": "86a58fdf-5837-4342-b488-23f43f0c8db6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1066442327", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207857d3-8c", "ovs_interfaceid": "207857d3-8c12-4e4f-b934-c69ed1f92961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converting VIF {"id": "207857d3-8c12-4e4f-b934-c69ed1f92961", "address": "fa:16:3e:ca:ec:13", "network": {"id": "86a58fdf-5837-4342-b488-23f43f0c8db6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1066442327", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207857d3-8c", "ovs_interfaceid": "207857d3-8c12-4e4f-b934-c69ed1f92961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:ec:13,bridge_name='br-int',has_traffic_filtering=True,id=207857d3-8c12-4e4f-b934-c69ed1f92961,network=Network(86a58fdf-5837-4342-b488-23f43f0c8db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap207857d3-8c') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_vif [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:ec:13,bridge_name='br-int',has_traffic_filtering=True,id=207857d3-8c12-4e4f-b934-c69ed1f92961,network=Network(86a58fdf-5837-4342-b488-23f43f0c8db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap207857d3-8c') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap207857d3-8c, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fe2264f8-1b7e-4d22-af1d-01a5e3dad562) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:22 user nova-compute[74898]: INFO os_vif [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:ec:13,bridge_name='br-int',has_traffic_filtering=True,id=207857d3-8c12-4e4f-b934-c69ed1f92961,network=Network(86a58fdf-5837-4342-b488-23f43f0c8db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap207857d3-8c')
Nov 17 03:02:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759658847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759658847',id=10,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9l33pWbZQh9MlgJ0c526xiqvNHClwgljKX0oW5Ns00va7Ih1kDjLTORglU0E8d91/kOyn6EwD4XGWP+H2+9W1xPbcpyJIBbpTxN1SZ9Q8W3RAxUoEhXIJ97lxsaeV5EQ==',key_name='tempest-keypair-1177168277',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:00:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d06ab04c365d49639386a4c40620f735',ramdisk_id='',reservation_id='r-hg4z88r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1407862931',owner_user_name='tempest-TaggedBootDevicesTest-1407862931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:00:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c9a303c92cc4937a595f49417224e46',uuid=df13492d-d351-49c1-9755-7c30caae89f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b0aade1-07ec-4744-b85c-d71ff8e10663", "address": "fa:16:3e:07:d7:07", "network": {"id": "86a58fdf-5837-4342-b488-23f43f0c8db6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1066442327", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b0aade1-07", "ovs_interfaceid": "7b0aade1-07ec-4744-b85c-d71ff8e10663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converting VIF {"id": "7b0aade1-07ec-4744-b85c-d71ff8e10663", "address": "fa:16:3e:07:d7:07", "network": {"id": "86a58fdf-5837-4342-b488-23f43f0c8db6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1066442327", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b0aade1-07", "ovs_interfaceid": "7b0aade1-07ec-4744-b85c-d71ff8e10663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:d7:07,bridge_name='br-int',has_traffic_filtering=True,id=7b0aade1-07ec-4744-b85c-d71ff8e10663,network=Network(86a58fdf-5837-4342-b488-23f43f0c8db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b0aade1-07') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_vif [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:d7:07,bridge_name='br-int',has_traffic_filtering=True,id=7b0aade1-07ec-4744-b85c-d71ff8e10663,network=Network(86a58fdf-5837-4342-b488-23f43f0c8db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b0aade1-07') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG nova.compute.manager [req-493ec0a8-8d0c-4fc0-a0f8-8beb024cfdbd req-39d56af1-048c-4966-aed7-92a3f303647a service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-plugged-d59452b9-ad23-4cfd-810a-776bb572d493 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-493ec0a8-8d0c-4fc0-a0f8-8beb024cfdbd req-39d56af1-048c-4966-aed7-92a3f303647a service nova] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-493ec0a8-8d0c-4fc0-a0f8-8beb024cfdbd req-39d56af1-048c-4966-aed7-92a3f303647a service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-493ec0a8-8d0c-4fc0-a0f8-8beb024cfdbd req-39d56af1-048c-4966-aed7-92a3f303647a service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG nova.compute.manager [req-493ec0a8-8d0c-4fc0-a0f8-8beb024cfdbd req-39d56af1-048c-4966-aed7-92a3f303647a service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] No waiting events found dispatching network-vif-plugged-d59452b9-ad23-4cfd-810a-776bb572d493 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:02:22 user nova-compute[74898]: WARNING nova.compute.manager [req-493ec0a8-8d0c-4fc0-a0f8-8beb024cfdbd req-39d56af1-048c-4966-aed7-92a3f303647a service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received unexpected event network-vif-plugged-d59452b9-ad23-4cfd-810a-776bb572d493 for instance with vm_state active and task_state deleting.
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b0aade1-07, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=608c15a9-71db-421c-9f62-23e1bf1b118c) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:22 user nova-compute[74898]: INFO os_vif [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:d7:07,bridge_name='br-int',has_traffic_filtering=True,id=7b0aade1-07ec-4744-b85c-d71ff8e10663,network=Network(86a58fdf-5837-4342-b488-23f43f0c8db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b0aade1-07')
Nov 17 03:02:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVXlTDCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:02:22 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a269a15-a299-48ae-9e4c-cdd4108568b9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:02:22 user nova-compute[74898]: No targets found.
Nov 17 03:02:22 user nova-compute[74898]: iSNS:
Nov 17 03:02:22 user nova-compute[74898]: No targets found.
Nov 17 03:02:22 user nova-compute[74898]: STATIC:
Nov 17 03:02:22 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962
Nov 17 03:02:22 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:02:22 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:02:22 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1
Nov 17 03:02:22 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:02:22 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:02:22 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd
Nov 17 03:02:22 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:02:22 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:02:22 user nova-compute[74898]: FIRMWARE:
Nov 17 03:02:22 user nova-compute[74898]: No targets found.
Nov 17 03:02:22 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:02:22 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:02:22 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b77fb47-8d0d-47b1-adfc-091bc4e691cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c23072a-1637-44a8-bc6a-f74789cdd75c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:02:22 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:02:22 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:02:22 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 (non-flash)
Nov 17 03:02:22 user nova-compute[74898]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:02:22 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:02:22 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9c187df250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1'): ({'sdb'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Removing single pathed devices sdb {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[631fad36-56a8-405d-b216-a77b12f78ebf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60c925f-e311-4f53-afda-7a5c88d225be]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Flushing IO for device /dev/sdb {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[03453552-410a-42dd-85de-8bb994d3689e]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[41528032-69ef-4b6a-a12d-a5f09c39cc4c]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95b1ac0-3caa-46cd-b436-e562bab930de]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG nova.compute.manager [req-50672f36-60ea-4410-abcb-716aa33db307 req-d5730fb3-d075-4fe9-8d23-6d8d8e087bc8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-plugged-e0003a9c-9202-4863-92aa-0fd29a026c8c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-50672f36-60ea-4410-abcb-716aa33db307 req-d5730fb3-d075-4fe9-8d23-6d8d8e087bc8 service nova] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-50672f36-60ea-4410-abcb-716aa33db307 req-d5730fb3-d075-4fe9-8d23-6d8d8e087bc8 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-50672f36-60ea-4410-abcb-716aa33db307 req-d5730fb3-d075-4fe9-8d23-6d8d8e087bc8 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG nova.compute.manager [req-50672f36-60ea-4410-abcb-716aa33db307 req-d5730fb3-d075-4fe9-8d23-6d8d8e087bc8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] No waiting events found dispatching network-vif-plugged-e0003a9c-9202-4863-92aa-0fd29a026c8c {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:02:22 user nova-compute[74898]: WARNING nova.compute.manager [req-50672f36-60ea-4410-abcb-716aa33db307 req-d5730fb3-d075-4fe9-8d23-6d8d8e087bc8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received unexpected event network-vif-plugged-e0003a9c-9202-4863-92aa-0fd29a026c8c for instance with vm_state active and task_state deleting.
Nov 17 03:02:22 user nova-compute[74898]: DEBUG nova.compute.manager [req-50672f36-60ea-4410-abcb-716aa33db307 req-d5730fb3-d075-4fe9-8d23-6d8d8e087bc8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-unplugged-7b0aade1-07ec-4744-b85c-d71ff8e10663 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-50672f36-60ea-4410-abcb-716aa33db307 req-d5730fb3-d075-4fe9-8d23-6d8d8e087bc8 service nova] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-50672f36-60ea-4410-abcb-716aa33db307 req-d5730fb3-d075-4fe9-8d23-6d8d8e087bc8 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-50672f36-60ea-4410-abcb-716aa33db307 req-d5730fb3-d075-4fe9-8d23-6d8d8e087bc8 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG nova.compute.manager [req-50672f36-60ea-4410-abcb-716aa33db307 req-d5730fb3-d075-4fe9-8d23-6d8d8e087bc8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] No waiting events found dispatching network-vif-unplugged-7b0aade1-07ec-4744-b85c-d71ff8e10663 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG nova.compute.manager [req-50672f36-60ea-4410-abcb-716aa33db307 req-d5730fb3-d075-4fe9-8d23-6d8d8e087bc8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-unplugged-7b0aade1-07ec-4744-b85c-d71ff8e10663 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG nova.compute.manager [req-50672f36-60ea-4410-abcb-716aa33db307 req-d5730fb3-d075-4fe9-8d23-6d8d8e087bc8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-plugged-7b0aade1-07ec-4744-b85c-d71ff8e10663 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-50672f36-60ea-4410-abcb-716aa33db307 req-d5730fb3-d075-4fe9-8d23-6d8d8e087bc8 service nova] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-50672f36-60ea-4410-abcb-716aa33db307 req-d5730fb3-d075-4fe9-8d23-6d8d8e087bc8 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-50672f36-60ea-4410-abcb-716aa33db307 req-d5730fb3-d075-4fe9-8d23-6d8d8e087bc8 service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG nova.compute.manager [req-50672f36-60ea-4410-abcb-716aa33db307 req-d5730fb3-d075-4fe9-8d23-6d8d8e087bc8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] No waiting events found dispatching network-vif-plugged-7b0aade1-07ec-4744-b85c-d71ff8e10663 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:02:22 user nova-compute[74898]: WARNING nova.compute.manager [req-50672f36-60ea-4410-abcb-716aa33db307 req-d5730fb3-d075-4fe9-8d23-6d8d8e087bc8 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received unexpected event network-vif-plugged-7b0aade1-07ec-4744-b85c-d71ff8e10663 for instance with vm_state active and task_state deleting.
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7967aff3-ed14-4d01-9514-e79bef2889ed]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1, portal: 172.16.0.220,3260]
Nov 17 03:02:22 user nova-compute[74898]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1, portal: 172.16.0.220,3260] successful.
Nov 17 03:02:22 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35255e9c-5fd6-477f-818a-3fc7fbe655d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd630f2a-715d-410a-9605-c09443be519f]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] <== disconnect_volume: return (335ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pDoAKakF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:02:22 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a75190-1def-4433-87aa-c0c36d246add]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:02:22 user nova-compute[74898]: No targets found.
Nov 17 03:02:22 user nova-compute[74898]: iSNS:
Nov 17 03:02:22 user nova-compute[74898]: No targets found.
Nov 17 03:02:22 user nova-compute[74898]: STATIC:
Nov 17 03:02:22 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962
Nov 17 03:02:22 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:02:22 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:02:22 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd
Nov 17 03:02:22 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:02:22 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:02:22 user nova-compute[74898]: FIRMWARE:
Nov 17 03:02:22 user nova-compute[74898]: No targets found.
Nov 17 03:02:22 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:02:22 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:02:22 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e17dc4-4494-49fc-aaab-74571fdc6909]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Acquiring lock "36e687c0-9481-4126-b365-f7f9707e2338" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "36e687c0-9481-4126-b365-f7f9707e2338" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG nova.compute.manager [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[839bfdd9-be56-4d38-980f-80dec7121909]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:02:22 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:02:22 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd (non-flash)
Nov 17 03:02:22 user nova-compute[74898]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:02:22 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9c187dda20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd'): ({'sdc'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Removing single pathed devices sdc {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5dd0eb-3eb0-4c78-86eb-4c0aa6d6701c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c6feb3-fd34-4b90-8cac-dcac9793e15b]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Flushing IO for device /dev/sdc {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[67820f84-124e-4a80-bcfe-6c0f2893a40f]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:02:22 user nova-compute[74898]: INFO nova.compute.claims [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Claim successful on node user
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[838a76eb-1f37-4e6b-9166-bb4ee60f1961]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] SCSI volumes sdc have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b351a7-c6cd-479f-a460-b968eacd587a]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2bf614-b621-47da-b04c-f83ddd29dcff]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd, portal: 172.16.0.220,3260]
Nov 17 03:02:22 user nova-compute[74898]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd, portal: 172.16.0.220,3260] successful.
Nov 17 03:02:22 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e40fe2-9d7f-4715-969a-be06e02bf1cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[740c6209-df18-41bb-9295-7851099f8824]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] <== disconnect_volume: return (315ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnAIxhtL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:02:22 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd975d8-01fe-41bf-aff5-0b82df91cea1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:02:22 user nova-compute[74898]: No targets found.
Nov 17 03:02:22 user nova-compute[74898]: iSNS:
Nov 17 03:02:22 user nova-compute[74898]: No targets found.
Nov 17 03:02:22 user nova-compute[74898]: STATIC:
Nov 17 03:02:22 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962
Nov 17 03:02:22 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:02:22 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:02:22 user nova-compute[74898]: FIRMWARE:
Nov 17 03:02:22 user nova-compute[74898]: No targets found.
Nov 17 03:02:22 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:02:22 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:02:22 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d718b2bc-f08b-4e7c-8b4c-4a4e9739b71e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa76ca3-3b0d-416a-884b-edfb6433bee5]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:02:22 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 (non-flash)
Nov 17 03:02:22 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf86981f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962'): ({'sdd'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Removing single pathed devices sdd {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:02:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4838f7b9-5fe6-4857-b823-add9a434642f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6922a7-5d9d-46d1-b4b8-a5a2b521953d]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Flushing IO for device /dev/sdd {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5ac3cc-1850-4dfd-bc34-0d42602a7fab]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83443d8-48b0-4e7d-bb85-409b7fcc53eb]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] SCSI volumes sdd have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e95b76-771c-476f-8d81-c2c21ccbc709]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7106c7c-c54e-4544-9613-5ac206ed1e9d]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962, portal: 172.16.0.220,3260]
Nov 17 03:02:23 user nova-compute[74898]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962, portal: 172.16.0.220,3260] successful.
Nov 17 03:02:23 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dee1ebf2-c6ab-4269-9c9a-68cb23c8a962 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f16e6e-6c9a-4fca-87f9-0ebbc1adbb09]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] <== disconnect_volume: return (279ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:02:23 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Deleting instance files /opt/stack/data/nova/instances/df13492d-d351-49c1-9755-7c30caae89f1_del
Nov 17 03:02:23 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Deletion of /opt/stack/data/nova/instances/df13492d-d351-49c1-9755-7c30caae89f1_del complete
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG nova.compute.manager [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:02:23 user nova-compute[74898]: INFO nova.compute.manager [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Took 3.79 seconds to destroy the instance on the hypervisor.
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: df13492d-d351-49c1-9755-7c30caae89f1] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG nova.compute.manager [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG nova.network.neutron [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:02:23 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:02:23 user nova-compute[74898]: DEBUG nova.compute.manager [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG nova.policy [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dbc18ee9aea24d6db4a9a71f4cf2d723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ed77effbea441eb58507f436033c3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:02:23 user nova-compute[74898]: INFO nova.virt.block_device [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Booting with volume 637a8d80-8ef7-46f9-806c-cb8fdf7699c4 at /dev/vda
Nov 17 03:02:23 user nova-compute[74898]: DEBUG os_brick.utils [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffc939a-01f3-492f-aa96-35f046ffd0e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1c2aff-96ac-49fa-a1ff-a12f1e27c60b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d7344f-8dca-483e-accf-7642be500436]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7520740d-0f48-4dc7-8b50-c6bdfcb3bcc8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:02:23 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1a2542-ed65-446a-99a7-a4db2d7de4bb]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG os_brick.utils [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Updating existing volume attachment record: ee958740-a709-4462-b66e-3748205212f2 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG nova.compute.manager [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-plugged-33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG nova.compute.manager [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] No waiting events found dispatching network-vif-plugged-33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:02:23 user nova-compute[74898]: WARNING nova.compute.manager [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received unexpected event network-vif-plugged-33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5 for instance with vm_state active and task_state deleting.
Nov 17 03:02:23 user nova-compute[74898]: DEBUG nova.compute.manager [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-unplugged-c1a0a6a3-d445-4e76-b6ca-1183ae4b724f {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG nova.compute.manager [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] No waiting events found dispatching network-vif-unplugged-c1a0a6a3-d445-4e76-b6ca-1183ae4b724f {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG nova.compute.manager [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-unplugged-c1a0a6a3-d445-4e76-b6ca-1183ae4b724f for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG nova.compute.manager [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-plugged-c1a0a6a3-d445-4e76-b6ca-1183ae4b724f {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG nova.compute.manager [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] No waiting events found dispatching network-vif-plugged-c1a0a6a3-d445-4e76-b6ca-1183ae4b724f {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:02:23 user nova-compute[74898]: WARNING nova.compute.manager [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received unexpected event network-vif-plugged-c1a0a6a3-d445-4e76-b6ca-1183ae4b724f for instance with vm_state active and task_state deleting.
Nov 17 03:02:23 user nova-compute[74898]: DEBUG nova.compute.manager [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-unplugged-e20d2c64-8b92-434c-84a4-d28453214349 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG nova.compute.manager [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] No waiting events found dispatching network-vif-unplugged-e20d2c64-8b92-434c-84a4-d28453214349 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG nova.compute.manager [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-unplugged-e20d2c64-8b92-434c-84a4-d28453214349 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG nova.compute.manager [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-plugged-e20d2c64-8b92-434c-84a4-d28453214349 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG nova.compute.manager [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] No waiting events found dispatching network-vif-plugged-e20d2c64-8b92-434c-84a4-d28453214349 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:02:23 user nova-compute[74898]: WARNING nova.compute.manager [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received unexpected event network-vif-plugged-e20d2c64-8b92-434c-84a4-d28453214349 for instance with vm_state active and task_state deleting.
Nov 17 03:02:23 user nova-compute[74898]: DEBUG nova.compute.manager [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-unplugged-207857d3-8c12-4e4f-b934-c69ed1f92961 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG nova.compute.manager [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] No waiting events found dispatching network-vif-unplugged-207857d3-8c12-4e4f-b934-c69ed1f92961 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG nova.compute.manager [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-unplugged-207857d3-8c12-4e4f-b934-c69ed1f92961 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG nova.compute.manager [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-plugged-207857d3-8c12-4e4f-b934-c69ed1f92961 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] Acquiring lock "df13492d-d351-49c1-9755-7c30caae89f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] Lock "df13492d-d351-49c1-9755-7c30caae89f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:23 user nova-compute[74898]: DEBUG nova.compute.manager [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] No waiting events found dispatching network-vif-plugged-207857d3-8c12-4e4f-b934-c69ed1f92961 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:02:23 user nova-compute[74898]: WARNING nova.compute.manager [req-9e016725-0a78-4260-a6e4-87b0d7f10a5a req-e71103e9-5c1a-4db4-9cfa-d50b7afce1ad service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received unexpected event network-vif-plugged-207857d3-8c12-4e4f-b934-c69ed1f92961 for instance with vm_state active and task_state deleting.
Nov 17 03:02:23 user nova-compute[74898]: DEBUG nova.network.neutron [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Successfully created port: 5415aaa1-723f-4f35-971c-509caa04575d {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:02:24 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:02:24 user nova-compute[74898]: DEBUG nova.network.neutron [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Successfully updated port: 5415aaa1-723f-4f35-971c-509caa04575d {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:02:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Acquiring lock "refresh_cache-36e687c0-9481-4126-b365-f7f9707e2338" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:02:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Acquired lock "refresh_cache-36e687c0-9481-4126-b365-f7f9707e2338" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:02:24 user nova-compute[74898]: DEBUG nova.network.neutron [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:02:24 user nova-compute[74898]: DEBUG nova.compute.manager [req-7158467a-fc02-419a-90ca-f0a56c8fdc7e req-ed7b6e17-e494-4f88-9151-aee3450079dd service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Received event network-changed-5415aaa1-723f-4f35-971c-509caa04575d {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:24 user nova-compute[74898]: DEBUG nova.compute.manager [req-7158467a-fc02-419a-90ca-f0a56c8fdc7e req-ed7b6e17-e494-4f88-9151-aee3450079dd service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Refreshing instance network info cache due to event network-changed-5415aaa1-723f-4f35-971c-509caa04575d. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:02:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7158467a-fc02-419a-90ca-f0a56c8fdc7e req-ed7b6e17-e494-4f88-9151-aee3450079dd service nova] Acquiring lock "refresh_cache-36e687c0-9481-4126-b365-f7f9707e2338" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:02:24 user nova-compute[74898]: DEBUG nova.network.neutron [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:02:24 user nova-compute[74898]: DEBUG nova.network.neutron [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Updating instance_info_cache with network_info: [{"id": "5415aaa1-723f-4f35-971c-509caa04575d", "address": "fa:16:3e:6f:9f:8e", "network": {"id": "4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-545743352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ed77effbea441eb58507f436033c3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5415aaa1-72", "ovs_interfaceid": "5415aaa1-723f-4f35-971c-509caa04575d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:02:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Releasing lock "refresh_cache-36e687c0-9481-4126-b365-f7f9707e2338" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:02:24 user nova-compute[74898]: DEBUG nova.compute.manager [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Instance network_info: |[{"id": "5415aaa1-723f-4f35-971c-509caa04575d", "address": "fa:16:3e:6f:9f:8e", "network": {"id": "4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-545743352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ed77effbea441eb58507f436033c3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5415aaa1-72", "ovs_interfaceid": "5415aaa1-723f-4f35-971c-509caa04575d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:02:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7158467a-fc02-419a-90ca-f0a56c8fdc7e req-ed7b6e17-e494-4f88-9151-aee3450079dd service nova] Acquired lock "refresh_cache-36e687c0-9481-4126-b365-f7f9707e2338" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:02:24 user nova-compute[74898]: DEBUG nova.network.neutron [req-7158467a-fc02-419a-90ca-f0a56c8fdc7e req-ed7b6e17-e494-4f88-9151-aee3450079dd service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Refreshing network info cache for port 5415aaa1-723f-4f35-971c-509caa04575d {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:02:25 user nova-compute[74898]: DEBUG nova.compute.manager [req-4d18003a-5372-4ac5-ad78-a9f69623f82f req-2b3ccfde-5cc6-45ca-9fb5-2bd9d7bfb549 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-deleted-33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:25 user nova-compute[74898]: INFO nova.compute.manager [req-4d18003a-5372-4ac5-ad78-a9f69623f82f req-2b3ccfde-5cc6-45ca-9fb5-2bd9d7bfb549 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Neutron deleted interface 33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5; detaching it from the instance and deleting it from the info cache
Nov 17 03:02:25 user nova-compute[74898]: DEBUG nova.network.neutron [req-4d18003a-5372-4ac5-ad78-a9f69623f82f req-2b3ccfde-5cc6-45ca-9fb5-2bd9d7bfb549 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Updating instance_info_cache with network_info: [{"id": "c1a0a6a3-d445-4e76-b6ca-1183ae4b724f", "address": "fa:16:3e:6d:37:0c", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a0a6a3-d4", "ovs_interfaceid": "c1a0a6a3-d445-4e76-b6ca-1183ae4b724f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d59452b9-ad23-4cfd-810a-776bb572d493", "address": "fa:16:3e:86:66:f2", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59452b9-ad", "ovs_interfaceid": "d59452b9-ad23-4cfd-810a-776bb572d493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e20d2c64-8b92-434c-84a4-d28453214349", "address": "fa:16:3e:e1:f4:1c", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape20d2c64-8b", "ovs_interfaceid": "e20d2c64-8b92-434c-84a4-d28453214349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0003a9c-9202-4863-92aa-0fd29a026c8c", "address": "fa:16:3e:8f:4e:96", "network": {"id": "a1111cf3-2ce5-4e9c-a5d1-7468a768f08e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2089013950", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0003a9c-92", "ovs_interfaceid": "e0003a9c-9202-4863-92aa-0fd29a026c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "207857d3-8c12-4e4f-b934-c69ed1f92961", "address": "fa:16:3e:ca:ec:13", "network": {"id": "86a58fdf-5837-4342-b488-23f43f0c8db6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1066442327", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207857d3-8c", "ovs_interfaceid": "207857d3-8c12-4e4f-b934-c69ed1f92961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b0aade1-07ec-4744-b85c-d71ff8e10663", "address": "fa:16:3e:07:d7:07", "network": {"id": "86a58fdf-5837-4342-b488-23f43f0c8db6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1066442327", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d06ab04c365d49639386a4c40620f735", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b0aade1-07", "ovs_interfaceid": "7b0aade1-07ec-4744-b85c-d71ff8e10663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:02:25 user nova-compute[74898]: DEBUG nova.network.neutron [req-7158467a-fc02-419a-90ca-f0a56c8fdc7e req-ed7b6e17-e494-4f88-9151-aee3450079dd service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Updated VIF entry in instance network info cache for port 5415aaa1-723f-4f35-971c-509caa04575d. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:02:25 user nova-compute[74898]: DEBUG nova.network.neutron [req-7158467a-fc02-419a-90ca-f0a56c8fdc7e req-ed7b6e17-e494-4f88-9151-aee3450079dd service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Updating instance_info_cache with network_info: [{"id": "5415aaa1-723f-4f35-971c-509caa04575d", "address": "fa:16:3e:6f:9f:8e", "network": {"id": "4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-545743352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ed77effbea441eb58507f436033c3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5415aaa1-72", "ovs_interfaceid": "5415aaa1-723f-4f35-971c-509caa04575d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:02:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7158467a-fc02-419a-90ca-f0a56c8fdc7e req-ed7b6e17-e494-4f88-9151-aee3450079dd service nova] Releasing lock "refresh_cache-36e687c0-9481-4126-b365-f7f9707e2338" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:02:25 user nova-compute[74898]: DEBUG nova.compute.manager [req-4d18003a-5372-4ac5-ad78-a9f69623f82f req-2b3ccfde-5cc6-45ca-9fb5-2bd9d7bfb549 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Detach interface failed, port_id=33c1e7b3-fb7d-42e7-9b9c-a4afbd9351b5, reason: Instance df13492d-d351-49c1-9755-7c30caae89f1 could not be found. {{(pid=74898) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:02:27 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Took 3.77 seconds to deallocate network for instance.
Nov 17 03:02:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Acquiring lock "4b869a55-acf6-4550-9354-2480273a4ee2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "4b869a55-acf6-4550-9354-2480273a4ee2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG nova.objects.instance [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lazy-loading 'flavor' on Instance uuid 4b869a55-acf6-4550-9354-2480273a4ee2 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "4b869a55-acf6-4550-9354-2480273a4ee2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Acquiring lock "4b869a55-acf6-4550-9354-2480273a4ee2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "4b869a55-acf6-4550-9354-2480273a4ee2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:27 user nova-compute[74898]: INFO nova.compute.manager [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Attaching volume a634de04-148d-4da4-816d-617343087019 to /dev/vdb
Nov 17 03:02:27 user nova-compute[74898]: DEBUG os_brick.utils [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ffdcdf-6de9-4c34-b8ac-6bb2610c5422]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9028257f-2ec8-4339-835d-d81008d040c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e4fe43-1e61-4138-b91e-40097a344b25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c5366e-f2e1-420d-9aab-3f024c8f4826]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:02:27 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:02:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac01399-e701-4858-8551-88ccbb361411]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG os_brick.utils [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Updating existing volume attachment record: da1d5c9a-0100-42c1-849d-1804bbf4e177 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG nova.compute.manager [req-1e8e06a5-4f01-4efc-ad16-57d0355b1d77 req-0c570e6e-764b-4c11-b146-39118df0ef97 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-deleted-e20d2c64-8b92-434c-84a4-d28453214349 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG nova.compute.manager [req-1e8e06a5-4f01-4efc-ad16-57d0355b1d77 req-0c570e6e-764b-4c11-b146-39118df0ef97 service nova] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Received event network-changed-edcbb515-e95f-4dee-a4be-ca8b4e2191c4 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG nova.compute.manager [req-1e8e06a5-4f01-4efc-ad16-57d0355b1d77 req-0c570e6e-764b-4c11-b146-39118df0ef97 service nova] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Refreshing instance network info cache due to event network-changed-edcbb515-e95f-4dee-a4be-ca8b4e2191c4. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1e8e06a5-4f01-4efc-ad16-57d0355b1d77 req-0c570e6e-764b-4c11-b146-39118df0ef97 service nova] Acquiring lock "refresh_cache-4b869a55-acf6-4550-9354-2480273a4ee2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1e8e06a5-4f01-4efc-ad16-57d0355b1d77 req-0c570e6e-764b-4c11-b146-39118df0ef97 service nova] Acquired lock "refresh_cache-4b869a55-acf6-4550-9354-2480273a4ee2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG nova.network.neutron [req-1e8e06a5-4f01-4efc-ad16-57d0355b1d77 req-0c570e6e-764b-4c11-b146-39118df0ef97 service nova] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Refreshing network info cache for port edcbb515-e95f-4dee-a4be-ca8b4e2191c4 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG nova.network.neutron [req-1e8e06a5-4f01-4efc-ad16-57d0355b1d77 req-0c570e6e-764b-4c11-b146-39118df0ef97 service nova] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Updated VIF entry in instance network info cache for port edcbb515-e95f-4dee-a4be-ca8b4e2191c4. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG nova.network.neutron [req-1e8e06a5-4f01-4efc-ad16-57d0355b1d77 req-0c570e6e-764b-4c11-b146-39118df0ef97 service nova] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Updating instance_info_cache with network_info: [{"id": "edcbb515-e95f-4dee-a4be-ca8b4e2191c4", "address": "fa:16:3e:cd:e9:3a", "network": {"id": "d0089735-d511-4277-92cc-f97083a06ac5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1908721109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd898b2b6f76441aa5cc13fd96d668f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedcbb515-e9", "ovs_interfaceid": "edcbb515-e95f-4dee-a4be-ca8b4e2191c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1e8e06a5-4f01-4efc-ad16-57d0355b1d77 req-0c570e6e-764b-4c11-b146-39118df0ef97 service nova] Releasing lock "refresh_cache-4b869a55-acf6-4550-9354-2480273a4ee2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG nova.compute.manager [req-1e8e06a5-4f01-4efc-ad16-57d0355b1d77 req-0c570e6e-764b-4c11-b146-39118df0ef97 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-deleted-7b0aade1-07ec-4744-b85c-d71ff8e10663 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG nova.compute.manager [req-1e8e06a5-4f01-4efc-ad16-57d0355b1d77 req-0c570e6e-764b-4c11-b146-39118df0ef97 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-deleted-e0003a9c-9202-4863-92aa-0fd29a026c8c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:27 user nova-compute[74898]: DEBUG nova.compute.manager [req-1e8e06a5-4f01-4efc-ad16-57d0355b1d77 req-0c570e6e-764b-4c11-b146-39118df0ef97 service nova] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Received event network-vif-deleted-207857d3-8c12-4e4f-b934-c69ed1f92961 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG nova.compute.manager [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:02:29 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Creating image(s)
Nov 17 03:02:29 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Did not create local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Ensure instance console log exists: /opt/stack/data/nova/instances/36e687c0-9481-4126-b365-f7f9707e2338/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Start _get_guest_xml network_info=[{"id": "5415aaa1-723f-4f35-971c-509caa04575d", "address": "fa:16:3e:6f:9f:8e", "network": {"id": "4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-545743352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ed77effbea441eb58507f436033c3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5415aaa1-72", "ovs_interfaceid": "5415aaa1-723f-4f35-971c-509caa04575d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFdrlUym', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '36e687c0-9481-4126-b365-f7f9707e2338', 'attached_at': '', 'detached_at': '', 'volume_id': '637a8d80-8ef7-46f9-806c-cb8fdf7699c4', 'serial': '637a8d80-8ef7-46f9-806c-cb8fdf7699c4'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'ee958740-a709-4462-b66e-3748205212f2', 'volume_type': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:02:29 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:02:29 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:02:29 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFdrlUym', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:02:29 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:02:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:02:29 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:02:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:02:29 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a199767b-4233-40c1-9d6b-21494027b3f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:02:29 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f96816b-3f3f-462c-8756-c83c5737932b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4] added
Nov 17 03:02:29 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf11e79-80a7-4f8b-b20f-aa9ae1261941]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:29 user nova-compute[74898]: INFO nova.compute.manager [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] [instance: df13492d-d351-49c1-9755-7c30caae89f1] Took 2.27 seconds to detach 3 volumes for instance.
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f077e3-09a9-4f3a-a765-92d67abbcbc1]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kFdrlUym {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kFdrlUym" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[58472bb3-944b-4e94-88d4-57b68f7d33ee]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kFdrlUym'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c560a6ea-adc6-4520-86d3-cfa730e0ab81]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc293a3-6724-42f8-867c-2c17e4b15e50]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 17 03:02:29 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 17 03:02:29 user nova-compute[74898]:  {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:02:29 user nova-compute[74898]: WARNING os_brick.initiator.connectors.iscsi [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 17 03:02:29 user nova-compute[74898]: 
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08a75e8-8aa1-4f89-a4f8-691c51155e32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4, portal: 172.16.0.220,3260]
Nov 17 03:02:29 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4, portal: 172.16.0.220,3260] successful.
Nov 17 03:02:29 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b385e6b-7789-42d6-b6c7-5c2099b91a3c]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[43367db5-5c6f-4edb-bb99-40b0375b399b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:02:29 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:02:29 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cdfcc0-ae5b-4a6b-8e2d-7d86b410c16c]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFdrlUym', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:02:29 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Waiting for libvirt event about the detach of device tap91e750ca-9d with device alias net1 from instance b886ada4-5bcb-4b2a-b69e-80edefdd2119 is timed out.
Nov 17 03:02:29 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:31:0f:fd"/><model type="virtio"/><mtu size="1442"/><target dev="tap91e750ca-9d"/></interface> {{(pid=74898) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:31:0f:fd"/><model type="virtio"/><mtu size="1442"/><target dev="tap91e750ca-9d"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 17 03:02:29 user nova-compute[74898]:   <name>instance-00000007</name>
Nov 17 03:02:29 user nova-compute[74898]:   <uuid>b886ada4-5bcb-4b2a-b69e-80edefdd2119</uuid>
Nov 17 03:02:29 user nova-compute[74898]:   <metadata>
Nov 17 03:02:29 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:02:29 user nova-compute[74898]:   <nova:package version="0.0.0"/>
Nov 17 03:02:29 user nova-compute[74898]:   <nova:name>tempest-device-tagging-server-1059772796</nova:name>
Nov 17 03:02:29 user nova-compute[74898]:   <nova:creationTime>2023-11-17 03:01:37</nova:creationTime>
Nov 17 03:02:29 user nova-compute[74898]:   <nova:flavor name="m1.tiny">
Nov 17 03:02:29 user nova-compute[74898]:     <nova:memory>512</nova:memory>
Nov 17 03:02:29 user nova-compute[74898]:     <nova:disk>1</nova:disk>
Nov 17 03:02:29 user nova-compute[74898]:     <nova:swap>0</nova:swap>
Nov 17 03:02:29 user nova-compute[74898]:     <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:02:29 user nova-compute[74898]:     <nova:vcpus>1</nova:vcpus>
Nov 17 03:02:29 user nova-compute[74898]:   </nova:flavor>
Nov 17 03:02:29 user nova-compute[74898]:   <nova:owner>
Nov 17 03:02:29 user nova-compute[74898]:     <nova:user uuid="f7c4ed2ec81a411c95b2be4dcfb9859d">tempest-TaggedAttachmentsTest-1966129795-project-member</nova:user>
Nov 17 03:02:29 user nova-compute[74898]:     <nova:project uuid="8c45541cf5bd44c2a34d5a31f04e2a2a">tempest-TaggedAttachmentsTest-1966129795</nova:project>
Nov 17 03:02:29 user nova-compute[74898]:   </nova:owner>
Nov 17 03:02:29 user nova-compute[74898]:   <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:02:29 user nova-compute[74898]:   <nova:ports>
Nov 17 03:02:29 user nova-compute[74898]:     <nova:port uuid="bd3b73ca-0068-42f4-8cf3-f84932dee960">
Nov 17 03:02:29 user nova-compute[74898]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 17 03:02:29 user nova-compute[74898]:     </nova:port>
Nov 17 03:02:29 user nova-compute[74898]:     <nova:port uuid="91e750ca-9d66-4a01-927f-43eace319a06">
Nov 17 03:02:29 user nova-compute[74898]:       <nova:ip type="fixed" address="10.10.10.218" ipVersion="4"/>
Nov 17 03:02:29 user nova-compute[74898]:     </nova:port>
Nov 17 03:02:29 user nova-compute[74898]:   </nova:ports>
Nov 17 03:02:29 user nova-compute[74898]: </nova:instance>
Nov 17 03:02:29 user nova-compute[74898]:   </metadata>
Nov 17 03:02:29 user nova-compute[74898]:   <memory unit='KiB'>524288</memory>
Nov 17 03:02:29 user nova-compute[74898]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 17 03:02:29 user nova-compute[74898]:   <vcpu placement='static'>1</vcpu>
Nov 17 03:02:29 user nova-compute[74898]:   <resource>
Nov 17 03:02:29 user nova-compute[74898]:     <partition>/machine</partition>
Nov 17 03:02:29 user nova-compute[74898]:   </resource>
Nov 17 03:02:29 user nova-compute[74898]:   <sysinfo type='smbios'>
Nov 17 03:02:29 user nova-compute[74898]:     <system>
Nov 17 03:02:29 user nova-compute[74898]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 17 03:02:29 user nova-compute[74898]:       <entry name='product'>OpenStack Nova</entry>
Nov 17 03:02:29 user nova-compute[74898]:       <entry name='version'>0.0.0</entry>
Nov 17 03:02:29 user nova-compute[74898]:       <entry name='serial'>b886ada4-5bcb-4b2a-b69e-80edefdd2119</entry>
Nov 17 03:02:29 user nova-compute[74898]:       <entry name='uuid'>b886ada4-5bcb-4b2a-b69e-80edefdd2119</entry>
Nov 17 03:02:29 user nova-compute[74898]:       <entry name='family'>Virtual Machine</entry>
Nov 17 03:02:29 user nova-compute[74898]:     </system>
Nov 17 03:02:29 user nova-compute[74898]:   </sysinfo>
Nov 17 03:02:29 user nova-compute[74898]:   <os>
Nov 17 03:02:29 user nova-compute[74898]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 17 03:02:29 user nova-compute[74898]:     <boot dev='hd'/>
Nov 17 03:02:29 user nova-compute[74898]:     <smbios mode='sysinfo'/>
Nov 17 03:02:29 user nova-compute[74898]:   </os>
Nov 17 03:02:29 user nova-compute[74898]:   <features>
Nov 17 03:02:29 user nova-compute[74898]:     <acpi/>
Nov 17 03:02:29 user nova-compute[74898]:     <apic/>
Nov 17 03:02:29 user nova-compute[74898]:     <vmcoreinfo state='on'/>
Nov 17 03:02:29 user nova-compute[74898]:   </features>
Nov 17 03:02:29 user nova-compute[74898]:   <cpu mode='custom' match='exact' check='full'>
Nov 17 03:02:29 user nova-compute[74898]:     <model fallback='forbid'>Nehalem</model>
Nov 17 03:02:29 user nova-compute[74898]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 17 03:02:29 user nova-compute[74898]:     <feature policy='require' name='vme'/>
Nov 17 03:02:29 user nova-compute[74898]:     <feature policy='require' name='x2apic'/>
Nov 17 03:02:29 user nova-compute[74898]:     <feature policy='require' name='hypervisor'/>
Nov 17 03:02:29 user nova-compute[74898]:   </cpu>
Nov 17 03:02:29 user nova-compute[74898]:   <clock offset='utc'>
Nov 17 03:02:29 user nova-compute[74898]:     <timer name='pit' tickpolicy='delay'/>
Nov 17 03:02:29 user nova-compute[74898]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 17 03:02:29 user nova-compute[74898]:     <timer name='hpet' present='no'/>
Nov 17 03:02:29 user nova-compute[74898]:   </clock>
Nov 17 03:02:29 user nova-compute[74898]:   <on_poweroff>destroy</on_poweroff>
Nov 17 03:02:29 user nova-compute[74898]:   <on_reboot>restart</on_reboot>
Nov 17 03:02:29 user nova-compute[74898]:   <on_crash>destroy</on_crash>
Nov 17 03:02:29 user nova-compute[74898]:   <devices>
Nov 17 03:02:29 user nova-compute[74898]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 17 03:02:29 user nova-compute[74898]:     <disk type='file' device='disk'>
Nov 17 03:02:29 user nova-compute[74898]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 17 03:02:29 user nova-compute[74898]:       <source file='/opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk' index='2'/>
Nov 17 03:02:29 user nova-compute[74898]:       <backingStore type='file' index='3'>
Nov 17 03:02:29 user nova-compute[74898]:         <format type='raw'/>
Nov 17 03:02:29 user nova-compute[74898]:         <source file='/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372'/>
Nov 17 03:02:29 user nova-compute[74898]:         <backingStore/>
Nov 17 03:02:29 user nova-compute[74898]:       </backingStore>
Nov 17 03:02:29 user nova-compute[74898]:       <target dev='vda' bus='virtio'/>
Nov 17 03:02:29 user nova-compute[74898]:       <alias name='virtio-disk0'/>
Nov 17 03:02:29 user nova-compute[74898]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 17 03:02:29 user nova-compute[74898]:     </disk>
Nov 17 03:02:29 user nova-compute[74898]:     <disk type='file' device='cdrom'>
Nov 17 03:02:29 user nova-compute[74898]:       <driver name='qemu' type='raw' cache='none'/>
Nov 17 03:02:29 user nova-compute[74898]:       <source file='/opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk.config' index='1'/>
Nov 17 03:02:29 user nova-compute[74898]:       <backingStore/>
Nov 17 03:02:29 user nova-compute[74898]:       <target dev='hda' bus='ide'/>
Nov 17 03:02:29 user nova-compute[74898]:       <readonly/>
Nov 17 03:02:29 user nova-compute[74898]:       <alias name='ide0-0-0'/>
Nov 17 03:02:29 user nova-compute[74898]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 17 03:02:29 user nova-compute[74898]:     </disk>
Nov 17 03:02:29 user nova-compute[74898]:     <controller type='usb' index='0' model='none'>
Nov 17 03:02:29 user nova-compute[74898]:       <alias name='usb'/>
Nov 17 03:02:29 user nova-compute[74898]:     </controller>
Nov 17 03:02:29 user nova-compute[74898]:     <controller type='pci' index='0' model='pci-root'>
Nov 17 03:02:29 user nova-compute[74898]:       <alias name='pci.0'/>
Nov 17 03:02:29 user nova-compute[74898]:     </controller>
Nov 17 03:02:29 user nova-compute[74898]:     <controller type='ide' index='0'>
Nov 17 03:02:29 user nova-compute[74898]:       <alias name='ide'/>
Nov 17 03:02:29 user nova-compute[74898]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 17 03:02:29 user nova-compute[74898]:     </controller>
Nov 17 03:02:29 user nova-compute[74898]:     <interface type='ethernet'>
Nov 17 03:02:29 user nova-compute[74898]:       <mac address='fa:16:3e:2d:e6:07'/>
Nov 17 03:02:29 user nova-compute[74898]:       <target dev='tapbd3b73ca-00'/>
Nov 17 03:02:29 user nova-compute[74898]:       <model type='virtio'/>
Nov 17 03:02:29 user nova-compute[74898]:       <mtu size='1442'/>
Nov 17 03:02:29 user nova-compute[74898]:       <alias name='net0'/>
Nov 17 03:02:29 user nova-compute[74898]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 17 03:02:29 user nova-compute[74898]:     </interface>
Nov 17 03:02:29 user nova-compute[74898]:     <serial type='pty'>
Nov 17 03:02:29 user nova-compute[74898]:       <source path='/dev/pts/6'/>
Nov 17 03:02:29 user nova-compute[74898]:       <log file='/opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/console.log' append='off'/>
Nov 17 03:02:29 user nova-compute[74898]:       <target type='isa-serial' port='0'>
Nov 17 03:02:29 user nova-compute[74898]:         <model name='isa-serial'/>
Nov 17 03:02:29 user nova-compute[74898]:       </target>
Nov 17 03:02:29 user nova-compute[74898]:       <alias name='serial0'/>
Nov 17 03:02:29 user nova-compute[74898]:     </serial>
Nov 17 03:02:29 user nova-compute[74898]:     <console type='pty' tty='/dev/pts/6'>
Nov 17 03:02:29 user nova-compute[74898]:       <source path='/dev/pts/6'/>
Nov 17 03:02:29 user nova-compute[74898]:       <log file='/opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/console.log' append='off'/>
Nov 17 03:02:29 user nova-compute[74898]:       <target type='serial' port='0'/>
Nov 17 03:02:29 user nova-compute[74898]:       <alias name='serial0'/>
Nov 17 03:02:29 user nova-compute[74898]:     </console>
Nov 17 03:02:29 user nova-compute[74898]:     <input type='mouse' bus='ps2'>
Nov 17 03:02:29 user nova-compute[74898]:       <alias name='input0'/>
Nov 17 03:02:29 user nova-compute[74898]:     </input>
Nov 17 03:02:29 user nova-compute[74898]:     <input type='keyboard' bus='ps2'>
Nov 17 03:02:29 user nova-compute[74898]:       <alias name='input1'/>
Nov 17 03:02:29 user nova-compute[74898]:     </input>
Nov 17 03:02:29 user nova-compute[74898]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 17 03:02:29 user nova-compute[74898]:       <listen type='address' address='0.0.0.0'/>
Nov 17 03:02:29 user nova-compute[74898]:     </graphics>
Nov 17 03:02:29 user nova-compute[74898]:     <audio id='1' type='none'/>
Nov 17 03:02:29 user nova-compute[74898]:     <video>
Nov 17 03:02:29 user nova-compute[74898]:       <model type='virtio' heads='1' primary='yes'/>
Nov 17 03:02:29 user nova-compute[74898]:       <alias name='video0'/>
Nov 17 03:02:29 user nova-compute[74898]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 17 03:02:29 user nova-compute[74898]:     </video>
Nov 17 03:02:29 user nova-compute[74898]:     <memballoon model='virtio'>
Nov 17 03:02:29 user nova-compute[74898]:       <stats period='10'/>
Nov 17 03:02:29 user nova-compute[74898]:       <alias name='balloon0'/>
Nov 17 03:02:29 user nova-compute[74898]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 17 03:02:29 user nova-compute[74898]:     </memballoon>
Nov 17 03:02:29 user nova-compute[74898]:     <rng model='virtio'>
Nov 17 03:02:29 user nova-compute[74898]:       <backend model='random'>/dev/urandom</backend>
Nov 17 03:02:29 user nova-compute[74898]:       <alias name='rng0'/>
Nov 17 03:02:29 user nova-compute[74898]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 17 03:02:29 user nova-compute[74898]:     </rng>
Nov 17 03:02:29 user nova-compute[74898]:   </devices>
Nov 17 03:02:29 user nova-compute[74898]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 17 03:02:29 user nova-compute[74898]:     <label>libvirt-b886ada4-5bcb-4b2a-b69e-80edefdd2119</label>
Nov 17 03:02:29 user nova-compute[74898]:     <imagelabel>libvirt-b886ada4-5bcb-4b2a-b69e-80edefdd2119</imagelabel>
Nov 17 03:02:29 user nova-compute[74898]:   </seclabel>
Nov 17 03:02:29 user nova-compute[74898]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 17 03:02:29 user nova-compute[74898]:     <label>+64055:+108</label>
Nov 17 03:02:29 user nova-compute[74898]:     <imagelabel>+64055:+108</imagelabel>
Nov 17 03:02:29 user nova-compute[74898]:   </seclabel>
Nov 17 03:02:29 user nova-compute[74898]: </domain>
Nov 17 03:02:29 user nova-compute[74898]:  {{(pid=74898) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 17 03:02:29 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Successfully detached device tap91e750ca-9d from instance b886ada4-5bcb-4b2a-b69e-80edefdd2119 from the live domain config.
Nov 17 03:02:29 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T02:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1059772796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1059772796',id=7,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbRzMswcys+QI6rLi6X0vGsy7XfMvLPPyHl7k0Ny6Kbzn4mYAR49YTYPPYUhsJ7Wj7VjaU+vGFbOCukOTayflDVlC4cnZKPAPKbqPCeENy+82k6vfJ0ZQpQ1EY3m67/9g==',key_name='tempest-keypair-1533313292',keypairs=<?>,launch_index=0,launched_at=2023-11-17T02:59:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c45541cf5bd44c2a34d5a31f04e2a2a',ramdisk_id='',reservation_id='r-ftctsg18',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1966129795',owner_user_name='tempest-TaggedAttachmentsTest-1966129795-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T02:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7c4ed2ec81a411c95b2be4dcfb9859d',uuid=b886ada4-5bcb-4b2a-b69e-80edefdd2119,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91e750ca-9d66-4a01-927f-43eace319a06", "address": "fa:16:3e:31:0f:fd", "network": {"id": "c40bf74e-2312-450f-ae66-15e481af3230", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1183652464", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8c45541cf5bd44c2a34d5a31f04e2a2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e750ca-9d", "ovs_interfaceid": "91e750ca-9d66-4a01-927f-43eace319a06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Converting VIF {"id": "91e750ca-9d66-4a01-927f-43eace319a06", "address": "fa:16:3e:31:0f:fd", "network": {"id": "c40bf74e-2312-450f-ae66-15e481af3230", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1183652464", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8c45541cf5bd44c2a34d5a31f04e2a2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e750ca-9d", "ovs_interfaceid": "91e750ca-9d66-4a01-927f-43eace319a06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:0f:fd,bridge_name='br-int',has_traffic_filtering=True,id=91e750ca-9d66-4a01-927f-43eace319a06,network=Network(c40bf74e-2312-450f-ae66-15e481af3230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e750ca-9d') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG os_vif [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:0f:fd,bridge_name='br-int',has_traffic_filtering=True,id=91e750ca-9d66-4a01-927f-43eace319a06,network=Network(c40bf74e-2312-450f-ae66-15e481af3230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e750ca-9d') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91e750ca-9d, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=17040311-fe26-44d4-9b22-84c0985662ef) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:02:29 user nova-compute[74898]: INFO os_vif [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:0f:fd,bridge_name='br-int',has_traffic_filtering=True,id=91e750ca-9d66-4a01-927f-43eace319a06,network=Network(c40bf74e-2312-450f-ae66-15e481af3230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e750ca-9d')
Nov 17 03:02:29 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:02:29 user nova-compute[74898]:   <nova:package version="0.0.0"/>
Nov 17 03:02:29 user nova-compute[74898]:   <nova:name>tempest-device-tagging-server-1059772796</nova:name>
Nov 17 03:02:29 user nova-compute[74898]:   <nova:creationTime>2023-11-17 03:02:29</nova:creationTime>
Nov 17 03:02:29 user nova-compute[74898]:   <nova:flavor name="m1.tiny">
Nov 17 03:02:29 user nova-compute[74898]:     <nova:memory>512</nova:memory>
Nov 17 03:02:29 user nova-compute[74898]:     <nova:disk>1</nova:disk>
Nov 17 03:02:29 user nova-compute[74898]:     <nova:swap>0</nova:swap>
Nov 17 03:02:29 user nova-compute[74898]:     <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:02:29 user nova-compute[74898]:     <nova:vcpus>1</nova:vcpus>
Nov 17 03:02:29 user nova-compute[74898]:   </nova:flavor>
Nov 17 03:02:29 user nova-compute[74898]:   <nova:owner>
Nov 17 03:02:29 user nova-compute[74898]:     <nova:user uuid="f7c4ed2ec81a411c95b2be4dcfb9859d">tempest-TaggedAttachmentsTest-1966129795-project-member</nova:user>
Nov 17 03:02:29 user nova-compute[74898]:     <nova:project uuid="8c45541cf5bd44c2a34d5a31f04e2a2a">tempest-TaggedAttachmentsTest-1966129795</nova:project>
Nov 17 03:02:29 user nova-compute[74898]:   </nova:owner>
Nov 17 03:02:29 user nova-compute[74898]:   <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:02:29 user nova-compute[74898]:   <nova:ports>
Nov 17 03:02:29 user nova-compute[74898]:     <nova:port uuid="bd3b73ca-0068-42f4-8cf3-f84932dee960">
Nov 17 03:02:29 user nova-compute[74898]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 17 03:02:29 user nova-compute[74898]:     </nova:port>
Nov 17 03:02:29 user nova-compute[74898]:   </nova:ports>
Nov 17 03:02:29 user nova-compute[74898]: </nova:instance>
Nov 17 03:02:29 user nova-compute[74898]:  {{(pid=74898) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.640s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:30 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Deleted allocations for instance df13492d-d351-49c1-9755-7c30caae89f1
Nov 17 03:02:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ba2e3aac-0dcd-497b-a6c0-b0ee4db605d2 tempest-TaggedBootDevicesTest-1407862931 tempest-TaggedBootDevicesTest-1407862931-project-member] Lock "df13492d-d351-49c1-9755-7c30caae89f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.701s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG nova.compute.manager [req-660b8146-f480-454a-a866-2b76d0d7c9a2 req-7402e0cd-443b-4ea0-9e38-7d4ba539b032 service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Received event network-vif-deleted-91e750ca-9d66-4a01-927f-43eace319a06 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:30 user nova-compute[74898]: INFO nova.compute.manager [req-660b8146-f480-454a-a866-2b76d0d7c9a2 req-7402e0cd-443b-4ea0-9e38-7d4ba539b032 service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Neutron deleted interface 91e750ca-9d66-4a01-927f-43eace319a06; detaching it from the instance and deleting it from the info cache
Nov 17 03:02:30 user nova-compute[74898]: DEBUG nova.network.neutron [req-660b8146-f480-454a-a866-2b76d0d7c9a2 req-7402e0cd-443b-4ea0-9e38-7d4ba539b032 service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Updating instance_info_cache with network_info: [{"id": "bd3b73ca-0068-42f4-8cf3-f84932dee960", "address": "fa:16:3e:2d:e6:07", "network": {"id": "a432562d-92fd-4786-944f-3a082f5146e8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1288851087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c45541cf5bd44c2a34d5a31f04e2a2a", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3b73ca-00", "ovs_interfaceid": "bd3b73ca-0068-42f4-8cf3-f84932dee960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Acquiring lock "refresh_cache-b886ada4-5bcb-4b2a-b69e-80edefdd2119" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Acquired lock "refresh_cache-b886ada4-5bcb-4b2a-b69e-80edefdd2119" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG nova.network.neutron [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG nova.objects.instance [req-660b8146-f480-454a-a866-2b76d0d7c9a2 req-7402e0cd-443b-4ea0-9e38-7d4ba539b032 service nova] Lazy-loading 'system_metadata' on Instance uuid b886ada4-5bcb-4b2a-b69e-80edefdd2119 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23135373636363233', 'path': '/dev/sdb'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135373636363233', 'path': '/dev/sdb'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:02:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1142928320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1142928320',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFxXq1bg8SNfYclLKbHjQo8K7gYin+VKFCZjgxMqEfzsP02ZdMm/i+ADtVzCoWZvNZrQLncAAgkXtb7MJSmkiivDIZZxRPOsrvSXR9fx5NB8X7uJk83pxZNQE+yr12IYQ==',key_name='tempest-keypair-2063298515',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1ed77effbea441eb58507f436033c3c',ramdisk_id='',reservation_id='r-ez9l9sip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1334889751',owner_user_name='tempest-ServerActionsV293TestJSON-1334889751-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:02:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbc18ee9aea24d6db4a9a71f4cf2d723',uuid=36e687c0-9481-4126-b365-f7f9707e2338,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5415aaa1-723f-4f35-971c-509caa04575d", "address": "fa:16:3e:6f:9f:8e", "network": {"id": "4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-545743352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ed77effbea441eb58507f436033c3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5415aaa1-72", "ovs_interfaceid": "5415aaa1-723f-4f35-971c-509caa04575d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Converting VIF {"id": "5415aaa1-723f-4f35-971c-509caa04575d", "address": "fa:16:3e:6f:9f:8e", "network": {"id": "4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-545743352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ed77effbea441eb58507f436033c3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5415aaa1-72", "ovs_interfaceid": "5415aaa1-723f-4f35-971c-509caa04575d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:9f:8e,bridge_name='br-int',has_traffic_filtering=True,id=5415aaa1-723f-4f35-971c-509caa04575d,network=Network(4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5415aaa1-72') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG nova.objects.instance [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lazy-loading 'pci_devices' on Instance uuid 36e687c0-9481-4126-b365-f7f9707e2338 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:02:30 user nova-compute[74898]:   <uuid>36e687c0-9481-4126-b365-f7f9707e2338</uuid>
Nov 17 03:02:30 user nova-compute[74898]:   <name>instance-0000000d</name>
Nov 17 03:02:30 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:02:30 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:02:30 user nova-compute[74898]:   <metadata>
Nov 17 03:02:30 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:02:30 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:02:30 user nova-compute[74898]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1142928320</nova:name>
Nov 17 03:02:30 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:02:29</nova:creationTime>
Nov 17 03:02:30 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:02:30 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:02:30 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:02:30 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:02:30 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:02:30 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:02:30 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:02:30 user nova-compute[74898]:       <nova:owner>
Nov 17 03:02:30 user nova-compute[74898]:         <nova:user uuid="dbc18ee9aea24d6db4a9a71f4cf2d723">tempest-ServerActionsV293TestJSON-1334889751-project-member</nova:user>
Nov 17 03:02:30 user nova-compute[74898]:         <nova:project uuid="a1ed77effbea441eb58507f436033c3c">tempest-ServerActionsV293TestJSON-1334889751</nova:project>
Nov 17 03:02:30 user nova-compute[74898]:       </nova:owner>
Nov 17 03:02:30 user nova-compute[74898]:       <nova:ports>
Nov 17 03:02:30 user nova-compute[74898]:         <nova:port uuid="5415aaa1-723f-4f35-971c-509caa04575d">
Nov 17 03:02:30 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 17 03:02:30 user nova-compute[74898]:         </nova:port>
Nov 17 03:02:30 user nova-compute[74898]:       </nova:ports>
Nov 17 03:02:30 user nova-compute[74898]:     </nova:instance>
Nov 17 03:02:30 user nova-compute[74898]:   </metadata>
Nov 17 03:02:30 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:02:30 user nova-compute[74898]:     <system>
Nov 17 03:02:30 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:02:30 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:02:30 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:02:30 user nova-compute[74898]:       <entry name="serial">36e687c0-9481-4126-b365-f7f9707e2338</entry>
Nov 17 03:02:30 user nova-compute[74898]:       <entry name="uuid">36e687c0-9481-4126-b365-f7f9707e2338</entry>
Nov 17 03:02:30 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:02:30 user nova-compute[74898]:     </system>
Nov 17 03:02:30 user nova-compute[74898]:   </sysinfo>
Nov 17 03:02:30 user nova-compute[74898]:   <os>
Nov 17 03:02:30 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:02:30 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:02:30 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:02:30 user nova-compute[74898]:   </os>
Nov 17 03:02:30 user nova-compute[74898]:   <features>
Nov 17 03:02:30 user nova-compute[74898]:     <acpi/>
Nov 17 03:02:30 user nova-compute[74898]:     <apic/>
Nov 17 03:02:30 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:02:30 user nova-compute[74898]:   </features>
Nov 17 03:02:30 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:02:30 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:02:30 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:02:30 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:02:30 user nova-compute[74898]:   </clock>
Nov 17 03:02:30 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:02:30 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:02:30 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:02:30 user nova-compute[74898]:   </cpu>
Nov 17 03:02:30 user nova-compute[74898]:   <devices>
Nov 17 03:02:30 user nova-compute[74898]:     <disk type="block" device="disk">
Nov 17 03:02:30 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:02:30 user nova-compute[74898]:       <source dev="/dev/sdb"/>
Nov 17 03:02:30 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:02:30 user nova-compute[74898]:       <serial>637a8d80-8ef7-46f9-806c-cb8fdf7699c4</serial>
Nov 17 03:02:30 user nova-compute[74898]:     </disk>
Nov 17 03:02:30 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:02:30 user nova-compute[74898]:       <mac address="fa:16:3e:6f:9f:8e"/>
Nov 17 03:02:30 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:02:30 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:02:30 user nova-compute[74898]:       <target dev="tap5415aaa1-72"/>
Nov 17 03:02:30 user nova-compute[74898]:     </interface>
Nov 17 03:02:30 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:02:30 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/36e687c0-9481-4126-b365-f7f9707e2338/console.log" append="off"/>
Nov 17 03:02:30 user nova-compute[74898]:     </serial>
Nov 17 03:02:30 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:02:30 user nova-compute[74898]:     <video>
Nov 17 03:02:30 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:02:30 user nova-compute[74898]:     </video>
Nov 17 03:02:30 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:02:30 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:02:30 user nova-compute[74898]:     </rng>
Nov 17 03:02:30 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:02:30 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:02:30 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:02:30 user nova-compute[74898]:     </memballoon>
Nov 17 03:02:30 user nova-compute[74898]:   </devices>
Nov 17 03:02:30 user nova-compute[74898]: </domain>
Nov 17 03:02:30 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:02:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1142928320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1142928320',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFxXq1bg8SNfYclLKbHjQo8K7gYin+VKFCZjgxMqEfzsP02ZdMm/i+ADtVzCoWZvNZrQLncAAgkXtb7MJSmkiivDIZZxRPOsrvSXR9fx5NB8X7uJk83pxZNQE+yr12IYQ==',key_name='tempest-keypair-2063298515',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1ed77effbea441eb58507f436033c3c',ramdisk_id='',reservation_id='r-ez9l9sip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1334889751',owner_user_name='tempest-ServerActionsV293TestJSON-1334889751-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:02:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbc18ee9aea24d6db4a9a71f4cf2d723',uuid=36e687c0-9481-4126-b365-f7f9707e2338,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5415aaa1-723f-4f35-971c-509caa04575d", "address": "fa:16:3e:6f:9f:8e", "network": {"id": "4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-545743352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ed77effbea441eb58507f436033c3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5415aaa1-72", "ovs_interfaceid": "5415aaa1-723f-4f35-971c-509caa04575d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Converting VIF {"id": "5415aaa1-723f-4f35-971c-509caa04575d", "address": "fa:16:3e:6f:9f:8e", "network": {"id": "4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-545743352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ed77effbea441eb58507f436033c3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5415aaa1-72", "ovs_interfaceid": "5415aaa1-723f-4f35-971c-509caa04575d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:9f:8e,bridge_name='br-int',has_traffic_filtering=True,id=5415aaa1-723f-4f35-971c-509caa04575d,network=Network(4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5415aaa1-72') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG os_vif [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:9f:8e,bridge_name='br-int',has_traffic_filtering=True,id=5415aaa1-723f-4f35-971c-509caa04575d,network=Network(4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5415aaa1-72') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG nova.objects.instance [req-660b8146-f480-454a-a866-2b76d0d7c9a2 req-7402e0cd-443b-4ea0-9e38-7d4ba539b032 service nova] Lazy-loading 'flavor' on Instance uuid b886ada4-5bcb-4b2a-b69e-80edefdd2119 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32831a78-4539-5f72-9d80-c35b0b3090b2', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5415aaa1-72, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5415aaa1-72, col_values=(('qos', UUID('5fa1d332-6894-4dd8-b94d-48301b2f8818')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5415aaa1-72, col_values=(('external_ids', {'iface-id': '5415aaa1-723f-4f35-971c-509caa04575d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:9f:8e', 'vm-uuid': '36e687c0-9481-4126-b365-f7f9707e2338'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:30 user nova-compute[74898]: INFO os_vif [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:9f:8e,bridge_name='br-int',has_traffic_filtering=True,id=5415aaa1-723f-4f35-971c-509caa04575d,network=Network(4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5415aaa1-72')
Nov 17 03:02:30 user nova-compute[74898]: DEBUG nova.objects.base [req-660b8146-f480-454a-a866-2b76d0d7c9a2 req-7402e0cd-443b-4ea0-9e38-7d4ba539b032 service nova] Object Instance<b886ada4-5bcb-4b2a-b69e-80edefdd2119> lazy-loaded attributes: system_metadata,flavor {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [req-660b8146-f480-454a-a866-2b76d0d7c9a2 req-7402e0cd-443b-4ea0-9e38-7d4ba539b032 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T02:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1059772796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1059772796',id=7,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbRzMswcys+QI6rLi6X0vGsy7XfMvLPPyHl7k0Ny6Kbzn4mYAR49YTYPPYUhsJ7Wj7VjaU+vGFbOCukOTayflDVlC4cnZKPAPKbqPCeENy+82k6vfJ0ZQpQ1EY3m67/9g==',key_name='tempest-keypair-1533313292',keypairs=<?>,launch_index=0,launched_at=2023-11-17T02:59:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c45541cf5bd44c2a34d5a31f04e2a2a',ramdisk_id='',reservation_id='r-ftctsg18',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1966129795',owner_user_name='tempest-TaggedAttachmentsTest-1966129795-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T02:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7c4ed2ec81a411c95b2be4dcfb9859d',uuid=b886ada4-5bcb-4b2a-b69e-80edefdd2119,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91e750ca-9d66-4a01-927f-43eace319a06", "address": "fa:16:3e:31:0f:fd", "network": {"id": "c40bf74e-2312-450f-ae66-15e481af3230", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1183652464", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8c45541cf5bd44c2a34d5a31f04e2a2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e750ca-9d", "ovs_interfaceid": "91e750ca-9d66-4a01-927f-43eace319a06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG nova.network.os_vif_util [req-660b8146-f480-454a-a866-2b76d0d7c9a2 req-7402e0cd-443b-4ea0-9e38-7d4ba539b032 service nova] Converting VIF {"id": "91e750ca-9d66-4a01-927f-43eace319a06", "address": "fa:16:3e:31:0f:fd", "network": {"id": "c40bf74e-2312-450f-ae66-15e481af3230", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1183652464", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8c45541cf5bd44c2a34d5a31f04e2a2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e750ca-9d", "ovs_interfaceid": "91e750ca-9d66-4a01-927f-43eace319a06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG nova.network.os_vif_util [req-660b8146-f480-454a-a866-2b76d0d7c9a2 req-7402e0cd-443b-4ea0-9e38-7d4ba539b032 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:0f:fd,bridge_name='br-int',has_traffic_filtering=True,id=91e750ca-9d66-4a01-927f-43eace319a06,network=Network(c40bf74e-2312-450f-ae66-15e481af3230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e750ca-9d') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [req-660b8146-f480-454a-a866-2b76d0d7c9a2 req-7402e0cd-443b-4ea0-9e38-7d4ba539b032 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:31:0f:fd"/><model type="virtio"/><mtu size="1442"/><target dev="tap91e750ca-9d"/></interface> {{(pid=74898) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [req-660b8146-f480-454a-a866-2b76d0d7c9a2 req-7402e0cd-443b-4ea0-9e38-7d4ba539b032 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:31:0f:fd"/><model type="virtio"/><mtu size="1442"/><target dev="tap91e750ca-9d"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 17 03:02:30 user nova-compute[74898]:   <name>instance-00000007</name>
Nov 17 03:02:30 user nova-compute[74898]:   <uuid>b886ada4-5bcb-4b2a-b69e-80edefdd2119</uuid>
Nov 17 03:02:30 user nova-compute[74898]:   <metadata>
Nov 17 03:02:30 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:02:30 user nova-compute[74898]:   <nova:package version="0.0.0"/>
Nov 17 03:02:30 user nova-compute[74898]:   <nova:name>tempest-device-tagging-server-1059772796</nova:name>
Nov 17 03:02:30 user nova-compute[74898]:   <nova:creationTime>2023-11-17 03:02:29</nova:creationTime>
Nov 17 03:02:30 user nova-compute[74898]:   <nova:flavor name="m1.tiny">
Nov 17 03:02:30 user nova-compute[74898]:     <nova:memory>512</nova:memory>
Nov 17 03:02:30 user nova-compute[74898]:     <nova:disk>1</nova:disk>
Nov 17 03:02:30 user nova-compute[74898]:     <nova:swap>0</nova:swap>
Nov 17 03:02:30 user nova-compute[74898]:     <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:02:30 user nova-compute[74898]:     <nova:vcpus>1</nova:vcpus>
Nov 17 03:02:30 user nova-compute[74898]:   </nova:flavor>
Nov 17 03:02:30 user nova-compute[74898]:   <nova:owner>
Nov 17 03:02:30 user nova-compute[74898]:     <nova:user uuid="f7c4ed2ec81a411c95b2be4dcfb9859d">tempest-TaggedAttachmentsTest-1966129795-project-member</nova:user>
Nov 17 03:02:30 user nova-compute[74898]:     <nova:project uuid="8c45541cf5bd44c2a34d5a31f04e2a2a">tempest-TaggedAttachmentsTest-1966129795</nova:project>
Nov 17 03:02:30 user nova-compute[74898]:   </nova:owner>
Nov 17 03:02:30 user nova-compute[74898]:   <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:02:30 user nova-compute[74898]:   <nova:ports>
Nov 17 03:02:30 user nova-compute[74898]:     <nova:port uuid="bd3b73ca-0068-42f4-8cf3-f84932dee960">
Nov 17 03:02:30 user nova-compute[74898]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 17 03:02:30 user nova-compute[74898]:     </nova:port>
Nov 17 03:02:30 user nova-compute[74898]:   </nova:ports>
Nov 17 03:02:30 user nova-compute[74898]: </nova:instance>
Nov 17 03:02:30 user nova-compute[74898]:   </metadata>
Nov 17 03:02:30 user nova-compute[74898]:   <memory unit='KiB'>524288</memory>
Nov 17 03:02:30 user nova-compute[74898]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 17 03:02:30 user nova-compute[74898]:   <vcpu placement='static'>1</vcpu>
Nov 17 03:02:30 user nova-compute[74898]:   <resource>
Nov 17 03:02:30 user nova-compute[74898]:     <partition>/machine</partition>
Nov 17 03:02:30 user nova-compute[74898]:   </resource>
Nov 17 03:02:30 user nova-compute[74898]:   <sysinfo type='smbios'>
Nov 17 03:02:30 user nova-compute[74898]:     <system>
Nov 17 03:02:30 user nova-compute[74898]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 17 03:02:30 user nova-compute[74898]:       <entry name='product'>OpenStack Nova</entry>
Nov 17 03:02:30 user nova-compute[74898]:       <entry name='version'>0.0.0</entry>
Nov 17 03:02:30 user nova-compute[74898]:       <entry name='serial'>b886ada4-5bcb-4b2a-b69e-80edefdd2119</entry>
Nov 17 03:02:30 user nova-compute[74898]:       <entry name='uuid'>b886ada4-5bcb-4b2a-b69e-80edefdd2119</entry>
Nov 17 03:02:30 user nova-compute[74898]:       <entry name='family'>Virtual Machine</entry>
Nov 17 03:02:30 user nova-compute[74898]:     </system>
Nov 17 03:02:30 user nova-compute[74898]:   </sysinfo>
Nov 17 03:02:30 user nova-compute[74898]:   <os>
Nov 17 03:02:30 user nova-compute[74898]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 17 03:02:30 user nova-compute[74898]:     <boot dev='hd'/>
Nov 17 03:02:30 user nova-compute[74898]:     <smbios mode='sysinfo'/>
Nov 17 03:02:30 user nova-compute[74898]:   </os>
Nov 17 03:02:30 user nova-compute[74898]:   <features>
Nov 17 03:02:30 user nova-compute[74898]:     <acpi/>
Nov 17 03:02:30 user nova-compute[74898]:     <apic/>
Nov 17 03:02:30 user nova-compute[74898]:     <vmcoreinfo state='on'/>
Nov 17 03:02:30 user nova-compute[74898]:   </features>
Nov 17 03:02:30 user nova-compute[74898]:   <cpu mode='custom' match='exact' check='full'>
Nov 17 03:02:30 user nova-compute[74898]:     <model fallback='forbid'>Nehalem</model>
Nov 17 03:02:30 user nova-compute[74898]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 17 03:02:30 user nova-compute[74898]:     <feature policy='require' name='vme'/>
Nov 17 03:02:30 user nova-compute[74898]:     <feature policy='require' name='x2apic'/>
Nov 17 03:02:30 user nova-compute[74898]:     <feature policy='require' name='hypervisor'/>
Nov 17 03:02:30 user nova-compute[74898]:   </cpu>
Nov 17 03:02:30 user nova-compute[74898]:   <clock offset='utc'>
Nov 17 03:02:30 user nova-compute[74898]:     <timer name='pit' tickpolicy='delay'/>
Nov 17 03:02:30 user nova-compute[74898]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 17 03:02:30 user nova-compute[74898]:     <timer name='hpet' present='no'/>
Nov 17 03:02:30 user nova-compute[74898]:   </clock>
Nov 17 03:02:30 user nova-compute[74898]:   <on_poweroff>destroy</on_poweroff>
Nov 17 03:02:30 user nova-compute[74898]:   <on_reboot>restart</on_reboot>
Nov 17 03:02:30 user nova-compute[74898]:   <on_crash>destroy</on_crash>
Nov 17 03:02:30 user nova-compute[74898]:   <devices>
Nov 17 03:02:30 user nova-compute[74898]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 17 03:02:30 user nova-compute[74898]:     <disk type='file' device='disk'>
Nov 17 03:02:30 user nova-compute[74898]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 17 03:02:30 user nova-compute[74898]:       <source file='/opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk' index='2'/>
Nov 17 03:02:30 user nova-compute[74898]:       <backingStore type='file' index='3'>
Nov 17 03:02:30 user nova-compute[74898]:         <format type='raw'/>
Nov 17 03:02:30 user nova-compute[74898]:         <source file='/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372'/>
Nov 17 03:02:30 user nova-compute[74898]:         <backingStore/>
Nov 17 03:02:30 user nova-compute[74898]:       </backingStore>
Nov 17 03:02:30 user nova-compute[74898]:       <target dev='vda' bus='virtio'/>
Nov 17 03:02:30 user nova-compute[74898]:       <alias name='virtio-disk0'/>
Nov 17 03:02:30 user nova-compute[74898]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 17 03:02:30 user nova-compute[74898]:     </disk>
Nov 17 03:02:30 user nova-compute[74898]:     <disk type='file' device='cdrom'>
Nov 17 03:02:30 user nova-compute[74898]:       <driver name='qemu' type='raw' cache='none'/>
Nov 17 03:02:30 user nova-compute[74898]:       <source file='/opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk.config' index='1'/>
Nov 17 03:02:30 user nova-compute[74898]:       <backingStore/>
Nov 17 03:02:30 user nova-compute[74898]:       <target dev='hda' bus='ide'/>
Nov 17 03:02:30 user nova-compute[74898]:       <readonly/>
Nov 17 03:02:30 user nova-compute[74898]:       <alias name='ide0-0-0'/>
Nov 17 03:02:30 user nova-compute[74898]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 17 03:02:30 user nova-compute[74898]:     </disk>
Nov 17 03:02:30 user nova-compute[74898]:     <controller type='usb' index='0' model='none'>
Nov 17 03:02:30 user nova-compute[74898]:       <alias name='usb'/>
Nov 17 03:02:30 user nova-compute[74898]:     </controller>
Nov 17 03:02:30 user nova-compute[74898]:     <controller type='pci' index='0' model='pci-root'>
Nov 17 03:02:30 user nova-compute[74898]:       <alias name='pci.0'/>
Nov 17 03:02:30 user nova-compute[74898]:     </controller>
Nov 17 03:02:30 user nova-compute[74898]:     <controller type='ide' index='0'>
Nov 17 03:02:30 user nova-compute[74898]:       <alias name='ide'/>
Nov 17 03:02:30 user nova-compute[74898]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 17 03:02:30 user nova-compute[74898]:     </controller>
Nov 17 03:02:30 user nova-compute[74898]:     <interface type='ethernet'>
Nov 17 03:02:30 user nova-compute[74898]:       <mac address='fa:16:3e:2d:e6:07'/>
Nov 17 03:02:30 user nova-compute[74898]:       <target dev='tapbd3b73ca-00'/>
Nov 17 03:02:30 user nova-compute[74898]:       <model type='virtio'/>
Nov 17 03:02:30 user nova-compute[74898]:       <mtu size='1442'/>
Nov 17 03:02:30 user nova-compute[74898]:       <alias name='net0'/>
Nov 17 03:02:30 user nova-compute[74898]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 17 03:02:30 user nova-compute[74898]:     </interface>
Nov 17 03:02:30 user nova-compute[74898]:     <serial type='pty'>
Nov 17 03:02:30 user nova-compute[74898]:       <source path='/dev/pts/6'/>
Nov 17 03:02:30 user nova-compute[74898]:       <log file='/opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/console.log' append='off'/>
Nov 17 03:02:30 user nova-compute[74898]:       <target type='isa-serial' port='0'>
Nov 17 03:02:30 user nova-compute[74898]:         <model name='isa-serial'/>
Nov 17 03:02:30 user nova-compute[74898]:       </target>
Nov 17 03:02:30 user nova-compute[74898]:       <alias name='serial0'/>
Nov 17 03:02:30 user nova-compute[74898]:     </serial>
Nov 17 03:02:30 user nova-compute[74898]:     <console type='pty' tty='/dev/pts/6'>
Nov 17 03:02:30 user nova-compute[74898]:       <source path='/dev/pts/6'/>
Nov 17 03:02:30 user nova-compute[74898]:       <log file='/opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/console.log' append='off'/>
Nov 17 03:02:30 user nova-compute[74898]:       <target type='serial' port='0'/>
Nov 17 03:02:30 user nova-compute[74898]:       <alias name='serial0'/>
Nov 17 03:02:30 user nova-compute[74898]:     </console>
Nov 17 03:02:30 user nova-compute[74898]:     <input type='mouse' bus='ps2'>
Nov 17 03:02:30 user nova-compute[74898]:       <alias name='input0'/>
Nov 17 03:02:30 user nova-compute[74898]:     </input>
Nov 17 03:02:30 user nova-compute[74898]:     <input type='keyboard' bus='ps2'>
Nov 17 03:02:30 user nova-compute[74898]:       <alias name='input1'/>
Nov 17 03:02:30 user nova-compute[74898]:     </input>
Nov 17 03:02:30 user nova-compute[74898]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 17 03:02:30 user nova-compute[74898]:       <listen type='address' address='0.0.0.0'/>
Nov 17 03:02:30 user nova-compute[74898]:     </graphics>
Nov 17 03:02:30 user nova-compute[74898]:     <audio id='1' type='none'/>
Nov 17 03:02:30 user nova-compute[74898]:     <video>
Nov 17 03:02:30 user nova-compute[74898]:       <model type='virtio' heads='1' primary='yes'/>
Nov 17 03:02:30 user nova-compute[74898]:       <alias name='video0'/>
Nov 17 03:02:30 user nova-compute[74898]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 17 03:02:30 user nova-compute[74898]:     </video>
Nov 17 03:02:30 user nova-compute[74898]:     <memballoon model='virtio'>
Nov 17 03:02:30 user nova-compute[74898]:       <stats period='10'/>
Nov 17 03:02:30 user nova-compute[74898]:       <alias name='balloon0'/>
Nov 17 03:02:30 user nova-compute[74898]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 17 03:02:30 user nova-compute[74898]:     </memballoon>
Nov 17 03:02:30 user nova-compute[74898]:     <rng model='virtio'>
Nov 17 03:02:30 user nova-compute[74898]:       <backend model='random'>/dev/urandom</backend>
Nov 17 03:02:30 user nova-compute[74898]:       <alias name='rng0'/>
Nov 17 03:02:30 user nova-compute[74898]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 17 03:02:30 user nova-compute[74898]:     </rng>
Nov 17 03:02:30 user nova-compute[74898]:   </devices>
Nov 17 03:02:30 user nova-compute[74898]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 17 03:02:30 user nova-compute[74898]:     <label>libvirt-b886ada4-5bcb-4b2a-b69e-80edefdd2119</label>
Nov 17 03:02:30 user nova-compute[74898]:     <imagelabel>libvirt-b886ada4-5bcb-4b2a-b69e-80edefdd2119</imagelabel>
Nov 17 03:02:30 user nova-compute[74898]:   </seclabel>
Nov 17 03:02:30 user nova-compute[74898]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 17 03:02:30 user nova-compute[74898]:     <label>+64055:+108</label>
Nov 17 03:02:30 user nova-compute[74898]:     <imagelabel>+64055:+108</imagelabel>
Nov 17 03:02:30 user nova-compute[74898]:   </seclabel>
Nov 17 03:02:30 user nova-compute[74898]: </domain>
Nov 17 03:02:30 user nova-compute[74898]:  {{(pid=74898) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [req-660b8146-f480-454a-a866-2b76d0d7c9a2 req-7402e0cd-443b-4ea0-9e38-7d4ba539b032 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:31:0f:fd"/><model type="virtio"/><mtu size="1442"/><target dev="tap91e750ca-9d"/></interface> {{(pid=74898) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [req-660b8146-f480-454a-a866-2b76d0d7c9a2 req-7402e0cd-443b-4ea0-9e38-7d4ba539b032 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:31:0f:fd"/><model type="virtio"/><mtu size="1442"/><target dev="tap91e750ca-9d"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 17 03:02:30 user nova-compute[74898]:   <name>instance-00000007</name>
Nov 17 03:02:30 user nova-compute[74898]:   <uuid>b886ada4-5bcb-4b2a-b69e-80edefdd2119</uuid>
Nov 17 03:02:30 user nova-compute[74898]:   <metadata>
Nov 17 03:02:30 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:02:30 user nova-compute[74898]:   <nova:package version="0.0.0"/>
Nov 17 03:02:30 user nova-compute[74898]:   <nova:name>tempest-device-tagging-server-1059772796</nova:name>
Nov 17 03:02:30 user nova-compute[74898]:   <nova:creationTime>2023-11-17 03:02:29</nova:creationTime>
Nov 17 03:02:30 user nova-compute[74898]:   <nova:flavor name="m1.tiny">
Nov 17 03:02:30 user nova-compute[74898]:     <nova:memory>512</nova:memory>
Nov 17 03:02:30 user nova-compute[74898]:     <nova:disk>1</nova:disk>
Nov 17 03:02:30 user nova-compute[74898]:     <nova:swap>0</nova:swap>
Nov 17 03:02:30 user nova-compute[74898]:     <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:02:30 user nova-compute[74898]:     <nova:vcpus>1</nova:vcpus>
Nov 17 03:02:30 user nova-compute[74898]:   </nova:flavor>
Nov 17 03:02:30 user nova-compute[74898]:   <nova:owner>
Nov 17 03:02:30 user nova-compute[74898]:     <nova:user uuid="f7c4ed2ec81a411c95b2be4dcfb9859d">tempest-TaggedAttachmentsTest-1966129795-project-member</nova:user>
Nov 17 03:02:30 user nova-compute[74898]:     <nova:project uuid="8c45541cf5bd44c2a34d5a31f04e2a2a">tempest-TaggedAttachmentsTest-1966129795</nova:project>
Nov 17 03:02:30 user nova-compute[74898]:   </nova:owner>
Nov 17 03:02:30 user nova-compute[74898]:   <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:02:30 user nova-compute[74898]:   <nova:ports>
Nov 17 03:02:30 user nova-compute[74898]:     <nova:port uuid="bd3b73ca-0068-42f4-8cf3-f84932dee960">
Nov 17 03:02:30 user nova-compute[74898]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 17 03:02:30 user nova-compute[74898]:     </nova:port>
Nov 17 03:02:30 user nova-compute[74898]:   </nova:ports>
Nov 17 03:02:30 user nova-compute[74898]: </nova:instance>
Nov 17 03:02:30 user nova-compute[74898]:   </metadata>
Nov 17 03:02:30 user nova-compute[74898]:   <memory unit='KiB'>524288</memory>
Nov 17 03:02:30 user nova-compute[74898]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 17 03:02:30 user nova-compute[74898]:   <vcpu placement='static'>1</vcpu>
Nov 17 03:02:30 user nova-compute[74898]:   <resource>
Nov 17 03:02:30 user nova-compute[74898]:     <partition>/machine</partition>
Nov 17 03:02:30 user nova-compute[74898]:   </resource>
Nov 17 03:02:30 user nova-compute[74898]:   <sysinfo type='smbios'>
Nov 17 03:02:30 user nova-compute[74898]:     <system>
Nov 17 03:02:30 user nova-compute[74898]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 17 03:02:30 user nova-compute[74898]:       <entry name='product'>OpenStack Nova</entry>
Nov 17 03:02:30 user nova-compute[74898]:       <entry name='version'>0.0.0</entry>
Nov 17 03:02:30 user nova-compute[74898]:       <entry name='serial'>b886ada4-5bcb-4b2a-b69e-80edefdd2119</entry>
Nov 17 03:02:30 user nova-compute[74898]:       <entry name='uuid'>b886ada4-5bcb-4b2a-b69e-80edefdd2119</entry>
Nov 17 03:02:30 user nova-compute[74898]:       <entry name='family'>Virtual Machine</entry>
Nov 17 03:02:30 user nova-compute[74898]:     </system>
Nov 17 03:02:30 user nova-compute[74898]:   </sysinfo>
Nov 17 03:02:30 user nova-compute[74898]:   <os>
Nov 17 03:02:30 user nova-compute[74898]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 17 03:02:30 user nova-compute[74898]:     <boot dev='hd'/>
Nov 17 03:02:30 user nova-compute[74898]:     <smbios mode='sysinfo'/>
Nov 17 03:02:30 user nova-compute[74898]:   </os>
Nov 17 03:02:30 user nova-compute[74898]:   <features>
Nov 17 03:02:30 user nova-compute[74898]:     <acpi/>
Nov 17 03:02:30 user nova-compute[74898]:     <apic/>
Nov 17 03:02:30 user nova-compute[74898]:     <vmcoreinfo state='on'/>
Nov 17 03:02:30 user nova-compute[74898]:   </features>
Nov 17 03:02:30 user nova-compute[74898]:   <cpu mode='custom' match='exact' check='full'>
Nov 17 03:02:30 user nova-compute[74898]:     <model fallback='forbid'>Nehalem</model>
Nov 17 03:02:30 user nova-compute[74898]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 17 03:02:30 user nova-compute[74898]:     <feature policy='require' name='vme'/>
Nov 17 03:02:30 user nova-compute[74898]:     <feature policy='require' name='x2apic'/>
Nov 17 03:02:30 user nova-compute[74898]:     <feature policy='require' name='hypervisor'/>
Nov 17 03:02:30 user nova-compute[74898]:   </cpu>
Nov 17 03:02:30 user nova-compute[74898]:   <clock offset='utc'>
Nov 17 03:02:30 user nova-compute[74898]:     <timer name='pit' tickpolicy='delay'/>
Nov 17 03:02:30 user nova-compute[74898]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 17 03:02:30 user nova-compute[74898]:     <timer name='hpet' present='no'/>
Nov 17 03:02:30 user nova-compute[74898]:   </clock>
Nov 17 03:02:30 user nova-compute[74898]:   <on_poweroff>destroy</on_poweroff>
Nov 17 03:02:30 user nova-compute[74898]:   <on_reboot>restart</on_reboot>
Nov 17 03:02:30 user nova-compute[74898]:   <on_crash>destroy</on_crash>
Nov 17 03:02:30 user nova-compute[74898]:   <devices>
Nov 17 03:02:30 user nova-compute[74898]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 17 03:02:30 user nova-compute[74898]:     <disk type='file' device='disk'>
Nov 17 03:02:30 user nova-compute[74898]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 17 03:02:30 user nova-compute[74898]:       <source file='/opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk' index='2'/>
Nov 17 03:02:30 user nova-compute[74898]:       <backingStore type='file' index='3'>
Nov 17 03:02:30 user nova-compute[74898]:         <format type='raw'/>
Nov 17 03:02:30 user nova-compute[74898]:         <source file='/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372'/>
Nov 17 03:02:30 user nova-compute[74898]:         <backingStore/>
Nov 17 03:02:30 user nova-compute[74898]:       </backingStore>
Nov 17 03:02:30 user nova-compute[74898]:       <target dev='vda' bus='virtio'/>
Nov 17 03:02:30 user nova-compute[74898]:       <alias name='virtio-disk0'/>
Nov 17 03:02:30 user nova-compute[74898]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 17 03:02:30 user nova-compute[74898]:     </disk>
Nov 17 03:02:30 user nova-compute[74898]:     <disk type='file' device='cdrom'>
Nov 17 03:02:30 user nova-compute[74898]:       <driver name='qemu' type='raw' cache='none'/>
Nov 17 03:02:30 user nova-compute[74898]:       <source file='/opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/disk.config' index='1'/>
Nov 17 03:02:30 user nova-compute[74898]:       <backingStore/>
Nov 17 03:02:30 user nova-compute[74898]:       <target dev='hda' bus='ide'/>
Nov 17 03:02:30 user nova-compute[74898]:       <readonly/>
Nov 17 03:02:30 user nova-compute[74898]:       <alias name='ide0-0-0'/>
Nov 17 03:02:30 user nova-compute[74898]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 17 03:02:30 user nova-compute[74898]:     </disk>
Nov 17 03:02:30 user nova-compute[74898]:     <controller type='usb' index='0' model='none'>
Nov 17 03:02:30 user nova-compute[74898]:       <alias name='usb'/>
Nov 17 03:02:30 user nova-compute[74898]:     </controller>
Nov 17 03:02:30 user nova-compute[74898]:     <controller type='pci' index='0' model='pci-root'>
Nov 17 03:02:30 user nova-compute[74898]:       <alias name='pci.0'/>
Nov 17 03:02:30 user nova-compute[74898]:     </controller>
Nov 17 03:02:30 user nova-compute[74898]:     <controller type='ide' index='0'>
Nov 17 03:02:30 user nova-compute[74898]:       <alias name='ide'/>
Nov 17 03:02:30 user nova-compute[74898]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 17 03:02:30 user nova-compute[74898]:     </controller>
Nov 17 03:02:30 user nova-compute[74898]:     <interface type='ethernet'>
Nov 17 03:02:30 user nova-compute[74898]:       <mac address='fa:16:3e:2d:e6:07'/>
Nov 17 03:02:30 user nova-compute[74898]:       <target dev='tapbd3b73ca-00'/>
Nov 17 03:02:30 user nova-compute[74898]:       <model type='virtio'/>
Nov 17 03:02:30 user nova-compute[74898]:       <mtu size='1442'/>
Nov 17 03:02:30 user nova-compute[74898]:       <alias name='net0'/>
Nov 17 03:02:30 user nova-compute[74898]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 17 03:02:30 user nova-compute[74898]:     </interface>
Nov 17 03:02:30 user nova-compute[74898]:     <serial type='pty'>
Nov 17 03:02:30 user nova-compute[74898]:       <source path='/dev/pts/6'/>
Nov 17 03:02:30 user nova-compute[74898]:       <log file='/opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/console.log' append='off'/>
Nov 17 03:02:30 user nova-compute[74898]:       <target type='isa-serial' port='0'>
Nov 17 03:02:30 user nova-compute[74898]:         <model name='isa-serial'/>
Nov 17 03:02:30 user nova-compute[74898]:       </target>
Nov 17 03:02:30 user nova-compute[74898]:       <alias name='serial0'/>
Nov 17 03:02:30 user nova-compute[74898]:     </serial>
Nov 17 03:02:30 user nova-compute[74898]:     <console type='pty' tty='/dev/pts/6'>
Nov 17 03:02:30 user nova-compute[74898]:       <source path='/dev/pts/6'/>
Nov 17 03:02:30 user nova-compute[74898]:       <log file='/opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119/console.log' append='off'/>
Nov 17 03:02:30 user nova-compute[74898]:       <target type='serial' port='0'/>
Nov 17 03:02:30 user nova-compute[74898]:       <alias name='serial0'/>
Nov 17 03:02:30 user nova-compute[74898]:     </console>
Nov 17 03:02:30 user nova-compute[74898]:     <input type='mouse' bus='ps2'>
Nov 17 03:02:30 user nova-compute[74898]:       <alias name='input0'/>
Nov 17 03:02:30 user nova-compute[74898]:     </input>
Nov 17 03:02:30 user nova-compute[74898]:     <input type='keyboard' bus='ps2'>
Nov 17 03:02:30 user nova-compute[74898]:       <alias name='input1'/>
Nov 17 03:02:30 user nova-compute[74898]:     </input>
Nov 17 03:02:30 user nova-compute[74898]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 17 03:02:30 user nova-compute[74898]:       <listen type='address' address='0.0.0.0'/>
Nov 17 03:02:30 user nova-compute[74898]:     </graphics>
Nov 17 03:02:30 user nova-compute[74898]:     <audio id='1' type='none'/>
Nov 17 03:02:30 user nova-compute[74898]:     <video>
Nov 17 03:02:30 user nova-compute[74898]:       <model type='virtio' heads='1' primary='yes'/>
Nov 17 03:02:30 user nova-compute[74898]:       <alias name='video0'/>
Nov 17 03:02:30 user nova-compute[74898]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 17 03:02:30 user nova-compute[74898]:     </video>
Nov 17 03:02:30 user nova-compute[74898]:     <memballoon model='virtio'>
Nov 17 03:02:30 user nova-compute[74898]:       <stats period='10'/>
Nov 17 03:02:30 user nova-compute[74898]:       <alias name='balloon0'/>
Nov 17 03:02:30 user nova-compute[74898]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 17 03:02:30 user nova-compute[74898]:     </memballoon>
Nov 17 03:02:30 user nova-compute[74898]:     <rng model='virtio'>
Nov 17 03:02:30 user nova-compute[74898]:       <backend model='random'>/dev/urandom</backend>
Nov 17 03:02:30 user nova-compute[74898]:       <alias name='rng0'/>
Nov 17 03:02:30 user nova-compute[74898]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 17 03:02:30 user nova-compute[74898]:     </rng>
Nov 17 03:02:30 user nova-compute[74898]:   </devices>
Nov 17 03:02:30 user nova-compute[74898]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 17 03:02:30 user nova-compute[74898]:     <label>libvirt-b886ada4-5bcb-4b2a-b69e-80edefdd2119</label>
Nov 17 03:02:30 user nova-compute[74898]:     <imagelabel>libvirt-b886ada4-5bcb-4b2a-b69e-80edefdd2119</imagelabel>
Nov 17 03:02:30 user nova-compute[74898]:   </seclabel>
Nov 17 03:02:30 user nova-compute[74898]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 17 03:02:30 user nova-compute[74898]:     <label>+64055:+108</label>
Nov 17 03:02:30 user nova-compute[74898]:     <imagelabel>+64055:+108</imagelabel>
Nov 17 03:02:30 user nova-compute[74898]:   </seclabel>
Nov 17 03:02:30 user nova-compute[74898]: </domain>
Nov 17 03:02:30 user nova-compute[74898]:  {{(pid=74898) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 17 03:02:30 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [req-660b8146-f480-454a-a866-2b76d0d7c9a2 req-7402e0cd-443b-4ea0-9e38-7d4ba539b032 service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Detaching interface fa:16:3e:31:0f:fd failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap91e750ca-9d' not found.
Nov 17 03:02:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [req-660b8146-f480-454a-a866-2b76d0d7c9a2 req-7402e0cd-443b-4ea0-9e38-7d4ba539b032 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T02:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1059772796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1059772796',id=7,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbRzMswcys+QI6rLi6X0vGsy7XfMvLPPyHl7k0Ny6Kbzn4mYAR49YTYPPYUhsJ7Wj7VjaU+vGFbOCukOTayflDVlC4cnZKPAPKbqPCeENy+82k6vfJ0ZQpQ1EY3m67/9g==',key_name='tempest-keypair-1533313292',keypairs=<?>,launch_index=0,launched_at=2023-11-17T02:59:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c45541cf5bd44c2a34d5a31f04e2a2a',ramdisk_id='',reservation_id='r-ftctsg18',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1966129795',owner_user_name='tempest-TaggedAttachmentsTest-1966129795-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T02:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7c4ed2ec81a411c95b2be4dcfb9859d',uuid=b886ada4-5bcb-4b2a-b69e-80edefdd2119,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91e750ca-9d66-4a01-927f-43eace319a06", "address": "fa:16:3e:31:0f:fd", "network": {"id": "c40bf74e-2312-450f-ae66-15e481af3230", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1183652464", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8c45541cf5bd44c2a34d5a31f04e2a2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e750ca-9d", "ovs_interfaceid": "91e750ca-9d66-4a01-927f-43eace319a06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG nova.network.os_vif_util [req-660b8146-f480-454a-a866-2b76d0d7c9a2 req-7402e0cd-443b-4ea0-9e38-7d4ba539b032 service nova] Converting VIF {"id": "91e750ca-9d66-4a01-927f-43eace319a06", "address": "fa:16:3e:31:0f:fd", "network": {"id": "c40bf74e-2312-450f-ae66-15e481af3230", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1183652464", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8c45541cf5bd44c2a34d5a31f04e2a2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e750ca-9d", "ovs_interfaceid": "91e750ca-9d66-4a01-927f-43eace319a06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG nova.network.os_vif_util [req-660b8146-f480-454a-a866-2b76d0d7c9a2 req-7402e0cd-443b-4ea0-9e38-7d4ba539b032 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:0f:fd,bridge_name='br-int',has_traffic_filtering=True,id=91e750ca-9d66-4a01-927f-43eace319a06,network=Network(c40bf74e-2312-450f-ae66-15e481af3230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e750ca-9d') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG os_vif [req-660b8146-f480-454a-a866-2b76d0d7c9a2 req-7402e0cd-443b-4ea0-9e38-7d4ba539b032 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:0f:fd,bridge_name='br-int',has_traffic_filtering=True,id=91e750ca-9d66-4a01-927f-43eace319a06,network=Network(c40bf74e-2312-450f-ae66-15e481af3230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e750ca-9d') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91e750ca-9d, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:02:30 user nova-compute[74898]: INFO os_vif [req-660b8146-f480-454a-a866-2b76d0d7c9a2 req-7402e0cd-443b-4ea0-9e38-7d4ba539b032 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:0f:fd,bridge_name='br-int',has_traffic_filtering=True,id=91e750ca-9d66-4a01-927f-43eace319a06,network=Network(c40bf74e-2312-450f-ae66-15e481af3230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e750ca-9d')
Nov 17 03:02:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [req-660b8146-f480-454a-a866-2b76d0d7c9a2 req-7402e0cd-443b-4ea0-9e38-7d4ba539b032 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:02:30 user nova-compute[74898]:   <nova:package version="0.0.0"/>
Nov 17 03:02:30 user nova-compute[74898]:   <nova:name>tempest-device-tagging-server-1059772796</nova:name>
Nov 17 03:02:30 user nova-compute[74898]:   <nova:creationTime>2023-11-17 03:02:30</nova:creationTime>
Nov 17 03:02:30 user nova-compute[74898]:   <nova:flavor name="m1.tiny">
Nov 17 03:02:30 user nova-compute[74898]:     <nova:memory>512</nova:memory>
Nov 17 03:02:30 user nova-compute[74898]:     <nova:disk>1</nova:disk>
Nov 17 03:02:30 user nova-compute[74898]:     <nova:swap>0</nova:swap>
Nov 17 03:02:30 user nova-compute[74898]:     <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:02:30 user nova-compute[74898]:     <nova:vcpus>1</nova:vcpus>
Nov 17 03:02:30 user nova-compute[74898]:   </nova:flavor>
Nov 17 03:02:30 user nova-compute[74898]:   <nova:owner>
Nov 17 03:02:30 user nova-compute[74898]:     <nova:user uuid="f7c4ed2ec81a411c95b2be4dcfb9859d">tempest-TaggedAttachmentsTest-1966129795-project-member</nova:user>
Nov 17 03:02:30 user nova-compute[74898]:     <nova:project uuid="8c45541cf5bd44c2a34d5a31f04e2a2a">tempest-TaggedAttachmentsTest-1966129795</nova:project>
Nov 17 03:02:30 user nova-compute[74898]:   </nova:owner>
Nov 17 03:02:30 user nova-compute[74898]:   <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:02:30 user nova-compute[74898]:   <nova:ports>
Nov 17 03:02:30 user nova-compute[74898]:     <nova:port uuid="bd3b73ca-0068-42f4-8cf3-f84932dee960">
Nov 17 03:02:30 user nova-compute[74898]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 17 03:02:30 user nova-compute[74898]:     </nova:port>
Nov 17 03:02:30 user nova-compute[74898]:   </nova:ports>
Nov 17 03:02:30 user nova-compute[74898]: </nova:instance>
Nov 17 03:02:30 user nova-compute[74898]:  {{(pid=74898) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:02:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] No VIF found with MAC fa:16:3e:6f:9f:8e, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:02:31 user nova-compute[74898]: DEBUG nova.network.neutron [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Updating instance_info_cache with network_info: [{"id": "bd3b73ca-0068-42f4-8cf3-f84932dee960", "address": "fa:16:3e:2d:e6:07", "network": {"id": "a432562d-92fd-4786-944f-3a082f5146e8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1288851087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c45541cf5bd44c2a34d5a31f04e2a2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3b73ca-00", "ovs_interfaceid": "bd3b73ca-0068-42f4-8cf3-f84932dee960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:02:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Releasing lock "refresh_cache-b886ada4-5bcb-4b2a-b69e-80edefdd2119" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:02:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-9cba848e-40d3-4968-ae3f-9bd1f8339fe8 tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "interface-b886ada4-5bcb-4b2a-b69e-80edefdd2119-91e750ca-9d66-4a01-927f-43eace319a06" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.864s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:32 user nova-compute[74898]: DEBUG nova.compute.manager [req-a84135b2-cddb-43ea-8532-4c7ba295ca06 req-7f191dab-4333-43da-821e-20984338b789 service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Received event network-vif-plugged-5415aaa1-723f-4f35-971c-509caa04575d {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a84135b2-cddb-43ea-8532-4c7ba295ca06 req-7f191dab-4333-43da-821e-20984338b789 service nova] Acquiring lock "36e687c0-9481-4126-b365-f7f9707e2338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a84135b2-cddb-43ea-8532-4c7ba295ca06 req-7f191dab-4333-43da-821e-20984338b789 service nova] Lock "36e687c0-9481-4126-b365-f7f9707e2338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a84135b2-cddb-43ea-8532-4c7ba295ca06 req-7f191dab-4333-43da-821e-20984338b789 service nova] Lock "36e687c0-9481-4126-b365-f7f9707e2338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:32 user nova-compute[74898]: DEBUG nova.compute.manager [req-a84135b2-cddb-43ea-8532-4c7ba295ca06 req-7f191dab-4333-43da-821e-20984338b789 service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] No waiting events found dispatching network-vif-plugged-5415aaa1-723f-4f35-971c-509caa04575d {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:02:32 user nova-compute[74898]: WARNING nova.compute.manager [req-a84135b2-cddb-43ea-8532-4c7ba295ca06 req-7f191dab-4333-43da-821e-20984338b789 service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Received unexpected event network-vif-plugged-5415aaa1-723f-4f35-971c-509caa04575d for instance with vm_state building and task_state spawning.
Nov 17 03:02:32 user nova-compute[74898]: DEBUG nova.compute.manager [req-a84135b2-cddb-43ea-8532-4c7ba295ca06 req-7f191dab-4333-43da-821e-20984338b789 service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Received event network-vif-plugged-5415aaa1-723f-4f35-971c-509caa04575d {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a84135b2-cddb-43ea-8532-4c7ba295ca06 req-7f191dab-4333-43da-821e-20984338b789 service nova] Acquiring lock "36e687c0-9481-4126-b365-f7f9707e2338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a84135b2-cddb-43ea-8532-4c7ba295ca06 req-7f191dab-4333-43da-821e-20984338b789 service nova] Lock "36e687c0-9481-4126-b365-f7f9707e2338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a84135b2-cddb-43ea-8532-4c7ba295ca06 req-7f191dab-4333-43da-821e-20984338b789 service nova] Lock "36e687c0-9481-4126-b365-f7f9707e2338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:32 user nova-compute[74898]: DEBUG nova.compute.manager [req-a84135b2-cddb-43ea-8532-4c7ba295ca06 req-7f191dab-4333-43da-821e-20984338b789 service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] No waiting events found dispatching network-vif-plugged-5415aaa1-723f-4f35-971c-509caa04575d {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:02:32 user nova-compute[74898]: WARNING nova.compute.manager [req-a84135b2-cddb-43ea-8532-4c7ba295ca06 req-7f191dab-4333-43da-821e-20984338b789 service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Received unexpected event network-vif-plugged-5415aaa1-723f-4f35-971c-509caa04575d for instance with vm_state building and task_state spawning.
Nov 17 03:02:33 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Myjovkqc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:02:33 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:02:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:02:33 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:02:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:02:33 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b77b23-69e8-4766-b18a-6f4f560c451e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:02:33 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a4c756-14ab-4140-81b8-6051d663145c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019] added
Nov 17 03:02:33 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[81203480-fda0-4cf1-9db7-45515b931903]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b05bc6f-b0ae-4637-a793-dfbd108c17bd]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Myjovkqc {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Myjovkqc" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e871bc85-bb96-47fe-936c-247d48431b02]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Myjovkqc'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8442b14-706a-47ff-aad3-4128e95f410d]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fc2c78-b0a3-4e9b-a245-2cbe056814fa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:02:33 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:02:33 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4ea6b6-c6e1-4c20-bdae-228e39ba242b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019, portal: 172.16.0.220,3260]
Nov 17 03:02:33 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019, portal: 172.16.0.220,3260] successful.
Nov 17 03:02:33 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d50932-6bc3-42c9-bdca-189c6c152dc2]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc2fadb-33e2-4430-8419-f71698b4667b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:02:33 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:02:33 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:02:33 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:02:33 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] HCTL ('34', '-', '-', 0) found on session 11 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1917478b-4128-4632-9f1e-37b11909a1fd]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Searching for a device in session 11 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:02:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Myjovkqc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:02:34 user nova-compute[74898]: DEBUG nova.compute.manager [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:02:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:02:34 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Instance spawned successfully.
Nov 17 03:02:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:02:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:02:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:02:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:02:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:02:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:02:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:02:34 user nova-compute[74898]: INFO nova.compute.manager [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Took 5.00 seconds to spawn the instance on the hypervisor.
Nov 17 03:02:34 user nova-compute[74898]: DEBUG nova.compute.manager [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:02:34 user nova-compute[74898]: INFO nova.compute.manager [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Took 11.53 seconds to build instance.
Nov 17 03:02:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6c698e2d-d445-4b09-a1bc-0ec9c5f5d53e tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "36e687c0-9481-4126-b365-f7f9707e2338" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.631s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:02:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23666303065653037', 'path': '/dev/sdc'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:02:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666303065653037', 'path': '/dev/sdc'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:02:34 user nova-compute[74898]: DEBUG nova.objects.instance [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lazy-loading 'flavor' on Instance uuid 4b869a55-acf6-4550-9354-2480273a4ee2 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:02:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 03:02:34 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:02:34 user nova-compute[74898]:   <source dev="/dev/sdc"/>
Nov 17 03:02:34 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:02:34 user nova-compute[74898]:   <serial>a634de04-148d-4da4-816d-617343087019</serial>
Nov 17 03:02:34 user nova-compute[74898]: </disk>
Nov 17 03:02:34 user nova-compute[74898]:  {{(pid=74898) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 03:02:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Acquiring lock "ba39a7b9-8b0a-421c-80d1-6bd3f32aef42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "ba39a7b9-8b0a-421c-80d1-6bd3f32aef42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:34 user nova-compute[74898]: DEBUG nova.compute.manager [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:02:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:34 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:02:34 user nova-compute[74898]: INFO nova.compute.claims [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Claim successful on node user
Nov 17 03:02:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:02:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:02:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] No VIF found with MAC fa:16:3e:cd:e9:3a, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:02:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-81c568ce-c6e4-4fc2-94ba-4398ea07bf5b tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "4b869a55-acf6-4550-9354-2480273a4ee2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.864s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:35 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:02:35 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:02:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.542s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:35 user nova-compute[74898]: DEBUG nova.compute.manager [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:02:35 user nova-compute[74898]: DEBUG nova.compute.manager [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:02:35 user nova-compute[74898]: DEBUG nova.network.neutron [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:02:35 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:02:35 user nova-compute[74898]: DEBUG nova.compute.manager [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:02:35 user nova-compute[74898]: DEBUG nova.policy [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a8202cbeb204cd38b3f8daa90578dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29dfc5e055942b4af680a17e5b1de13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:02:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:35 user nova-compute[74898]: DEBUG nova.compute.manager [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:02:35 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:02:35 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Creating image(s)
Nov 17 03:02:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Acquiring lock "/opt/stack/data/nova/instances/ba39a7b9-8b0a-421c-80d1-6bd3f32aef42/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "/opt/stack/data/nova/instances/ba39a7b9-8b0a-421c-80d1-6bd3f32aef42/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "/opt/stack/data/nova/instances/ba39a7b9-8b0a-421c-80d1-6bd3f32aef42/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.194s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.205s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/ba39a7b9-8b0a-421c-80d1-6bd3f32aef42/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:35 user nova-compute[74898]: DEBUG nova.network.neutron [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Successfully created port: 944fd53e-41fc-471e-b185-cda1e137d8b5 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:02:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/ba39a7b9-8b0a-421c-80d1-6bd3f32aef42/disk 1073741824" returned: 0 in 0.065s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.273s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:36 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ba39a7b9-8b0a-421c-80d1-6bd3f32aef42/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:02:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba39a7b9-8b0a-421c-80d1-6bd3f32aef42/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba39a7b9-8b0a-421c-80d1-6bd3f32aef42/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:36 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Cannot resize image /opt/stack/data/nova/instances/ba39a7b9-8b0a-421c-80d1-6bd3f32aef42/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:02:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:02:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Ensure instance console log exists: /opt/stack/data/nova/instances/ba39a7b9-8b0a-421c-80d1-6bd3f32aef42/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:02:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:36 user nova-compute[74898]: DEBUG nova.network.neutron [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Successfully updated port: 944fd53e-41fc-471e-b185-cda1e137d8b5 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:02:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Acquiring lock "refresh_cache-ba39a7b9-8b0a-421c-80d1-6bd3f32aef42" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:02:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Acquired lock "refresh_cache-ba39a7b9-8b0a-421c-80d1-6bd3f32aef42" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:02:36 user nova-compute[74898]: DEBUG nova.network.neutron [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:02:36 user nova-compute[74898]: DEBUG nova.compute.manager [req-c38a0010-c6c2-4ab2-85e8-2a91667fddeb req-355f6fd7-69c7-4ee4-97c1-bd1bdde5b057 service nova] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Received event network-changed-944fd53e-41fc-471e-b185-cda1e137d8b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:36 user nova-compute[74898]: DEBUG nova.compute.manager [req-c38a0010-c6c2-4ab2-85e8-2a91667fddeb req-355f6fd7-69c7-4ee4-97c1-bd1bdde5b057 service nova] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Refreshing instance network info cache due to event network-changed-944fd53e-41fc-471e-b185-cda1e137d8b5. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:02:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c38a0010-c6c2-4ab2-85e8-2a91667fddeb req-355f6fd7-69c7-4ee4-97c1-bd1bdde5b057 service nova] Acquiring lock "refresh_cache-ba39a7b9-8b0a-421c-80d1-6bd3f32aef42" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.network.neutron [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.network.neutron [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Updating instance_info_cache with network_info: [{"id": "944fd53e-41fc-471e-b185-cda1e137d8b5", "address": "fa:16:3e:a6:ae:f0", "network": {"id": "7ed585ab-8901-4ced-a881-2dd15371baa7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-738644687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d29dfc5e055942b4af680a17e5b1de13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap944fd53e-41", "ovs_interfaceid": "944fd53e-41fc-471e-b185-cda1e137d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Releasing lock "refresh_cache-ba39a7b9-8b0a-421c-80d1-6bd3f32aef42" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.compute.manager [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Instance network_info: |[{"id": "944fd53e-41fc-471e-b185-cda1e137d8b5", "address": "fa:16:3e:a6:ae:f0", "network": {"id": "7ed585ab-8901-4ced-a881-2dd15371baa7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-738644687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d29dfc5e055942b4af680a17e5b1de13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap944fd53e-41", "ovs_interfaceid": "944fd53e-41fc-471e-b185-cda1e137d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c38a0010-c6c2-4ab2-85e8-2a91667fddeb req-355f6fd7-69c7-4ee4-97c1-bd1bdde5b057 service nova] Acquired lock "refresh_cache-ba39a7b9-8b0a-421c-80d1-6bd3f32aef42" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.network.neutron [req-c38a0010-c6c2-4ab2-85e8-2a91667fddeb req-355f6fd7-69c7-4ee4-97c1-bd1bdde5b057 service nova] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Refreshing network info cache for port 944fd53e-41fc-471e-b185-cda1e137d8b5 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Start _get_guest_xml network_info=[{"id": "944fd53e-41fc-471e-b185-cda1e137d8b5", "address": "fa:16:3e:a6:ae:f0", "network": {"id": "7ed585ab-8901-4ced-a881-2dd15371baa7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-738644687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d29dfc5e055942b4af680a17e5b1de13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap944fd53e-41", "ovs_interfaceid": "944fd53e-41fc-471e-b185-cda1e137d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:02:37 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:02:37 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-294260331',display_name='tempest-VolumesAdminNegativeTest-server-294260331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-294260331',id=14,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d29dfc5e055942b4af680a17e5b1de13',ramdisk_id='',reservation_id='r-zokasr2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1538245231',owner_user_name='tempest-VolumesAdminNegativeTest-1538245231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:02:35Z,user_data=None,user_id='7a8202cbeb204cd38b3f8daa90578dbf',uuid=ba39a7b9-8b0a-421c-80d1-6bd3f32aef42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "944fd53e-41fc-471e-b185-cda1e137d8b5", "address": "fa:16:3e:a6:ae:f0", "network": {"id": "7ed585ab-8901-4ced-a881-2dd15371baa7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-738644687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d29dfc5e055942b4af680a17e5b1de13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap944fd53e-41", "ovs_interfaceid": "944fd53e-41fc-471e-b185-cda1e137d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Converting VIF {"id": "944fd53e-41fc-471e-b185-cda1e137d8b5", "address": "fa:16:3e:a6:ae:f0", "network": {"id": "7ed585ab-8901-4ced-a881-2dd15371baa7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-738644687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d29dfc5e055942b4af680a17e5b1de13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap944fd53e-41", "ovs_interfaceid": "944fd53e-41fc-471e-b185-cda1e137d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:ae:f0,bridge_name='br-int',has_traffic_filtering=True,id=944fd53e-41fc-471e-b185-cda1e137d8b5,network=Network(7ed585ab-8901-4ced-a881-2dd15371baa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap944fd53e-41') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.objects.instance [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lazy-loading 'pci_devices' on Instance uuid ba39a7b9-8b0a-421c-80d1-6bd3f32aef42 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:02:37 user nova-compute[74898]:   <uuid>ba39a7b9-8b0a-421c-80d1-6bd3f32aef42</uuid>
Nov 17 03:02:37 user nova-compute[74898]:   <name>instance-0000000e</name>
Nov 17 03:02:37 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:02:37 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:02:37 user nova-compute[74898]:   <metadata>
Nov 17 03:02:37 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:02:37 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:02:37 user nova-compute[74898]:       <nova:name>tempest-VolumesAdminNegativeTest-server-294260331</nova:name>
Nov 17 03:02:37 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:02:37</nova:creationTime>
Nov 17 03:02:37 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:02:37 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:02:37 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:02:37 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:02:37 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:02:37 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:02:37 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:02:37 user nova-compute[74898]:       <nova:owner>
Nov 17 03:02:37 user nova-compute[74898]:         <nova:user uuid="7a8202cbeb204cd38b3f8daa90578dbf">tempest-VolumesAdminNegativeTest-1538245231-project-member</nova:user>
Nov 17 03:02:37 user nova-compute[74898]:         <nova:project uuid="d29dfc5e055942b4af680a17e5b1de13">tempest-VolumesAdminNegativeTest-1538245231</nova:project>
Nov 17 03:02:37 user nova-compute[74898]:       </nova:owner>
Nov 17 03:02:37 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:02:37 user nova-compute[74898]:       <nova:ports>
Nov 17 03:02:37 user nova-compute[74898]:         <nova:port uuid="944fd53e-41fc-471e-b185-cda1e137d8b5">
Nov 17 03:02:37 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 17 03:02:37 user nova-compute[74898]:         </nova:port>
Nov 17 03:02:37 user nova-compute[74898]:       </nova:ports>
Nov 17 03:02:37 user nova-compute[74898]:     </nova:instance>
Nov 17 03:02:37 user nova-compute[74898]:   </metadata>
Nov 17 03:02:37 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:02:37 user nova-compute[74898]:     <system>
Nov 17 03:02:37 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:02:37 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:02:37 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:02:37 user nova-compute[74898]:       <entry name="serial">ba39a7b9-8b0a-421c-80d1-6bd3f32aef42</entry>
Nov 17 03:02:37 user nova-compute[74898]:       <entry name="uuid">ba39a7b9-8b0a-421c-80d1-6bd3f32aef42</entry>
Nov 17 03:02:37 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:02:37 user nova-compute[74898]:     </system>
Nov 17 03:02:37 user nova-compute[74898]:   </sysinfo>
Nov 17 03:02:37 user nova-compute[74898]:   <os>
Nov 17 03:02:37 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:02:37 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:02:37 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:02:37 user nova-compute[74898]:   </os>
Nov 17 03:02:37 user nova-compute[74898]:   <features>
Nov 17 03:02:37 user nova-compute[74898]:     <acpi/>
Nov 17 03:02:37 user nova-compute[74898]:     <apic/>
Nov 17 03:02:37 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:02:37 user nova-compute[74898]:   </features>
Nov 17 03:02:37 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:02:37 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:02:37 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:02:37 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:02:37 user nova-compute[74898]:   </clock>
Nov 17 03:02:37 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:02:37 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:02:37 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:02:37 user nova-compute[74898]:   </cpu>
Nov 17 03:02:37 user nova-compute[74898]:   <devices>
Nov 17 03:02:37 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:02:37 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:02:37 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/ba39a7b9-8b0a-421c-80d1-6bd3f32aef42/disk"/>
Nov 17 03:02:37 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:02:37 user nova-compute[74898]:     </disk>
Nov 17 03:02:37 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:02:37 user nova-compute[74898]:       <mac address="fa:16:3e:a6:ae:f0"/>
Nov 17 03:02:37 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:02:37 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:02:37 user nova-compute[74898]:       <target dev="tap944fd53e-41"/>
Nov 17 03:02:37 user nova-compute[74898]:     </interface>
Nov 17 03:02:37 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:02:37 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/ba39a7b9-8b0a-421c-80d1-6bd3f32aef42/console.log" append="off"/>
Nov 17 03:02:37 user nova-compute[74898]:     </serial>
Nov 17 03:02:37 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:02:37 user nova-compute[74898]:     <video>
Nov 17 03:02:37 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:02:37 user nova-compute[74898]:     </video>
Nov 17 03:02:37 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:02:37 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:02:37 user nova-compute[74898]:     </rng>
Nov 17 03:02:37 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:02:37 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:02:37 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:02:37 user nova-compute[74898]:     </memballoon>
Nov 17 03:02:37 user nova-compute[74898]:   </devices>
Nov 17 03:02:37 user nova-compute[74898]: </domain>
Nov 17 03:02:37 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-294260331',display_name='tempest-VolumesAdminNegativeTest-server-294260331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-294260331',id=14,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d29dfc5e055942b4af680a17e5b1de13',ramdisk_id='',reservation_id='r-zokasr2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1538245231',owner_user_name='tempest-VolumesAdminNegativeTest-1538245231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:02:35Z,user_data=None,user_id='7a8202cbeb204cd38b3f8daa90578dbf',uuid=ba39a7b9-8b0a-421c-80d1-6bd3f32aef42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "944fd53e-41fc-471e-b185-cda1e137d8b5", "address": "fa:16:3e:a6:ae:f0", "network": {"id": "7ed585ab-8901-4ced-a881-2dd15371baa7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-738644687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d29dfc5e055942b4af680a17e5b1de13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap944fd53e-41", "ovs_interfaceid": "944fd53e-41fc-471e-b185-cda1e137d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Converting VIF {"id": "944fd53e-41fc-471e-b185-cda1e137d8b5", "address": "fa:16:3e:a6:ae:f0", "network": {"id": "7ed585ab-8901-4ced-a881-2dd15371baa7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-738644687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d29dfc5e055942b4af680a17e5b1de13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap944fd53e-41", "ovs_interfaceid": "944fd53e-41fc-471e-b185-cda1e137d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:ae:f0,bridge_name='br-int',has_traffic_filtering=True,id=944fd53e-41fc-471e-b185-cda1e137d8b5,network=Network(7ed585ab-8901-4ced-a881-2dd15371baa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap944fd53e-41') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG os_vif [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:ae:f0,bridge_name='br-int',has_traffic_filtering=True,id=944fd53e-41fc-471e-b185-cda1e137d8b5,network=Network(7ed585ab-8901-4ced-a881-2dd15371baa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap944fd53e-41') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '097042ea-b2ea-5ebd-a172-3169dcb7b17b', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap944fd53e-41, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap944fd53e-41, col_values=(('qos', UUID('ea521657-b435-44a1-8231-4ccf0b87f666')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap944fd53e-41, col_values=(('external_ids', {'iface-id': '944fd53e-41fc-471e-b185-cda1e137d8b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:ae:f0', 'vm-uuid': 'ba39a7b9-8b0a-421c-80d1-6bd3f32aef42'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:37 user nova-compute[74898]: INFO os_vif [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:ae:f0,bridge_name='br-int',has_traffic_filtering=True,id=944fd53e-41fc-471e-b185-cda1e137d8b5,network=Network(7ed585ab-8901-4ced-a881-2dd15371baa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap944fd53e-41')
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] No VIF found with MAC fa:16:3e:a6:ae:f0, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.network.neutron [req-c38a0010-c6c2-4ab2-85e8-2a91667fddeb req-355f6fd7-69c7-4ee4-97c1-bd1bdde5b057 service nova] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Updated VIF entry in instance network info cache for port 944fd53e-41fc-471e-b185-cda1e137d8b5. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG nova.network.neutron [req-c38a0010-c6c2-4ab2-85e8-2a91667fddeb req-355f6fd7-69c7-4ee4-97c1-bd1bdde5b057 service nova] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Updating instance_info_cache with network_info: [{"id": "944fd53e-41fc-471e-b185-cda1e137d8b5", "address": "fa:16:3e:a6:ae:f0", "network": {"id": "7ed585ab-8901-4ced-a881-2dd15371baa7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-738644687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d29dfc5e055942b4af680a17e5b1de13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap944fd53e-41", "ovs_interfaceid": "944fd53e-41fc-471e-b185-cda1e137d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:02:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c38a0010-c6c2-4ab2-85e8-2a91667fddeb req-355f6fd7-69c7-4ee4-97c1-bd1bdde5b057 service nova] Releasing lock "refresh_cache-ba39a7b9-8b0a-421c-80d1-6bd3f32aef42" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:02:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-77e2c260-800b-4ad0-beaa-d3209d05bea3 req-aceae821-2914-4938-94fe-a3cf7e7a5210 service nova] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Received event network-vif-plugged-944fd53e-41fc-471e-b185-cda1e137d8b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-77e2c260-800b-4ad0-beaa-d3209d05bea3 req-aceae821-2914-4938-94fe-a3cf7e7a5210 service nova] Acquiring lock "ba39a7b9-8b0a-421c-80d1-6bd3f32aef42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-77e2c260-800b-4ad0-beaa-d3209d05bea3 req-aceae821-2914-4938-94fe-a3cf7e7a5210 service nova] Lock "ba39a7b9-8b0a-421c-80d1-6bd3f32aef42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-77e2c260-800b-4ad0-beaa-d3209d05bea3 req-aceae821-2914-4938-94fe-a3cf7e7a5210 service nova] Lock "ba39a7b9-8b0a-421c-80d1-6bd3f32aef42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-77e2c260-800b-4ad0-beaa-d3209d05bea3 req-aceae821-2914-4938-94fe-a3cf7e7a5210 service nova] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] No waiting events found dispatching network-vif-plugged-944fd53e-41fc-471e-b185-cda1e137d8b5 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:02:39 user nova-compute[74898]: WARNING nova.compute.manager [req-77e2c260-800b-4ad0-beaa-d3209d05bea3 req-aceae821-2914-4938-94fe-a3cf7e7a5210 service nova] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Received unexpected event network-vif-plugged-944fd53e-41fc-471e-b185-cda1e137d8b5 for instance with vm_state building and task_state spawning.
Nov 17 03:02:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Acquiring lock "4b869a55-acf6-4550-9354-2480273a4ee2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "4b869a55-acf6-4550-9354-2480273a4ee2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:40 user nova-compute[74898]: DEBUG nova.objects.instance [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lazy-loading 'flavor' on Instance uuid 4b869a55-acf6-4550-9354-2480273a4ee2 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:02:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "4b869a55-acf6-4550-9354-2480273a4ee2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Acquiring lock "4b869a55-acf6-4550-9354-2480273a4ee2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "4b869a55-acf6-4550-9354-2480273a4ee2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:40 user nova-compute[74898]: INFO nova.compute.manager [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Attaching volume dde9aed6-04ca-4387-a9a2-a617b225066a to /dev/vdc
Nov 17 03:02:40 user nova-compute[74898]: DEBUG os_brick.utils [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:02:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[22982073-2089-4153-80bd-b4a61cc22e1d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1e2982-fe8d-4ad1-a9e2-dd95f00a8315]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec3dbc2-0abe-4dcc-8ac7-f4721a60463c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[36567c2e-a31a-4f63-b79d-ac2cbc21ef53]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:02:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:02:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:02:40 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:02:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1019b8b-39d0-451c-8d84-9cd3400e7612]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:02:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:02:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:02:40 user nova-compute[74898]: DEBUG os_brick.utils [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:02:40 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Updating existing volume attachment record: 5f7d7a7e-99d4-4321-a022-80fc39144eca {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:02:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:41 user nova-compute[74898]: DEBUG nova.compute.manager [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:02:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:02:41 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Instance spawned successfully.
Nov 17 03:02:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:02:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:02:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:02:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:02:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:02:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:02:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:02:41 user nova-compute[74898]: DEBUG nova.compute.manager [req-a5c913b8-11cf-4d71-90ca-5ea9dde5ede1 req-35ccd90a-74db-4df1-8b04-4323117557b8 service nova] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Received event network-vif-plugged-944fd53e-41fc-471e-b185-cda1e137d8b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a5c913b8-11cf-4d71-90ca-5ea9dde5ede1 req-35ccd90a-74db-4df1-8b04-4323117557b8 service nova] Acquiring lock "ba39a7b9-8b0a-421c-80d1-6bd3f32aef42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a5c913b8-11cf-4d71-90ca-5ea9dde5ede1 req-35ccd90a-74db-4df1-8b04-4323117557b8 service nova] Lock "ba39a7b9-8b0a-421c-80d1-6bd3f32aef42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a5c913b8-11cf-4d71-90ca-5ea9dde5ede1 req-35ccd90a-74db-4df1-8b04-4323117557b8 service nova] Lock "ba39a7b9-8b0a-421c-80d1-6bd3f32aef42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:41 user nova-compute[74898]: DEBUG nova.compute.manager [req-a5c913b8-11cf-4d71-90ca-5ea9dde5ede1 req-35ccd90a-74db-4df1-8b04-4323117557b8 service nova] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] No waiting events found dispatching network-vif-plugged-944fd53e-41fc-471e-b185-cda1e137d8b5 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:02:41 user nova-compute[74898]: WARNING nova.compute.manager [req-a5c913b8-11cf-4d71-90ca-5ea9dde5ede1 req-35ccd90a-74db-4df1-8b04-4323117557b8 service nova] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Received unexpected event network-vif-plugged-944fd53e-41fc-471e-b185-cda1e137d8b5 for instance with vm_state building and task_state spawning.
Nov 17 03:02:41 user nova-compute[74898]: INFO nova.compute.manager [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Took 5.88 seconds to spawn the instance on the hypervisor.
Nov 17 03:02:41 user nova-compute[74898]: DEBUG nova.compute.manager [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:02:41 user nova-compute[74898]: INFO nova.compute.manager [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Took 6.79 seconds to build instance.
Nov 17 03:02:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-35466d81-faf4-4e1f-973b-7973769d9da1 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "ba39a7b9-8b0a-421c-80d1-6bd3f32aef42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.888s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNWYShdb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:02:46 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:02:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:02:46 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:02:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:02:46 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[829802a0-b3c8-4f1d-8253-66e5d97e2633]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:02:46 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d350d3c-bfc9-453b-a01b-2d3b05e16ae2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a] added
Nov 17 03:02:46 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4b054b-ea4a-4bb9-b3f2-ad8c243e4e3b]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4955dcb-ff96-4808-a24b-73795aa832b6]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BNWYShdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BNWYShdb" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a9e6eb-4537-4fc5-8f23-ada3ef273361]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BNWYShdb'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbaffa50-9ff8-43aa-8c4f-b5276c5749b6]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d39089-39f3-4bdf-94f8-a98243c64146]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:02:46 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:02:46 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:02:46 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:02:46 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88a4567-a2cd-4267-9b6f-55048f5298a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a, portal: 172.16.0.220,3260]
Nov 17 03:02:46 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a, portal: 172.16.0.220,3260] successful.
Nov 17 03:02:46 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0761ae-0a49-4b31-b7fe-048aa945ec0a]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[353b7801-b41a-4b24-916f-369e9bbf11cc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:02:46 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:02:46 user nova-compute[74898]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a (non-flash)
Nov 17 03:02:46 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:02:46 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:02:46 user nova-compute[74898]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a (non-flash)
Nov 17 03:02:46 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] HCTL ('35', '-', '-', 0) found on session 12 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6240ded9-6345-45db-88db-11c4f3648d1e]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Searching for a device in session 12 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:02:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNWYShdb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:02:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:47 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:02:47 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23266316533363335', 'path': '/dev/sdd'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:02:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266316533363335', 'path': '/dev/sdd'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:02:47 user nova-compute[74898]: DEBUG nova.objects.instance [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lazy-loading 'flavor' on Instance uuid 4b869a55-acf6-4550-9354-2480273a4ee2 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:02:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 03:02:47 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:02:47 user nova-compute[74898]:   <source dev="/dev/sdd"/>
Nov 17 03:02:47 user nova-compute[74898]:   <target dev="vdc" bus="virtio"/>
Nov 17 03:02:47 user nova-compute[74898]:   <serial>dde9aed6-04ca-4387-a9a2-a617b225066a</serial>
Nov 17 03:02:47 user nova-compute[74898]: </disk>
Nov 17 03:02:47 user nova-compute[74898]:  {{(pid=74898) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "d1ee03a5-13fb-47e7-8712-ea31aed36643" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "d1ee03a5-13fb-47e7-8712-ea31aed36643" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG nova.objects.instance [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lazy-loading 'flavor' on Instance uuid d1ee03a5-13fb-47e7-8712-ea31aed36643 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "d1ee03a5-13fb-47e7-8712-ea31aed36643" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "d1ee03a5-13fb-47e7-8712-ea31aed36643" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "d1ee03a5-13fb-47e7-8712-ea31aed36643" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:48 user nova-compute[74898]: INFO nova.compute.manager [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Attaching volume 441761f8-0044-43bc-8437-f31147d6c4f8 to /dev/vdb
Nov 17 03:02:48 user nova-compute[74898]: DEBUG os_brick.utils [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b4b091-c54c-44c7-9f2f-5c819cb05731]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d14719f-66c5-456c-8043-6cbc98163b2e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[721e08df-3aca-4bb3-8b29-1811b5564fcb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6faa3dcc-7ee9-44f6-8d9b-8fe356100c9d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:02:48 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:02:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c830e4-5be9-4472-bee1-3c724eb120c6]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG os_brick.utils [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Updating existing volume attachment record: d90a4750-afe4-4b9a-98ca-7816b44c63d6 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] No VIF found with MAC fa:16:3e:cd:e9:3a, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:02:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1bd69d79-106c-4bec-897f-0110ff015d94 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "4b869a55-acf6-4550-9354-2480273a4ee2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.524s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Acquiring lock "4b869a55-acf6-4550-9354-2480273a4ee2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "4b869a55-acf6-4550-9354-2480273a4ee2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:49 user nova-compute[74898]: INFO nova.compute.manager [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Detaching volume dde9aed6-04ca-4387-a9a2-a617b225066a
Nov 17 03:02:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-54065576-f95e-4b05-9156-a9b315ecd0e6 tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Acquiring lock "e5885526-e2d0-41d4-8da1-b3440d243a19" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-54065576-f95e-4b05-9156-a9b315ecd0e6 tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Lock "e5885526-e2d0-41d4-8da1-b3440d243a19" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-54065576-f95e-4b05-9156-a9b315ecd0e6 tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Acquiring lock "e5885526-e2d0-41d4-8da1-b3440d243a19-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-54065576-f95e-4b05-9156-a9b315ecd0e6 tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Lock "e5885526-e2d0-41d4-8da1-b3440d243a19-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-54065576-f95e-4b05-9156-a9b315ecd0e6 tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Lock "e5885526-e2d0-41d4-8da1-b3440d243a19-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:49 user nova-compute[74898]: INFO nova.compute.manager [None req-54065576-f95e-4b05-9156-a9b315ecd0e6 tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Terminating instance
Nov 17 03:02:49 user nova-compute[74898]: DEBUG nova.compute.manager [None req-54065576-f95e-4b05-9156-a9b315ecd0e6 tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:02:49 user nova-compute[74898]: INFO nova.virt.block_device [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Attempting to driver detach volume dde9aed6-04ca-4387-a9a2-a617b225066a from mountpoint /dev/vdc
Nov 17 03:02:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Attempting to detach device vdc from instance 4b869a55-acf6-4550-9354-2480273a4ee2 from the persistent domain config. {{(pid=74898) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 03:02:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:02:49 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:02:49 user nova-compute[74898]:   <source dev="/dev/sdd"/>
Nov 17 03:02:49 user nova-compute[74898]:   <target dev="vdc" bus="virtio"/>
Nov 17 03:02:49 user nova-compute[74898]:   <serial>dde9aed6-04ca-4387-a9a2-a617b225066a</serial>
Nov 17 03:02:49 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 17 03:02:49 user nova-compute[74898]: </disk>
Nov 17 03:02:49 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:02:49 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Successfully detached device vdc from instance 4b869a55-acf6-4550-9354-2480273a4ee2 from the persistent domain config.
Nov 17 03:02:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 4b869a55-acf6-4550-9354-2480273a4ee2 from the live domain config. {{(pid=74898) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 03:02:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:02:49 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:02:49 user nova-compute[74898]:   <source dev="/dev/sdd"/>
Nov 17 03:02:49 user nova-compute[74898]:   <target dev="vdc" bus="virtio"/>
Nov 17 03:02:49 user nova-compute[74898]:   <serial>dde9aed6-04ca-4387-a9a2-a617b225066a</serial>
Nov 17 03:02:49 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 17 03:02:49 user nova-compute[74898]: </disk>
Nov 17 03:02:49 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:02:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:49 user nova-compute[74898]: DEBUG nova.compute.manager [req-424484d8-0c66-4c7d-b70b-5e7c823b1ede req-91f2849a-f745-4a01-92a9-2e4fb6fab9e8 service nova] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Received event network-vif-unplugged-9bcfc458-e33f-4119-91dc-af8a29f214e8 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-424484d8-0c66-4c7d-b70b-5e7c823b1ede req-91f2849a-f745-4a01-92a9-2e4fb6fab9e8 service nova] Acquiring lock "e5885526-e2d0-41d4-8da1-b3440d243a19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-424484d8-0c66-4c7d-b70b-5e7c823b1ede req-91f2849a-f745-4a01-92a9-2e4fb6fab9e8 service nova] Lock "e5885526-e2d0-41d4-8da1-b3440d243a19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-424484d8-0c66-4c7d-b70b-5e7c823b1ede req-91f2849a-f745-4a01-92a9-2e4fb6fab9e8 service nova] Lock "e5885526-e2d0-41d4-8da1-b3440d243a19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:49 user nova-compute[74898]: DEBUG nova.compute.manager [req-424484d8-0c66-4c7d-b70b-5e7c823b1ede req-91f2849a-f745-4a01-92a9-2e4fb6fab9e8 service nova] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] No waiting events found dispatching network-vif-unplugged-9bcfc458-e33f-4119-91dc-af8a29f214e8 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:02:49 user nova-compute[74898]: DEBUG nova.compute.manager [req-424484d8-0c66-4c7d-b70b-5e7c823b1ede req-91f2849a-f745-4a01-92a9-2e4fb6fab9e8 service nova] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Received event network-vif-unplugged-9bcfc458-e33f-4119-91dc-af8a29f214e8 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:02:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 4b869a55-acf6-4550-9354-2480273a4ee2 {{(pid=74898) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 03:02:50 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Instance destroyed successfully.
Nov 17 03:02:50 user nova-compute[74898]: DEBUG nova.objects.instance [None req-54065576-f95e-4b05-9156-a9b315ecd0e6 tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Lazy-loading 'resources' on Instance uuid e5885526-e2d0-41d4-8da1-b3440d243a19 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:02:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-54065576-f95e-4b05-9156-a9b315ecd0e6 tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:59:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1346803539',display_name='tempest-VolumesAssistedSnapshotsTest-server-1346803539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1346803539',id=9,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxzg7Va6PTW9bTrepjvinQmsSUemZ5Gcj2p486It2ugKXaqN4w5w24X992yN7jBzyi5lm7BNinGAzDIG7f3lM1DWALT1ZcATMF9WmYgjTzZ3T7fVwQ4IJxgGojRd7s/bw==',key_name='tempest-keypair-1780004240',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:00:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08934f3952aa4f01809ed58e16905fd1',ramdisk_id='',reservation_id='r-ye0jfeu1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-796155726',owner_user_name='tempest-VolumesAssistedSnapshotsTest-796155726-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:00:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93084077b7414f73b09bd22324488e74',uuid=e5885526-e2d0-41d4-8da1-b3440d243a19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9bcfc458-e33f-4119-91dc-af8a29f214e8", "address": "fa:16:3e:15:7a:74", "network": {"id": "8084ece6-42d8-412f-841a-f0a2b78991fa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1363926162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08934f3952aa4f01809ed58e16905fd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bcfc458-e3", "ovs_interfaceid": "9bcfc458-e33f-4119-91dc-af8a29f214e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:02:50 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-54065576-f95e-4b05-9156-a9b315ecd0e6 tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Converting VIF {"id": "9bcfc458-e33f-4119-91dc-af8a29f214e8", "address": "fa:16:3e:15:7a:74", "network": {"id": "8084ece6-42d8-412f-841a-f0a2b78991fa", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1363926162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08934f3952aa4f01809ed58e16905fd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bcfc458-e3", "ovs_interfaceid": "9bcfc458-e33f-4119-91dc-af8a29f214e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:02:50 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-54065576-f95e-4b05-9156-a9b315ecd0e6 tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:7a:74,bridge_name='br-int',has_traffic_filtering=True,id=9bcfc458-e33f-4119-91dc-af8a29f214e8,network=Network(8084ece6-42d8-412f-841a-f0a2b78991fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bcfc458-e3') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:02:50 user nova-compute[74898]: DEBUG os_vif [None req-54065576-f95e-4b05-9156-a9b315ecd0e6 tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:7a:74,bridge_name='br-int',has_traffic_filtering=True,id=9bcfc458-e33f-4119-91dc-af8a29f214e8,network=Network(8084ece6-42d8-412f-841a-f0a2b78991fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bcfc458-e3') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:02:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9bcfc458-e3, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:02:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b43f84c-b301-4269-92a2-9e58850183e1) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:02:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:02:50 user nova-compute[74898]: INFO os_vif [None req-54065576-f95e-4b05-9156-a9b315ecd0e6 tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:7a:74,bridge_name='br-int',has_traffic_filtering=True,id=9bcfc458-e33f-4119-91dc-af8a29f214e8,network=Network(8084ece6-42d8-412f-841a-f0a2b78991fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bcfc458-e3')
Nov 17 03:02:50 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-54065576-f95e-4b05-9156-a9b315ecd0e6 tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Deleting instance files /opt/stack/data/nova/instances/e5885526-e2d0-41d4-8da1-b3440d243a19_del
Nov 17 03:02:50 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-54065576-f95e-4b05-9156-a9b315ecd0e6 tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Deletion of /opt/stack/data/nova/instances/e5885526-e2d0-41d4-8da1-b3440d243a19_del complete
Nov 17 03:02:50 user nova-compute[74898]: INFO nova.compute.manager [None req-54065576-f95e-4b05-9156-a9b315ecd0e6 tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 17 03:02:50 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-54065576-f95e-4b05-9156-a9b315ecd0e6 tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:02:50 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:02:50 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:02:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:51 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:02:51 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Took 1.27 seconds to deallocate network for instance.
Nov 17 03:02:51 user nova-compute[74898]: DEBUG nova.compute.manager [req-bfcfe5eb-377b-43ee-91cb-44edd8d32233 req-a3a0b7c4-812a-41ba-a3bd-45cab5625e62 service nova] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Received event network-vif-deleted-9bcfc458-e33f-4119-91dc-af8a29f214e8 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-54065576-f95e-4b05-9156-a9b315ecd0e6 tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-54065576-f95e-4b05-9156-a9b315ecd0e6 tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:51 user nova-compute[74898]: DEBUG nova.compute.manager [req-0c3e5bba-bdbe-4ea2-9473-0653cf1f8d99 req-d2f62632-a621-4c43-ab7b-0db7775b4504 service nova] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Received event network-vif-plugged-9bcfc458-e33f-4119-91dc-af8a29f214e8 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:02:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0c3e5bba-bdbe-4ea2-9473-0653cf1f8d99 req-d2f62632-a621-4c43-ab7b-0db7775b4504 service nova] Acquiring lock "e5885526-e2d0-41d4-8da1-b3440d243a19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:02:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0c3e5bba-bdbe-4ea2-9473-0653cf1f8d99 req-d2f62632-a621-4c43-ab7b-0db7775b4504 service nova] Lock "e5885526-e2d0-41d4-8da1-b3440d243a19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:02:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0c3e5bba-bdbe-4ea2-9473-0653cf1f8d99 req-d2f62632-a621-4c43-ab7b-0db7775b4504 service nova] Lock "e5885526-e2d0-41d4-8da1-b3440d243a19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:51 user nova-compute[74898]: DEBUG nova.compute.manager [req-0c3e5bba-bdbe-4ea2-9473-0653cf1f8d99 req-d2f62632-a621-4c43-ab7b-0db7775b4504 service nova] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] No waiting events found dispatching network-vif-plugged-9bcfc458-e33f-4119-91dc-af8a29f214e8 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:02:51 user nova-compute[74898]: WARNING nova.compute.manager [req-0c3e5bba-bdbe-4ea2-9473-0653cf1f8d99 req-d2f62632-a621-4c43-ab7b-0db7775b4504 service nova] [instance: e5885526-e2d0-41d4-8da1-b3440d243a19] Received unexpected event network-vif-plugged-9bcfc458-e33f-4119-91dc-af8a29f214e8 for instance with vm_state deleted and task_state None.
Nov 17 03:02:52 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-54065576-f95e-4b05-9156-a9b315ecd0e6 tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:02:52 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-54065576-f95e-4b05-9156-a9b315ecd0e6 tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:02:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-54065576-f95e-4b05-9156-a9b315ecd0e6 tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:52 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-54065576-f95e-4b05-9156-a9b315ecd0e6 tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Deleted allocations for instance e5885526-e2d0-41d4-8da1-b3440d243a19
Nov 17 03:02:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-54065576-f95e-4b05-9156-a9b315ecd0e6 tempest-VolumesAssistedSnapshotsTest-796155726 tempest-VolumesAssistedSnapshotsTest-796155726-project-member] Lock "e5885526-e2d0-41d4-8da1-b3440d243a19" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.754s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NCAhvgdo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:02:54 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:02:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:02:54 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:02:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:02:54 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f19220-6c9d-4640-95d6-4b5ead63e330]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:02:54 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a1be1f-54c4-4306-8c5d-d063e8886072]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8] added
Nov 17 03:02:54 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da899bd-f341-45b0-8bc7-9db65e029241]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ddb1a2-e0b2-433d-adb0-ba6b14dbaaa2]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NCAhvgdo {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NCAhvgdo" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ca88bd-b5d3-4491-827b-9f00939eb587]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NCAhvgdo'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6c1bf0-6c86-4291-adff-227e02373671]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc36c56-f96e-49d1-bc43-26f0eb1fdc2a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:02:54 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:02:54 user nova-compute[74898]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a (non-flash)
Nov 17 03:02:54 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:02:54 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:02:54 user nova-compute[74898]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a (non-flash)
Nov 17 03:02:54 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bf6e0c-6e01-4cae-84b9-f806d1abdfe0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8, portal: 172.16.0.220,3260]
Nov 17 03:02:54 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8, portal: 172.16.0.220,3260] successful.
Nov 17 03:02:54 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b70ecc5-7262-47c9-86a6-4b32caee31f8]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[26738f80-26ec-4d1e-a884-8b0ead81f22e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:02:54 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:02:54 user nova-compute[74898]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a (non-flash)
Nov 17 03:02:54 user nova-compute[74898]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:02:54 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:02:54 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:02:54 user nova-compute[74898]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a (non-flash)
Nov 17 03:02:54 user nova-compute[74898]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:02:54 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] HCTL ('36', '-', '-', 0) found on session 13 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec8a2c9-d457-4e4d-b9e4-0d608233b98e]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Searching for a device in session 13 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:02:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NCAhvgdo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:02:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:02:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:02:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26633643065346163', 'path': '/dev/sde'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:02:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633643065346163', 'path': '/dev/sde'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:02:55 user nova-compute[74898]: DEBUG nova.objects.instance [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lazy-loading 'flavor' on Instance uuid d1ee03a5-13fb-47e7-8712-ea31aed36643 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:02:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 03:02:55 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:02:55 user nova-compute[74898]:   <source dev="/dev/sde"/>
Nov 17 03:02:55 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:02:55 user nova-compute[74898]:   <serial>441761f8-0044-43bc-8437-f31147d6c4f8</serial>
Nov 17 03:02:55 user nova-compute[74898]: </disk>
Nov 17 03:02:55 user nova-compute[74898]:  {{(pid=74898) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 03:02:56 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:02:56 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:02:56 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] No VIF found with MAC fa:16:3e:46:e0:47, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:02:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e587a9d7-a4e8-48ce-9a23-c3fb27b12c18 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "d1ee03a5-13fb-47e7-8712-ea31aed36643" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.919s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1f54e4f3-da64-4999-940c-ce5e01f540bc tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Acquiring lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1f54e4f3-da64-4999-940c-ce5e01f540bc tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1f54e4f3-da64-4999-940c-ce5e01f540bc tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Acquiring lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1f54e4f3-da64-4999-940c-ce5e01f540bc tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1f54e4f3-da64-4999-940c-ce5e01f540bc tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:00 user nova-compute[74898]: INFO nova.compute.manager [None req-1f54e4f3-da64-4999-940c-ce5e01f540bc tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Terminating instance
Nov 17 03:03:00 user nova-compute[74898]: DEBUG nova.compute.manager [None req-1f54e4f3-da64-4999-940c-ce5e01f540bc tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:03:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:00 user nova-compute[74898]: DEBUG nova.compute.manager [req-b8f19936-3249-44da-a4b8-6c4241857d61 req-ef1580fc-7660-4f02-adc5-03f9e8504d96 service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Received event network-vif-unplugged-bd3b73ca-0068-42f4-8cf3-f84932dee960 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:03:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b8f19936-3249-44da-a4b8-6c4241857d61 req-ef1580fc-7660-4f02-adc5-03f9e8504d96 service nova] Acquiring lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b8f19936-3249-44da-a4b8-6c4241857d61 req-ef1580fc-7660-4f02-adc5-03f9e8504d96 service nova] Lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b8f19936-3249-44da-a4b8-6c4241857d61 req-ef1580fc-7660-4f02-adc5-03f9e8504d96 service nova] Lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:00 user nova-compute[74898]: DEBUG nova.compute.manager [req-b8f19936-3249-44da-a4b8-6c4241857d61 req-ef1580fc-7660-4f02-adc5-03f9e8504d96 service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] No waiting events found dispatching network-vif-unplugged-bd3b73ca-0068-42f4-8cf3-f84932dee960 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:03:00 user nova-compute[74898]: DEBUG nova.compute.manager [req-b8f19936-3249-44da-a4b8-6c4241857d61 req-ef1580fc-7660-4f02-adc5-03f9e8504d96 service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Received event network-vif-unplugged-bd3b73ca-0068-42f4-8cf3-f84932dee960 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:03:00 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Instance destroyed successfully.
Nov 17 03:03:00 user nova-compute[74898]: DEBUG nova.objects.instance [None req-1f54e4f3-da64-4999-940c-ce5e01f540bc tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lazy-loading 'resources' on Instance uuid b886ada4-5bcb-4b2a-b69e-80edefdd2119 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:03:00 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-1f54e4f3-da64-4999-940c-ce5e01f540bc tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T02:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1059772796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1059772796',id=7,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbRzMswcys+QI6rLi6X0vGsy7XfMvLPPyHl7k0Ny6Kbzn4mYAR49YTYPPYUhsJ7Wj7VjaU+vGFbOCukOTayflDVlC4cnZKPAPKbqPCeENy+82k6vfJ0ZQpQ1EY3m67/9g==',key_name='tempest-keypair-1533313292',keypairs=<?>,launch_index=0,launched_at=2023-11-17T02:59:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c45541cf5bd44c2a34d5a31f04e2a2a',ramdisk_id='',reservation_id='r-ftctsg18',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1966129795',owner_user_name='tempest-TaggedAttachmentsTest-1966129795-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T02:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7c4ed2ec81a411c95b2be4dcfb9859d',uuid=b886ada4-5bcb-4b2a-b69e-80edefdd2119,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd3b73ca-0068-42f4-8cf3-f84932dee960", "address": "fa:16:3e:2d:e6:07", "network": {"id": "a432562d-92fd-4786-944f-3a082f5146e8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1288851087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c45541cf5bd44c2a34d5a31f04e2a2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3b73ca-00", "ovs_interfaceid": "bd3b73ca-0068-42f4-8cf3-f84932dee960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:03:00 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-1f54e4f3-da64-4999-940c-ce5e01f540bc tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Converting VIF {"id": "bd3b73ca-0068-42f4-8cf3-f84932dee960", "address": "fa:16:3e:2d:e6:07", "network": {"id": "a432562d-92fd-4786-944f-3a082f5146e8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1288851087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c45541cf5bd44c2a34d5a31f04e2a2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3b73ca-00", "ovs_interfaceid": "bd3b73ca-0068-42f4-8cf3-f84932dee960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:03:00 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-1f54e4f3-da64-4999-940c-ce5e01f540bc tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=bd3b73ca-0068-42f4-8cf3-f84932dee960,network=Network(a432562d-92fd-4786-944f-3a082f5146e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd3b73ca-00') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:03:00 user nova-compute[74898]: DEBUG os_vif [None req-1f54e4f3-da64-4999-940c-ce5e01f540bc tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=bd3b73ca-0068-42f4-8cf3-f84932dee960,network=Network(a432562d-92fd-4786-944f-3a082f5146e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd3b73ca-00') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:03:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd3b73ca-00, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:03:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:03:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e37d037e-6ea6-47e1-b826-72aa52c63216) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:03:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:00 user nova-compute[74898]: INFO os_vif [None req-1f54e4f3-da64-4999-940c-ce5e01f540bc tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=bd3b73ca-0068-42f4-8cf3-f84932dee960,network=Network(a432562d-92fd-4786-944f-3a082f5146e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd3b73ca-00')
Nov 17 03:03:00 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-1f54e4f3-da64-4999-940c-ce5e01f540bc tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Deleting instance files /opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119_del
Nov 17 03:03:00 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-1f54e4f3-da64-4999-940c-ce5e01f540bc tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Deletion of /opt/stack/data/nova/instances/b886ada4-5bcb-4b2a-b69e-80edefdd2119_del complete
Nov 17 03:03:01 user nova-compute[74898]: DEBUG nova.compute.manager [req-1f0222c0-9339-4961-8c88-4c91504af5c7 req-b4952dfb-32e2-45dc-a446-2355257c29d0 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Received event network-changed-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:03:01 user nova-compute[74898]: DEBUG nova.compute.manager [req-1f0222c0-9339-4961-8c88-4c91504af5c7 req-b4952dfb-32e2-45dc-a446-2355257c29d0 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Refreshing instance network info cache due to event network-changed-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:03:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1f0222c0-9339-4961-8c88-4c91504af5c7 req-b4952dfb-32e2-45dc-a446-2355257c29d0 service nova] Acquiring lock "refresh_cache-d1ee03a5-13fb-47e7-8712-ea31aed36643" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:03:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1f0222c0-9339-4961-8c88-4c91504af5c7 req-b4952dfb-32e2-45dc-a446-2355257c29d0 service nova] Acquired lock "refresh_cache-d1ee03a5-13fb-47e7-8712-ea31aed36643" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:03:01 user nova-compute[74898]: DEBUG nova.network.neutron [req-1f0222c0-9339-4961-8c88-4c91504af5c7 req-b4952dfb-32e2-45dc-a446-2355257c29d0 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Refreshing network info cache for port 4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:03:01 user nova-compute[74898]: INFO nova.compute.manager [None req-1f54e4f3-da64-4999-940c-ce5e01f540bc tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 17 03:03:01 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-1f54e4f3-da64-4999-940c-ce5e01f540bc tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:03:01 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:03:01 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:03:01 user nova-compute[74898]: DEBUG nova.network.neutron [req-1f0222c0-9339-4961-8c88-4c91504af5c7 req-b4952dfb-32e2-45dc-a446-2355257c29d0 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Updated VIF entry in instance network info cache for port 4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:03:01 user nova-compute[74898]: DEBUG nova.network.neutron [req-1f0222c0-9339-4961-8c88-4c91504af5c7 req-b4952dfb-32e2-45dc-a446-2355257c29d0 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Updating instance_info_cache with network_info: [{"id": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "address": "fa:16:3e:46:e0:47", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cfbdbfd-83", "ovs_interfaceid": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:03:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1f0222c0-9339-4961-8c88-4c91504af5c7 req-b4952dfb-32e2-45dc-a446-2355257c29d0 service nova] Releasing lock "refresh_cache-d1ee03a5-13fb-47e7-8712-ea31aed36643" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:03:01 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:03:01 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Took 0.66 seconds to deallocate network for instance.
Nov 17 03:03:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1f54e4f3-da64-4999-940c-ce5e01f540bc tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1f54e4f3-da64-4999-940c-ce5e01f540bc tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:02 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-1f54e4f3-da64-4999-940c-ce5e01f540bc tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:03:02 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-1f54e4f3-da64-4999-940c-ce5e01f540bc tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:03:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1f54e4f3-da64-4999-940c-ce5e01f540bc tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:02 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-1f54e4f3-da64-4999-940c-ce5e01f540bc tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Deleted allocations for instance b886ada4-5bcb-4b2a-b69e-80edefdd2119
Nov 17 03:03:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1f54e4f3-da64-4999-940c-ce5e01f540bc tempest-TaggedAttachmentsTest-1966129795 tempest-TaggedAttachmentsTest-1966129795-project-member] Lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.045s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:02 user nova-compute[74898]: DEBUG nova.compute.manager [req-ce6f2b51-749b-419a-ac37-b36d8e4689a9 req-93142578-287f-4352-a8b9-02c16de028f8 service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Received event network-vif-plugged-bd3b73ca-0068-42f4-8cf3-f84932dee960 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:03:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ce6f2b51-749b-419a-ac37-b36d8e4689a9 req-93142578-287f-4352-a8b9-02c16de028f8 service nova] Acquiring lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ce6f2b51-749b-419a-ac37-b36d8e4689a9 req-93142578-287f-4352-a8b9-02c16de028f8 service nova] Lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ce6f2b51-749b-419a-ac37-b36d8e4689a9 req-93142578-287f-4352-a8b9-02c16de028f8 service nova] Lock "b886ada4-5bcb-4b2a-b69e-80edefdd2119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:02 user nova-compute[74898]: DEBUG nova.compute.manager [req-ce6f2b51-749b-419a-ac37-b36d8e4689a9 req-93142578-287f-4352-a8b9-02c16de028f8 service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] No waiting events found dispatching network-vif-plugged-bd3b73ca-0068-42f4-8cf3-f84932dee960 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:03:02 user nova-compute[74898]: WARNING nova.compute.manager [req-ce6f2b51-749b-419a-ac37-b36d8e4689a9 req-93142578-287f-4352-a8b9-02c16de028f8 service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Received unexpected event network-vif-plugged-bd3b73ca-0068-42f4-8cf3-f84932dee960 for instance with vm_state deleted and task_state None.
Nov 17 03:03:03 user nova-compute[74898]: DEBUG nova.compute.manager [req-ba1e245c-9c5e-4e36-873a-48af8301a06c req-4def921e-494a-4a2d-a6ea-ce5c20068a4e service nova] [instance: b886ada4-5bcb-4b2a-b69e-80edefdd2119] Received event network-vif-deleted-bd3b73ca-0068-42f4-8cf3-f84932dee960 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:03:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:03 user nova-compute[74898]: DEBUG nova.compute.manager [req-6565a535-41f7-491a-932a-68808bf5f33c req-48170f4c-b695-44cb-9604-23f9ccb14188 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Received event network-changed-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:03:03 user nova-compute[74898]: DEBUG nova.compute.manager [req-6565a535-41f7-491a-932a-68808bf5f33c req-48170f4c-b695-44cb-9604-23f9ccb14188 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Refreshing instance network info cache due to event network-changed-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:03:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-6565a535-41f7-491a-932a-68808bf5f33c req-48170f4c-b695-44cb-9604-23f9ccb14188 service nova] Acquiring lock "refresh_cache-d1ee03a5-13fb-47e7-8712-ea31aed36643" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:03:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-6565a535-41f7-491a-932a-68808bf5f33c req-48170f4c-b695-44cb-9604-23f9ccb14188 service nova] Acquired lock "refresh_cache-d1ee03a5-13fb-47e7-8712-ea31aed36643" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:03:03 user nova-compute[74898]: DEBUG nova.network.neutron [req-6565a535-41f7-491a-932a-68808bf5f33c req-48170f4c-b695-44cb-9604-23f9ccb14188 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Refreshing network info cache for port 4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:03:04 user nova-compute[74898]: DEBUG nova.network.neutron [req-6565a535-41f7-491a-932a-68808bf5f33c req-48170f4c-b695-44cb-9604-23f9ccb14188 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Updated VIF entry in instance network info cache for port 4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:03:04 user nova-compute[74898]: DEBUG nova.network.neutron [req-6565a535-41f7-491a-932a-68808bf5f33c req-48170f4c-b695-44cb-9604-23f9ccb14188 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Updating instance_info_cache with network_info: [{"id": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "address": "fa:16:3e:46:e0:47", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cfbdbfd-83", "ovs_interfaceid": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:03:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-6565a535-41f7-491a-932a-68808bf5f33c req-48170f4c-b695-44cb-9604-23f9ccb14188 service nova] Releasing lock "refresh_cache-d1ee03a5-13fb-47e7-8712-ea31aed36643" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:03:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "d1ee03a5-13fb-47e7-8712-ea31aed36643" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "d1ee03a5-13fb-47e7-8712-ea31aed36643" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:06 user nova-compute[74898]: INFO nova.compute.manager [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Rebooting instance
Nov 17 03:03:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "refresh_cache-d1ee03a5-13fb-47e7-8712-ea31aed36643" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:03:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquired lock "refresh_cache-d1ee03a5-13fb-47e7-8712-ea31aed36643" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:03:07 user nova-compute[74898]: DEBUG nova.network.neutron [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:03:07 user nova-compute[74898]: DEBUG nova.network.neutron [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Updating instance_info_cache with network_info: [{"id": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "address": "fa:16:3e:46:e0:47", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cfbdbfd-83", "ovs_interfaceid": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:03:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Releasing lock "refresh_cache-d1ee03a5-13fb-47e7-8712-ea31aed36643" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:03:07 user nova-compute[74898]: DEBUG nova.compute.manager [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:03:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:07 user nova-compute[74898]: DEBUG nova.compute.manager [req-46a8a19a-8b18-48c2-9aed-fbfc01eb335d req-144fc819-c0df-4c42-b6d1-1e62aa20e435 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Received event network-vif-unplugged-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:03:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-46a8a19a-8b18-48c2-9aed-fbfc01eb335d req-144fc819-c0df-4c42-b6d1-1e62aa20e435 service nova] Acquiring lock "d1ee03a5-13fb-47e7-8712-ea31aed36643-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-46a8a19a-8b18-48c2-9aed-fbfc01eb335d req-144fc819-c0df-4c42-b6d1-1e62aa20e435 service nova] Lock "d1ee03a5-13fb-47e7-8712-ea31aed36643-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-46a8a19a-8b18-48c2-9aed-fbfc01eb335d req-144fc819-c0df-4c42-b6d1-1e62aa20e435 service nova] Lock "d1ee03a5-13fb-47e7-8712-ea31aed36643-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:07 user nova-compute[74898]: DEBUG nova.compute.manager [req-46a8a19a-8b18-48c2-9aed-fbfc01eb335d req-144fc819-c0df-4c42-b6d1-1e62aa20e435 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] No waiting events found dispatching network-vif-unplugged-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:03:07 user nova-compute[74898]: WARNING nova.compute.manager [req-46a8a19a-8b18-48c2-9aed-fbfc01eb335d req-144fc819-c0df-4c42-b6d1-1e62aa20e435 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Received unexpected event network-vif-unplugged-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd for instance with vm_state active and task_state reboot_started_hard.
Nov 17 03:03:08 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Instance destroyed successfully.
Nov 17 03:03:08 user nova-compute[74898]: DEBUG nova.objects.instance [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lazy-loading 'resources' on Instance uuid d1ee03a5-13fb-47e7-8712-ea31aed36643 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-518555806',display_name='tempest-TestMinimumBasicScenario-server-518555806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-518555806',id=12,image_ref='69542cfe-cdd4-48dc-9b63-061653d7cdc6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1EY5rCz2E3x/wAgxCKYUaqooziw3CyJR0nPDRdz0y4i4+yhrfN56ldStLgGItlqOV644u8QPrJzURL6gJ6sRaVxPODdWNcHba75nAX5V0fmckz29P2gUNRuvvbham3/Q==',key_name='tempest-TestMinimumBasicScenario-1952571884',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:01:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3251ef4d69740409c9beec4f368bf72',ramdisk_id='',reservation_id='r-d70154jv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='69542cfe-cdd4-48dc-9b63-061653d7cdc6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1625508354',owner_user_name='tempest-TestMinimumBasicScenario-1625508354-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:03:08Z,user_data=None,user_id='8507fa418393437cbba167b470aa7dc1',uuid=d1ee03a5-13fb-47e7-8712-ea31aed36643,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "address": "fa:16:3e:46:e0:47", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cfbdbfd-83", "ovs_interfaceid": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Converting VIF {"id": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "address": "fa:16:3e:46:e0:47", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cfbdbfd-83", "ovs_interfaceid": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:e0:47,bridge_name='br-int',has_traffic_filtering=True,id=4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd,network=Network(7b139a66-9d14-40e3-b129-0febdd13b264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cfbdbfd-83') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_vif [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:e0:47,bridge_name='br-int',has_traffic_filtering=True,id=4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd,network=Network(7b139a66-9d14-40e3-b129-0febdd13b264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cfbdbfd-83') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4cfbdbfd-83, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a0feb3d3-52bd-4f21-add9-ce872012198d) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:08 user nova-compute[74898]: INFO os_vif [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:e0:47,bridge_name='br-int',has_traffic_filtering=True,id=4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd,network=Network(7b139a66-9d14-40e3-b129-0febdd13b264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cfbdbfd-83')
Nov 17 03:03:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NCAhvgdo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:03:08 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[84521963-c1b5-4740-9ed0-49f87d16ef09]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:03:08 user nova-compute[74898]: No targets found.
Nov 17 03:03:08 user nova-compute[74898]: iSNS:
Nov 17 03:03:08 user nova-compute[74898]: No targets found.
Nov 17 03:03:08 user nova-compute[74898]: STATIC:
Nov 17 03:03:08 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4
Nov 17 03:03:08 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:03:08 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:03:08 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8
Nov 17 03:03:08 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:03:08 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:03:08 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019
Nov 17 03:03:08 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:03:08 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:03:08 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a
Nov 17 03:03:08 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:03:08 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:03:08 user nova-compute[74898]: FIRMWARE:
Nov 17 03:03:08 user nova-compute[74898]: No targets found.
Nov 17 03:03:08 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:03:08 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:03:08 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[159f8337-67fd-43f9-92cc-28ca3a96d9a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3c0223-ea25-4156-adb5-58a6f6f11acf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:03:08 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:03:08 user nova-compute[74898]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a (non-flash)
Nov 17 03:03:08 user nova-compute[74898]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:03:08 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:03:08 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:03:08 user nova-compute[74898]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a (non-flash)
Nov 17 03:03:08 user nova-compute[74898]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:03:08 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf86970a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8'): ({'sde'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Removing single pathed devices sde {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d0c1d9-22c2-4c14-a07a-db87e6439f10]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[77393f82-6c0c-4631-9df6-ffacef2ab816]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Flushing IO for device /dev/sde {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[608d12e5-bac8-4d53-aeee-808e11a0abe1]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[502da07a-a1da-467b-bc01-07d57fac8a6e]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] SCSI volumes sde have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3f2e56-35d0-4193-9faf-4a1ccdc660b1]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c56cfbe-6cf2-4eb6-bdbc-6b756cff6be4]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8, portal: 172.16.0.220,3260]
Nov 17 03:03:08 user nova-compute[74898]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8, portal: 172.16.0.220,3260] successful.
Nov 17 03:03:08 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe4955f-7cfa-4bdf-a8ea-93ed0b0d6ee8]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] <== disconnect_volume: return (304ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Start _get_guest_xml network_info=[{"id": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "address": "fa:16:3e:46:e0:47", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cfbdbfd-83", "ovs_interfaceid": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=69542cfe-cdd4-48dc-9b63-061653d7cdc6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '69542cfe-cdd4-48dc-9b63-061653d7cdc6'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NCAhvgdo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'd1ee03a5-13fb-47e7-8712-ea31aed36643', 'attached_at': '', 'detached_at': '', 'volume_id': '441761f8-0044-43bc-8437-f31147d6c4f8', 'serial': '441761f8-0044-43bc-8437-f31147d6c4f8'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'd90a4750-afe4-4b9a-98ca-7816b44c63d6', 'volume_type': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:03:08 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:03:08 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:03:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=69542cfe-cdd4-48dc-9b63-061653d7cdc6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG nova.objects.instance [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lazy-loading 'vcpu_model' on Instance uuid d1ee03a5-13fb-47e7-8712-ea31aed36643 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG nova.objects.base [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Object Instance<d1ee03a5-13fb-47e7-8712-ea31aed36643> lazy-loaded attributes: resources,vcpu_model {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NCAhvgdo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:03:08 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:03:08 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:03:08 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b338e83-adf6-4251-af27-31e800d49801]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:03:08 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a652f1f9-8ea1-454d-b722-39ca7b12a592]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8] added
Nov 17 03:03:08 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c693375a-ded5-4bf3-89dc-228acbde1927]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cda9d42-6ebe-46a6-a29d-af7fb8010484]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NCAhvgdo {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NCAhvgdo" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e85dc90-74a4-43ea-b073-e5c043d816a2]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NCAhvgdo'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6245ca-2470-4db6-928c-1f2e94721fa9]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6929cce4-efc3-4bba-b3bb-cc2cefe13cb4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:03:08 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:03:08 user nova-compute[74898]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a (non-flash)
Nov 17 03:03:08 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:03:08 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:03:08 user nova-compute[74898]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a (non-flash)
Nov 17 03:03:08 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[688ee450-6103-4432-9860-b1f310d8f5d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8, portal: 172.16.0.220,3260]
Nov 17 03:03:08 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8, portal: 172.16.0.220,3260] successful.
Nov 17 03:03:08 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[734f84ae-ca5d-445d-a77c-0907cbf84f62]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea405ba-2cd3-43f6-8d5e-70d2cee44746]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:03:09 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:03:09 user nova-compute[74898]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a (non-flash)
Nov 17 03:03:09 user nova-compute[74898]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:03:09 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:03:09 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:03:09 user nova-compute[74898]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a (non-flash)
Nov 17 03:03:09 user nova-compute[74898]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:03:09 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] HCTL ('36', '-', '-', 0) found on session 14 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ece6ef-a9a4-40c3-99e7-dd7b524cac75]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Searching for a device in session 14 and hctl ['36', '*', '*', 0] yield: None {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquiring lock "11704034-7afe-475c-ae43-1324b40f0d92" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "11704034-7afe-475c-ae43-1324b40f0d92" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG nova.objects.instance [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lazy-loading 'flavor' on Instance uuid 11704034-7afe-475c-ae43-1324b40f0d92 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "11704034-7afe-475c-ae43-1324b40f0d92" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquiring lock "11704034-7afe-475c-ae43-1324b40f0d92" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "11704034-7afe-475c-ae43-1324b40f0d92" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:09 user nova-compute[74898]: INFO nova.compute.manager [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Attaching volume 2efad82a-fd47-4649-8ce0-ba22f7a22f45 to /dev/vdb
Nov 17 03:03:09 user nova-compute[74898]: DEBUG os_brick.utils [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d8a9b6-341e-4d0b-938e-4fc5cd2a0bc7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42f81fe-ccfd-49ca-9124-ed136178df73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8612e8-f098-4684-9fa5-07dc79d195c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[684f6a89-8ab5-421b-b944-9fdfdd2489ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:03:09 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedd24ae-50bf-428b-a80b-73322d261b6e]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG os_brick.utils [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Updating existing volume attachment record: f5339c99-6647-479e-92dd-621f1adfa486 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG nova.compute.manager [req-aa23c882-9112-4a64-a560-15d49b3fe016 req-6bb61397-dd3e-428e-958e-187a73a253a6 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Received event network-vif-plugged-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-aa23c882-9112-4a64-a560-15d49b3fe016 req-6bb61397-dd3e-428e-958e-187a73a253a6 service nova] Acquiring lock "d1ee03a5-13fb-47e7-8712-ea31aed36643-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-aa23c882-9112-4a64-a560-15d49b3fe016 req-6bb61397-dd3e-428e-958e-187a73a253a6 service nova] Lock "d1ee03a5-13fb-47e7-8712-ea31aed36643-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-aa23c882-9112-4a64-a560-15d49b3fe016 req-6bb61397-dd3e-428e-958e-187a73a253a6 service nova] Lock "d1ee03a5-13fb-47e7-8712-ea31aed36643-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG nova.compute.manager [req-aa23c882-9112-4a64-a560-15d49b3fe016 req-6bb61397-dd3e-428e-958e-187a73a253a6 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] No waiting events found dispatching network-vif-plugged-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:03:09 user nova-compute[74898]: WARNING nova.compute.manager [req-aa23c882-9112-4a64-a560-15d49b3fe016 req-6bb61397-dd3e-428e-958e-187a73a253a6 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Received unexpected event network-vif-plugged-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd for instance with vm_state active and task_state reboot_started_hard.
Nov 17 03:03:09 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 4b869a55-acf6-4550-9354-2480273a4ee2 is timed out.
Nov 17 03:03:09 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Successfully detached device vdc from instance 4b869a55-acf6-4550-9354-2480273a4ee2 from the live domain config.
Nov 17 03:03:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:03:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNWYShdb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:03:09 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:03:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Searching for a device in session 14 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NCAhvgdo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26633643065346163', 'path': '/dev/sde'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633643065346163', 'path': '/dev/sde'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.111s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7657d2-43cd-42ca-9c68-9eff503519b9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:03:10 user nova-compute[74898]: No targets found.
Nov 17 03:03:10 user nova-compute[74898]: iSNS:
Nov 17 03:03:10 user nova-compute[74898]: No targets found.
Nov 17 03:03:10 user nova-compute[74898]: STATIC:
Nov 17 03:03:10 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4
Nov 17 03:03:10 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:03:10 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:03:10 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8
Nov 17 03:03:10 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:03:10 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:03:10 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019
Nov 17 03:03:10 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:03:10 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:03:10 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a
Nov 17 03:03:10 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:03:10 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:03:10 user nova-compute[74898]: FIRMWARE:
Nov 17 03:03:10 user nova-compute[74898]: No targets found.
Nov 17 03:03:10 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:03:10 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:03:10 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-518555806',display_name='tempest-TestMinimumBasicScenario-server-518555806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-518555806',id=12,image_ref='69542cfe-cdd4-48dc-9b63-061653d7cdc6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1EY5rCz2E3x/wAgxCKYUaqooziw3CyJR0nPDRdz0y4i4+yhrfN56ldStLgGItlqOV644u8QPrJzURL6gJ6sRaVxPODdWNcHba75nAX5V0fmckz29P2gUNRuvvbham3/Q==',key_name='tempest-TestMinimumBasicScenario-1952571884',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:01:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3251ef4d69740409c9beec4f368bf72',ramdisk_id='',reservation_id='r-d70154jv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='69542cfe-cdd4-48dc-9b63-061653d7cdc6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1625508354',owner_user_name='tempest-TestMinimumBasicScenario-1625508354-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:03:08Z,user_data=None,user_id='8507fa418393437cbba167b470aa7dc1',uuid=d1ee03a5-13fb-47e7-8712-ea31aed36643,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "address": "fa:16:3e:46:e0:47", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cfbdbfd-83", "ovs_interfaceid": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Converting VIF {"id": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "address": "fa:16:3e:46:e0:47", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cfbdbfd-83", "ovs_interfaceid": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:e0:47,bridge_name='br-int',has_traffic_filtering=True,id=4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd,network=Network(7b139a66-9d14-40e3-b129-0febdd13b264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cfbdbfd-83') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG nova.objects.instance [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lazy-loading 'pci_devices' on Instance uuid d1ee03a5-13fb-47e7-8712-ea31aed36643 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4766cc6c-80cc-4c96-aa32-2edd54148300]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG nova.objects.base [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Object Instance<d1ee03a5-13fb-47e7-8712-ea31aed36643> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:03:10 user nova-compute[74898]:   <uuid>d1ee03a5-13fb-47e7-8712-ea31aed36643</uuid>
Nov 17 03:03:10 user nova-compute[74898]:   <name>instance-0000000c</name>
Nov 17 03:03:10 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:03:10 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:03:10 user nova-compute[74898]:   <metadata>
Nov 17 03:03:10 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:03:10 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:03:10 user nova-compute[74898]:       <nova:name>tempest-TestMinimumBasicScenario-server-518555806</nova:name>
Nov 17 03:03:10 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:03:08</nova:creationTime>
Nov 17 03:03:10 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:03:10 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:03:10 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:03:10 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:03:10 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:03:10 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:03:10 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:03:10 user nova-compute[74898]:       <nova:owner>
Nov 17 03:03:10 user nova-compute[74898]:         <nova:user uuid="8507fa418393437cbba167b470aa7dc1">tempest-TestMinimumBasicScenario-1625508354-project-member</nova:user>
Nov 17 03:03:10 user nova-compute[74898]:         <nova:project uuid="e3251ef4d69740409c9beec4f368bf72">tempest-TestMinimumBasicScenario-1625508354</nova:project>
Nov 17 03:03:10 user nova-compute[74898]:       </nova:owner>
Nov 17 03:03:10 user nova-compute[74898]:       <nova:root type="image" uuid="69542cfe-cdd4-48dc-9b63-061653d7cdc6"/>
Nov 17 03:03:10 user nova-compute[74898]:       <nova:ports>
Nov 17 03:03:10 user nova-compute[74898]:         <nova:port uuid="4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd">
Nov 17 03:03:10 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 17 03:03:10 user nova-compute[74898]:         </nova:port>
Nov 17 03:03:10 user nova-compute[74898]:       </nova:ports>
Nov 17 03:03:10 user nova-compute[74898]:     </nova:instance>
Nov 17 03:03:10 user nova-compute[74898]:   </metadata>
Nov 17 03:03:10 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:03:10 user nova-compute[74898]:     <system>
Nov 17 03:03:10 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:03:10 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:03:10 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:03:10 user nova-compute[74898]:       <entry name="serial">d1ee03a5-13fb-47e7-8712-ea31aed36643</entry>
Nov 17 03:03:10 user nova-compute[74898]:       <entry name="uuid">d1ee03a5-13fb-47e7-8712-ea31aed36643</entry>
Nov 17 03:03:10 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:03:10 user nova-compute[74898]:     </system>
Nov 17 03:03:10 user nova-compute[74898]:   </sysinfo>
Nov 17 03:03:10 user nova-compute[74898]:   <os>
Nov 17 03:03:10 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:03:10 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:03:10 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:03:10 user nova-compute[74898]:   </os>
Nov 17 03:03:10 user nova-compute[74898]:   <features>
Nov 17 03:03:10 user nova-compute[74898]:     <acpi/>
Nov 17 03:03:10 user nova-compute[74898]:     <apic/>
Nov 17 03:03:10 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:03:10 user nova-compute[74898]:   </features>
Nov 17 03:03:10 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:03:10 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:03:10 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:03:10 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:03:10 user nova-compute[74898]:   </clock>
Nov 17 03:03:10 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:03:10 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:03:10 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:03:10 user nova-compute[74898]:   </cpu>
Nov 17 03:03:10 user nova-compute[74898]:   <devices>
Nov 17 03:03:10 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:03:10 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:03:10 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk"/>
Nov 17 03:03:10 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:03:10 user nova-compute[74898]:     </disk>
Nov 17 03:03:10 user nova-compute[74898]:     <disk type="block" device="disk">
Nov 17 03:03:10 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:03:10 user nova-compute[74898]:       <source dev="/dev/sde"/>
Nov 17 03:03:10 user nova-compute[74898]:       <target dev="vdb" bus="virtio"/>
Nov 17 03:03:10 user nova-compute[74898]:       <serial>441761f8-0044-43bc-8437-f31147d6c4f8</serial>
Nov 17 03:03:10 user nova-compute[74898]:     </disk>
Nov 17 03:03:10 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:03:10 user nova-compute[74898]:       <mac address="fa:16:3e:46:e0:47"/>
Nov 17 03:03:10 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:03:10 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:03:10 user nova-compute[74898]:       <target dev="tap4cfbdbfd-83"/>
Nov 17 03:03:10 user nova-compute[74898]:     </interface>
Nov 17 03:03:10 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:03:10 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/console.log" append="off"/>
Nov 17 03:03:10 user nova-compute[74898]:     </serial>
Nov 17 03:03:10 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:03:10 user nova-compute[74898]:     <video>
Nov 17 03:03:10 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:03:10 user nova-compute[74898]:     </video>
Nov 17 03:03:10 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:03:10 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:03:10 user nova-compute[74898]:     </rng>
Nov 17 03:03:10 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:03:10 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:03:10 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:03:10 user nova-compute[74898]:     </memballoon>
Nov 17 03:03:10 user nova-compute[74898]:   </devices>
Nov 17 03:03:10 user nova-compute[74898]: </domain>
Nov 17 03:03:10 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcb5980-fb93-49ca-a2d5-ec8b37f1f820]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:03:10 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:03:10 user nova-compute[74898]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a (non-flash)
Nov 17 03:03:10 user nova-compute[74898]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:03:10 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:03:10 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:03:10 user nova-compute[74898]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a (non-flash)
Nov 17 03:03:10 user nova-compute[74898]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:03:10 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf8695990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a'): ({'sdd'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Removing single pathed devices sdd {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d42b0c-bf2e-484b-be02-8763d003edf8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9736bbc4-4cac-4872-b4e5-7e4152440108]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Flushing IO for device /dev/sdd {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcab44b-0544-4e54-b28d-bd803c41ca2f]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb37112-7744-4733-af7f-103d3d59c40b]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] SCSI volumes sdd have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d64610-82eb-42e1-8fa0-ab992be856a1]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[895e7eb1-8c3f-4d21-966e-c67fd49b6fb2]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a, portal: 172.16.0.220,3260]
Nov 17 03:03:10 user nova-compute[74898]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a, portal: 172.16.0.220,3260] successful.
Nov 17 03:03:10 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde9aed6-04ca-4387-a9a2-a617b225066a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[16634236-2c3e-42f4-a390-e0dec3c79841]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] <== disconnect_volume: return (484ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG nova.objects.instance [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lazy-loading 'trusted_certs' on Instance uuid d1ee03a5-13fb-47e7-8712-ea31aed36643 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG nova.objects.base [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Object Instance<d1ee03a5-13fb-47e7-8712-ea31aed36643> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d26be1178031a8201ee5e12c522d9728e450cac --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d26be1178031a8201ee5e12c522d9728e450cac --force-share --output=json" returned: 0 in 0.178s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Cannot resize image /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG nova.objects.instance [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lazy-loading 'migration_context' on Instance uuid d1ee03a5-13fb-47e7-8712-ea31aed36643 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG nova.objects.base [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Object Instance<d1ee03a5-13fb-47e7-8712-ea31aed36643> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-518555806',display_name='tempest-TestMinimumBasicScenario-server-518555806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-518555806',id=12,image_ref='69542cfe-cdd4-48dc-9b63-061653d7cdc6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1EY5rCz2E3x/wAgxCKYUaqooziw3CyJR0nPDRdz0y4i4+yhrfN56ldStLgGItlqOV644u8QPrJzURL6gJ6sRaVxPODdWNcHba75nAX5V0fmckz29P2gUNRuvvbham3/Q==',key_name='tempest-TestMinimumBasicScenario-1952571884',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:01:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='e3251ef4d69740409c9beec4f368bf72',ramdisk_id='',reservation_id='r-d70154jv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='69542cfe-cdd4-48dc-9b63-061653d7cdc6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1625508354',owner_user_name='tempest-TestMinimumBasicScenario-1625508354-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:03:08Z,user_data=None,user_id='8507fa418393437cbba167b470aa7dc1',uuid=d1ee03a5-13fb-47e7-8712-ea31aed36643,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "address": "fa:16:3e:46:e0:47", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cfbdbfd-83", "ovs_interfaceid": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Converting VIF {"id": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "address": "fa:16:3e:46:e0:47", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cfbdbfd-83", "ovs_interfaceid": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:e0:47,bridge_name='br-int',has_traffic_filtering=True,id=4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd,network=Network(7b139a66-9d14-40e3-b129-0febdd13b264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cfbdbfd-83') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG os_vif [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:e0:47,bridge_name='br-int',has_traffic_filtering=True,id=4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd,network=Network(7b139a66-9d14-40e3-b129-0febdd13b264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cfbdbfd-83') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '06f2c04e-2781-558e-8b15-51a59ec38f3e', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4cfbdbfd-83, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4cfbdbfd-83, col_values=(('qos', UUID('4023d2c5-1e7e-4ef7-9aef-e133f34d8584')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4cfbdbfd-83, col_values=(('external_ids', {'iface-id': '4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:e0:47', 'vm-uuid': 'd1ee03a5-13fb-47e7-8712-ea31aed36643'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:03:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:10 user nova-compute[74898]: INFO os_vif [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:e0:47,bridge_name='br-int',has_traffic_filtering=True,id=4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd,network=Network(7b139a66-9d14-40e3-b129-0febdd13b264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cfbdbfd-83')
Nov 17 03:03:11 user nova-compute[74898]: DEBUG nova.objects.instance [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lazy-loading 'flavor' on Instance uuid 4b869a55-acf6-4550-9354-2480273a4ee2 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:03:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-54b48c65-8c56-42cb-bbd0-4e206ff4e8dd tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "4b869a55-acf6-4550-9354-2480273a4ee2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.954s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Acquiring lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:11 user nova-compute[74898]: DEBUG nova.objects.instance [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lazy-loading 'flavor' on Instance uuid 015ff42a-4d69-4f60-b86c-c6bd68d23c99 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:03:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Acquiring lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:12 user nova-compute[74898]: INFO nova.compute.manager [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Attaching volume f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 to /dev/vdb
Nov 17 03:03:12 user nova-compute[74898]: DEBUG os_brick.utils [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:03:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42fedf0-dd56-4c15-aaf1-b0febe8eeefb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbe4a49-c128-4fab-9d6a-837c7b20936d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c930581-f3ca-4883-98af-ed4451614f77]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e2f45f-b298-4c39-8c00-e6253dcb6238]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:03:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:03:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:03:12 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:03:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d177aaca-cde0-4968-aa14-c00b62fe989a]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:03:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:03:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:03:12 user nova-compute[74898]: DEBUG os_brick.utils [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:03:12 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Updating existing volume attachment record: d767b91c-924a-439b-a481-e278c80eb904 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:03:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:12 user nova-compute[74898]: DEBUG nova.compute.manager [req-9bb15681-d258-48ee-a8f9-e6deb8556ff8 req-aa79d603-ddb6-4dc6-bba5-0b99a0760a07 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Received event network-vif-plugged-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:03:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9bb15681-d258-48ee-a8f9-e6deb8556ff8 req-aa79d603-ddb6-4dc6-bba5-0b99a0760a07 service nova] Acquiring lock "d1ee03a5-13fb-47e7-8712-ea31aed36643-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9bb15681-d258-48ee-a8f9-e6deb8556ff8 req-aa79d603-ddb6-4dc6-bba5-0b99a0760a07 service nova] Lock "d1ee03a5-13fb-47e7-8712-ea31aed36643-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9bb15681-d258-48ee-a8f9-e6deb8556ff8 req-aa79d603-ddb6-4dc6-bba5-0b99a0760a07 service nova] Lock "d1ee03a5-13fb-47e7-8712-ea31aed36643-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:12 user nova-compute[74898]: DEBUG nova.compute.manager [req-9bb15681-d258-48ee-a8f9-e6deb8556ff8 req-aa79d603-ddb6-4dc6-bba5-0b99a0760a07 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] No waiting events found dispatching network-vif-plugged-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:03:12 user nova-compute[74898]: WARNING nova.compute.manager [req-9bb15681-d258-48ee-a8f9-e6deb8556ff8 req-aa79d603-ddb6-4dc6-bba5-0b99a0760a07 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Received unexpected event network-vif-plugged-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd for instance with vm_state active and task_state reboot_started_hard.
Nov 17 03:03:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:13 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:03:13 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:03:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-11704034-7afe-475c-ae43-1324b40f0d92" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:03:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-11704034-7afe-475c-ae43-1324b40f0d92" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:03:14 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:03:14 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Updating instance_info_cache with network_info: [{"id": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "address": "fa:16:3e:98:61:d2", "network": {"id": "ff76f13f-ae63-4dd0-a219-894c6ae65c00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1502020482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b79304b161b748c4b105640273979318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d1282-04", "ovs_interfaceid": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:03:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-11704034-7afe-475c-ae43-1324b40f0d92" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:03:14 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:03:14 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:03:14 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:03:14 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:03:14 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:03:14 user nova-compute[74898]: DEBUG nova.compute.manager [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:03:14 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Instance rebooted successfully.
Nov 17 03:03:14 user nova-compute[74898]: DEBUG nova.compute.manager [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:03:14 user nova-compute[74898]: DEBUG nova.compute.manager [req-1cbc9470-61d2-481c-825e-21a74873248f req-75d2fa0f-2a06-4881-bfa7-133e6a3bca4e service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Received event network-vif-plugged-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:03:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1cbc9470-61d2-481c-825e-21a74873248f req-75d2fa0f-2a06-4881-bfa7-133e6a3bca4e service nova] Acquiring lock "d1ee03a5-13fb-47e7-8712-ea31aed36643-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1cbc9470-61d2-481c-825e-21a74873248f req-75d2fa0f-2a06-4881-bfa7-133e6a3bca4e service nova] Lock "d1ee03a5-13fb-47e7-8712-ea31aed36643-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1cbc9470-61d2-481c-825e-21a74873248f req-75d2fa0f-2a06-4881-bfa7-133e6a3bca4e service nova] Lock "d1ee03a5-13fb-47e7-8712-ea31aed36643-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:14 user nova-compute[74898]: DEBUG nova.compute.manager [req-1cbc9470-61d2-481c-825e-21a74873248f req-75d2fa0f-2a06-4881-bfa7-133e6a3bca4e service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] No waiting events found dispatching network-vif-plugged-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:03:14 user nova-compute[74898]: WARNING nova.compute.manager [req-1cbc9470-61d2-481c-825e-21a74873248f req-75d2fa0f-2a06-4881-bfa7-133e6a3bca4e service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Received unexpected event network-vif-plugged-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd for instance with vm_state active and task_state reboot_started_hard.
Nov 17 03:03:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-88f7dacd-7c6c-4c24-ae64-b5aeffba56a5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "d1ee03a5-13fb-47e7-8712-ea31aed36643" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.952s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpmzNxqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:03:15 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:03:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:03:15 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:03:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:03:15 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9184ec9c-b291-4b2a-873a-de12fafc0d6a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:03:15 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0539b225-be83-407b-ad2c-19048649d3b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45] added
Nov 17 03:03:15 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2578a8-9803-430c-8bcd-0b9e77d8330a]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72a57d2-fde2-4c32-90ec-bede5f2c666e]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HpmzNxqO {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HpmzNxqO" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39e47f8-b1e6-4353-aae9-5c8fd99a18ea]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HpmzNxqO'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb337386-908c-442c-8ec0-3642706e1f07]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b87d8eb-7977-43f3-b59b-c34df40ec8f7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:03:15 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:03:15 user nova-compute[74898]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:03:15 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:03:15 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:03:15 user nova-compute[74898]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:03:15 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[291ae070-21eb-4419-9698-ca5161003096]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45, portal: 172.16.0.220,3260]
Nov 17 03:03:15 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45, portal: 172.16.0.220,3260] successful.
Nov 17 03:03:15 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd174ef-2131-4293-aeb5-1d1fbd629d82]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[158ffbb4-5b01-4237-bd89-686d49c3eb73]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:03:15 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:03:15 user nova-compute[74898]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:03:15 user nova-compute[74898]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:03:15 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:03:15 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:03:15 user nova-compute[74898]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:03:15 user nova-compute[74898]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:03:15 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.034s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce652e09-3f64-403b-bb61-80c38a54571f]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: None {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:16 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:03:16 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:03:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpmzNxqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:03:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:03:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26136373566326237', 'path': '/dev/sdd'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:03:16 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136373566326237', 'path': '/dev/sdd'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:03:16 user nova-compute[74898]: DEBUG nova.objects.instance [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lazy-loading 'flavor' on Instance uuid 11704034-7afe-475c-ae43-1324b40f0d92 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:03:16 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 03:03:16 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:03:16 user nova-compute[74898]:   <source dev="/dev/sdd"/>
Nov 17 03:03:16 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:03:16 user nova-compute[74898]:   <serial>2efad82a-fd47-4649-8ce0-ba22f7a22f45</serial>
Nov 17 03:03:16 user nova-compute[74898]: </disk>
Nov 17 03:03:16 user nova-compute[74898]:  {{(pid=74898) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 03:03:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:03:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:03:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] No VIF found with MAC fa:16:3e:98:61:d2, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:03:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2762977f-80f0-4962-9e59-a6d572328fe1 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "11704034-7afe-475c-ae43-1324b40f0d92" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.324s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:17 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:03:17 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:03:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:17 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjUusBlA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:03:18 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:03:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:03:18 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:03:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:03:18 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ebfedb-b7d2-45ba-8097-ea993f0eba6f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:03:18 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[de114947-1257-4a41-91c4-f322228f761a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0] added
Nov 17 03:03:18 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd03be6-cf7a-469d-8b6b-18030cc3e268]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1589a61c-5d30-47ac-b27a-b072c86ec042]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JjUusBlA {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JjUusBlA" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac53ff03-a10e-4462-b20e-86f44df30859]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JjUusBlA'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1eb0618-7f67-4f01-9abc-c54a23620b88]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fafdf5-3f3a-45d1-9c41-69b4e9bafcc4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:03:18 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:03:18 user nova-compute[74898]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:03:18 user nova-compute[74898]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:03:18 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:03:18 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:03:18 user nova-compute[74898]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:03:18 user nova-compute[74898]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:03:18 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b869a55-acf6-4550-9354-2480273a4ee2/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[546fd553-46a7-4561-883f-a0af7e73c6d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0, portal: 172.16.0.220,3260]
Nov 17 03:03:18 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0, portal: 172.16.0.220,3260] successful.
Nov 17 03:03:18 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7920dd01-bea4-432d-822d-e5a18a241c1f]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dfd261-86b6-4358-ac8e-2cb101f8f1a6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:03:18 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:03:18 user nova-compute[74898]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:03:18 user nova-compute[74898]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:03:18 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:03:18 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:03:18 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:03:18 user nova-compute[74898]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:03:18 user nova-compute[74898]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:03:18 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:03:18 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] HCTL ('37', '-', '-', 0) found on session 16 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d341102a-c92e-4cb8-867b-16c74015747c]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Searching for a device in session 16 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjUusBlA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b869a55-acf6-4550-9354-2480273a4ee2/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b869a55-acf6-4550-9354-2480273a4ee2/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b869a55-acf6-4550-9354-2480273a4ee2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:03:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:19 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:03:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba39a7b9-8b0a-421c-80d1-6bd3f32aef42/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba39a7b9-8b0a-421c-80d1-6bd3f32aef42/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba39a7b9-8b0a-421c-80d1-6bd3f32aef42/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.446s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:03:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] <== connect_volume: return (1450ms) {'type': 'block', 'scsi_wwn': '26337306630383737', 'path': '/dev/sdf'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:03:19 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337306630383737', 'path': '/dev/sdf'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:03:19 user nova-compute[74898]: DEBUG nova.objects.instance [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lazy-loading 'flavor' on Instance uuid 015ff42a-4d69-4f60-b86c-c6bd68d23c99 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:03:19 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 03:03:19 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:03:19 user nova-compute[74898]:   <source dev="/dev/sdf"/>
Nov 17 03:03:19 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:03:19 user nova-compute[74898]:   <serial>f27c7dcc-c45f-4ad7-819d-d89a8a89bae0</serial>
Nov 17 03:03:19 user nova-compute[74898]: </disk>
Nov 17 03:03:19 user nova-compute[74898]:  {{(pid=74898) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 03:03:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba39a7b9-8b0a-421c-80d1-6bd3f32aef42/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:20 user nova-compute[74898]: DEBUG nova.compute.manager [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Stashing vm_state: active {{(pid=74898) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 17 03:03:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:03:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:03:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] No VIF found with MAC fa:16:3e:88:21:6c, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:03:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json" returned: 0 in 0.250s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:20 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:03:20 user nova-compute[74898]: INFO nova.compute.claims [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Claim successful on node user
Nov 17 03:03:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8d70c74b-a27a-4a97-be7d-58e276499e5b tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.394s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:20 user nova-compute[74898]: INFO nova.compute.resource_tracker [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Updating resource usage from migration e64df685-1998-4c22-aa5c-6dae1f6f2fe9
Nov 17 03:03:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:20 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:03:20 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:03:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.622s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:20 user nova-compute[74898]: INFO nova.compute.manager [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Migrating
Nov 17 03:03:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:03:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:03:20 user nova-compute[74898]: INFO nova.compute.rpcapi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 17 03:03:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:03:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquiring lock "refresh_cache-11704034-7afe-475c-ae43-1324b40f0d92" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:03:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquired lock "refresh_cache-11704034-7afe-475c-ae43-1324b40f0d92" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:03:21 user nova-compute[74898]: DEBUG nova.network.neutron [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:03:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:21 user nova-compute[74898]: INFO nova.compute.manager [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Rescuing
Nov 17 03:03:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Acquiring lock "refresh_cache-015ff42a-4d69-4f60-b86c-c6bd68d23c99" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:03:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Acquired lock "refresh_cache-015ff42a-4d69-4f60-b86c-c6bd68d23c99" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:03:21 user nova-compute[74898]: DEBUG nova.network.neutron [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:03:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:21 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:03:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:21 user nova-compute[74898]: DEBUG nova.network.neutron [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Updating instance_info_cache with network_info: [{"id": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "address": "fa:16:3e:98:61:d2", "network": {"id": "ff76f13f-ae63-4dd0-a219-894c6ae65c00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1502020482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b79304b161b748c4b105640273979318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d1282-04", "ovs_interfaceid": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:03:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Releasing lock "refresh_cache-11704034-7afe-475c-ae43-1324b40f0d92" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:03:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:21 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG nova.network.neutron [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Updating instance_info_cache with network_info: [{"id": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "address": "fa:16:3e:88:21:6c", "network": {"id": "bf964a06-b5fd-41c4-9dfe-5d485019bbdd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-848964430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74014d7708574848bee4da7056ab1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d80c52a-1f", "ovs_interfaceid": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:03:22 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:03:22 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:03:22 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=7674MB free_disk=25.578685760498047GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Releasing lock "refresh_cache-015ff42a-4d69-4f60-b86c-c6bd68d23c99" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Starting migrate_disk_and_power_off {{(pid=74898) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Applying migration context for instance 11704034-7afe-475c-ae43-1324b40f0d92 as it has an incoming, in-progress migration e64df685-1998-4c22-aa5c-6dae1f6f2fe9. Migration status is migrating {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 17 03:03:22 user nova-compute[74898]: INFO nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Updating resource usage from migration e64df685-1998-4c22-aa5c-6dae1f6f2fe9
Nov 17 03:03:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance e733574a-56ba-4e24-babd-855bcb5bda61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 015ff42a-4d69-4f60-b86c-c6bd68d23c99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 4b869a55-acf6-4550-9354-2480273a4ee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance d1ee03a5-13fb-47e7-8712-ea31aed36643 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 36e687c0-9481-4126-b365-f7f9707e2338 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance ba39a7b9-8b0a-421c-80d1-6bd3f32aef42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Migration e64df685-1998-4c22-aa5c-6dae1f6f2fe9 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 11704034-7afe-475c-ae43-1324b40f0d92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG nova.compute.manager [req-fdbc6e67-525b-45f2-9a10-501b01ce33c0 req-7bfb0b2a-5a87-43de-ba5e-49ac7538bc09 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received event network-vif-unplugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fdbc6e67-525b-45f2-9a10-501b01ce33c0 req-7bfb0b2a-5a87-43de-ba5e-49ac7538bc09 service nova] Acquiring lock "11704034-7afe-475c-ae43-1324b40f0d92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fdbc6e67-525b-45f2-9a10-501b01ce33c0 req-7bfb0b2a-5a87-43de-ba5e-49ac7538bc09 service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fdbc6e67-525b-45f2-9a10-501b01ce33c0 req-7bfb0b2a-5a87-43de-ba5e-49ac7538bc09 service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG nova.compute.manager [req-fdbc6e67-525b-45f2-9a10-501b01ce33c0 req-7bfb0b2a-5a87-43de-ba5e-49ac7538bc09 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] No waiting events found dispatching network-vif-unplugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:03:22 user nova-compute[74898]: WARNING nova.compute.manager [req-fdbc6e67-525b-45f2-9a10-501b01ce33c0 req-7bfb0b2a-5a87-43de-ba5e-49ac7538bc09 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received unexpected event network-vif-unplugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 for instance with vm_state active and task_state resize_migrating.
Nov 17 03:03:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG nova.compute.manager [req-f80fab47-0bb0-4c10-b0ae-102ba0b1420d req-86a9677b-70a6-4233-b4d7-32c99d2ac82c service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Received event network-vif-unplugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f80fab47-0bb0-4c10-b0ae-102ba0b1420d req-86a9677b-70a6-4233-b4d7-32c99d2ac82c service nova] Acquiring lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f80fab47-0bb0-4c10-b0ae-102ba0b1420d req-86a9677b-70a6-4233-b4d7-32c99d2ac82c service nova] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f80fab47-0bb0-4c10-b0ae-102ba0b1420d req-86a9677b-70a6-4233-b4d7-32c99d2ac82c service nova] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:22 user nova-compute[74898]: DEBUG nova.compute.manager [req-f80fab47-0bb0-4c10-b0ae-102ba0b1420d req-86a9677b-70a6-4233-b4d7-32c99d2ac82c service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] No waiting events found dispatching network-vif-unplugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:03:22 user nova-compute[74898]: WARNING nova.compute.manager [req-f80fab47-0bb0-4c10-b0ae-102ba0b1420d req-86a9677b-70a6-4233-b4d7-32c99d2ac82c service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Received unexpected event network-vif-unplugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f for instance with vm_state active and task_state rescuing.
Nov 17 03:03:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:23 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:03:23 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:03:23 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:03:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:23 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Instance destroyed successfully.
Nov 17 03:03:23 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Instance destroyed successfully.
Nov 17 03:03:23 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2234992',display_name='tempest-ServerActionsTestOtherB-server-2234992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2234992',id=4,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDa4qtus/f7IjtzuxUsFF91hKDL1YzX3TcJUCEJl5/APKTelpFkHRN746k1MAjDCvCv80GeN8KM6dto88zEniSlfqFbxPMUk2N38IhkUm1HO5g3tqYF+QbpzM60KAg8lAA==',key_name='tempest-keypair-562322790',keypairs=<?>,launch_index=0,launched_at=2023-11-17T02:59:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b79304b161b748c4b105640273979318',ramdisk_id='',reservation_id='r-p8pu7pmp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1831504115',owner_user_name='tempest-ServerActionsTestOtherB-1831504115-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:03:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92e234cf0f444581b2fa827b116959aa',uuid=11704034-7afe-475c-ae43-1324b40f0d92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "address": "fa:16:3e:98:61:d2", "network": {"id": "ff76f13f-ae63-4dd0-a219-894c6ae65c00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1502020482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1502020482-network", "vif_mac": "fa:16:3e:98:61:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b79304b161b748c4b105640273979318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d1282-04", "ovs_interfaceid": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:03:23 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Converting VIF {"id": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "address": "fa:16:3e:98:61:d2", "network": {"id": "ff76f13f-ae63-4dd0-a219-894c6ae65c00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1502020482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1502020482-network", "vif_mac": "fa:16:3e:98:61:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b79304b161b748c4b105640273979318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d1282-04", "ovs_interfaceid": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:03:23 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:61:d2,bridge_name='br-int',has_traffic_filtering=True,id=7f2d1282-0400-4c1e-890d-46a51040a8b5,network=Network(ff76f13f-ae63-4dd0-a219-894c6ae65c00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d1282-04') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:03:23 user nova-compute[74898]: DEBUG os_vif [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:61:d2,bridge_name='br-int',has_traffic_filtering=True,id=7f2d1282-0400-4c1e-890d-46a51040a8b5,network=Network(ff76f13f-ae63-4dd0-a219-894c6ae65c00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d1282-04') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:03:23 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Attempting a stable device rescue
Nov 17 03:03:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f2d1282-04, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:03:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:03:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8fdbbd17-0064-4fc4-93ac-d5280688763c) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:03:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:03:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:24 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74898) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 17 03:03:24 user nova-compute[74898]: INFO os_vif [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:61:d2,bridge_name='br-int',has_traffic_filtering=True,id=7f2d1282-0400-4c1e-890d-46a51040a8b5,network=Network(ff76f13f-ae63-4dd0-a219-894c6ae65c00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d1282-04')
Nov 17 03:03:24 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Instance directory exists: not creating {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 17 03:03:24 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Creating image(s)
Nov 17 03:03:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Acquiring lock "/opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "/opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "/opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:24 user nova-compute[74898]: DEBUG nova.objects.instance [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lazy-loading 'trusted_certs' on Instance uuid 015ff42a-4d69-4f60-b86c-c6bd68d23c99 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:03:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:24 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:03:24 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpmzNxqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:03:24 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:03:24 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:03:24 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:03:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Acquiring lock "e75e682c70f529fb4ed39e49672c43af79c04455" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "e75e682c70f529fb4ed39e49672c43af79c04455" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:24 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[83616962-0c89-443e-8cbc-bf58dbc4c438]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:24 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:03:24 user nova-compute[74898]: No targets found.
Nov 17 03:03:24 user nova-compute[74898]: iSNS:
Nov 17 03:03:24 user nova-compute[74898]: No targets found.
Nov 17 03:03:24 user nova-compute[74898]: STATIC:
Nov 17 03:03:24 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45
Nov 17 03:03:24 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:03:24 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:03:24 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0
Nov 17 03:03:24 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:03:24 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:03:24 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4
Nov 17 03:03:24 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:03:24 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:03:24 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8
Nov 17 03:03:24 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:03:24 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:03:24 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019
Nov 17 03:03:24 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:03:24 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:03:24 user nova-compute[74898]: FIRMWARE:
Nov 17 03:03:24 user nova-compute[74898]: No targets found.
Nov 17 03:03:24 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:03:24 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:03:24 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:03:24 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:03:24 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:03:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:24 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[882befe3-07a2-419f-a76d-a70f70654b1d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:24 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[68298ec1-b7be-4211-b09c-93497a8b40dd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:24 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:03:24 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:03:24 user nova-compute[74898]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:03:24 user nova-compute[74898]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:03:24 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:03:24 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:03:24 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:03:24 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:03:24 user nova-compute[74898]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:03:24 user nova-compute[74898]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:03:24 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:03:24 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:03:24 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf86c3760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45'): ({'sdd'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:03:24 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Removing single pathed devices sdd {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:03:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e75e682c70f529fb4ed39e49672c43af79c04455.part --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4904a68-0944-478d-b679-5324adcc3009]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG nova.compute.manager [req-f7000dac-6315-4b80-80a2-0578808d060e req-0361e204-ae92-4a4f-a68d-7d3a110a9dcf service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received event network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f7000dac-6315-4b80-80a2-0578808d060e req-0361e204-ae92-4a4f-a68d-7d3a110a9dcf service nova] Acquiring lock "11704034-7afe-475c-ae43-1324b40f0d92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f7000dac-6315-4b80-80a2-0578808d060e req-0361e204-ae92-4a4f-a68d-7d3a110a9dcf service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f7000dac-6315-4b80-80a2-0578808d060e req-0361e204-ae92-4a4f-a68d-7d3a110a9dcf service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG nova.compute.manager [req-f7000dac-6315-4b80-80a2-0578808d060e req-0361e204-ae92-4a4f-a68d-7d3a110a9dcf service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] No waiting events found dispatching network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:03:25 user nova-compute[74898]: WARNING nova.compute.manager [req-f7000dac-6315-4b80-80a2-0578808d060e req-0361e204-ae92-4a4f-a68d-7d3a110a9dcf service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received unexpected event network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 for instance with vm_state active and task_state resize_migrating.
Nov 17 03:03:25 user nova-compute[74898]: DEBUG nova.compute.manager [req-f7000dac-6315-4b80-80a2-0578808d060e req-0361e204-ae92-4a4f-a68d-7d3a110a9dcf service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received event network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f7000dac-6315-4b80-80a2-0578808d060e req-0361e204-ae92-4a4f-a68d-7d3a110a9dcf service nova] Acquiring lock "11704034-7afe-475c-ae43-1324b40f0d92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f7000dac-6315-4b80-80a2-0578808d060e req-0361e204-ae92-4a4f-a68d-7d3a110a9dcf service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f7000dac-6315-4b80-80a2-0578808d060e req-0361e204-ae92-4a4f-a68d-7d3a110a9dcf service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG nova.compute.manager [req-f7000dac-6315-4b80-80a2-0578808d060e req-0361e204-ae92-4a4f-a68d-7d3a110a9dcf service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] No waiting events found dispatching network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:03:25 user nova-compute[74898]: WARNING nova.compute.manager [req-f7000dac-6315-4b80-80a2-0578808d060e req-0361e204-ae92-4a4f-a68d-7d3a110a9dcf service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received unexpected event network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 for instance with vm_state active and task_state resize_migrating.
Nov 17 03:03:25 user nova-compute[74898]: DEBUG nova.compute.manager [req-021d4c6d-6712-4e49-aed2-17a6a7de5faf req-757beb8e-06cd-4e29-9b84-644034c6998b service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Received event network-vif-plugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-021d4c6d-6712-4e49-aed2-17a6a7de5faf req-757beb8e-06cd-4e29-9b84-644034c6998b service nova] Acquiring lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-021d4c6d-6712-4e49-aed2-17a6a7de5faf req-757beb8e-06cd-4e29-9b84-644034c6998b service nova] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-021d4c6d-6712-4e49-aed2-17a6a7de5faf req-757beb8e-06cd-4e29-9b84-644034c6998b service nova] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG nova.compute.manager [req-021d4c6d-6712-4e49-aed2-17a6a7de5faf req-757beb8e-06cd-4e29-9b84-644034c6998b service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] No waiting events found dispatching network-vif-plugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:03:25 user nova-compute[74898]: WARNING nova.compute.manager [req-021d4c6d-6712-4e49-aed2-17a6a7de5faf req-757beb8e-06cd-4e29-9b84-644034c6998b service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Received unexpected event network-vif-plugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f for instance with vm_state active and task_state rescuing.
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf6e0ac-a30d-41b4-84fe-49153894e679]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Flushing IO for device /dev/sdd {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d40365-cdef-4207-b195-b18b4985e47f]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[495dfe4b-81b6-4c86-98d0-356a3bc9104a]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] SCSI volumes sdd have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b670f06-6a15-44e9-a3a4-7e1f6867b56b]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e75e682c70f529fb4ed39e49672c43af79c04455.part --force-share --output=json" returned: 0 in 0.222s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG nova.virt.images [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] d59c708c-688e-4bae-a17b-29b8bef2b4d1 was qcow2, converting to raw {{(pid=74898) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG nova.privsep.utils [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74898) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e75e682c70f529fb4ed39e49672c43af79c04455.part /opt/stack/data/nova/instances/_base/e75e682c70f529fb4ed39e49672c43af79c04455.converted {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef79b80a-aa92-4c3d-ace7-e5bd10a12a42]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45, portal: 172.16.0.220,3260]
Nov 17 03:03:25 user nova-compute[74898]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45, portal: 172.16.0.220,3260] successful.
Nov 17 03:03:25 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bea0dce-97cc-4810-8547-70370b731fc6]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 1.522s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] <== disconnect_volume: return (1524ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e75e682c70f529fb4ed39e49672c43af79c04455.part /opt/stack/data/nova/instances/_base/e75e682c70f529fb4ed39e49672c43af79c04455.converted" returned: 0 in 0.519s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e75e682c70f529fb4ed39e49672c43af79c04455.converted --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json" returned: 0 in 0.351s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92_resize/disk /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e75e682c70f529fb4ed39e49672c43af79c04455.converted --force-share --output=json" returned: 0 in 0.216s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "e75e682c70f529fb4ed39e49672c43af79c04455" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.251s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Acquiring lock "e75e682c70f529fb4ed39e49672c43af79c04455" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "e75e682c70f529fb4ed39e49672c43af79c04455" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e75e682c70f529fb4ed39e49672c43af79c04455 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e75e682c70f529fb4ed39e49672c43af79c04455 --force-share --output=json" returned: 0 in 0.180s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e75e682c70f529fb4ed39e49672c43af79c04455,backing_fmt=raw /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk.rescue {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e75e682c70f529fb4ed39e49672c43af79c04455,backing_fmt=raw /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk.rescue" returned: 0 in 0.054s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "e75e682c70f529fb4ed39e49672c43af79c04455" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG nova.objects.instance [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lazy-loading 'migration_context' on Instance uuid 015ff42a-4d69-4f60-b86c-c6bd68d23c99 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG nova.objects.base [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Object Instance<015ff42a-4d69-4f60-b86c-c6bd68d23c99> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Start _get_guest_xml network_info=[{"id": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "address": "fa:16:3e:88:21:6c", "network": {"id": "bf964a06-b5fd-41c4-9dfe-5d485019bbdd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-848964430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-848964430-network", "vif_mac": "fa:16:3e:88:21:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74014d7708574848bee4da7056ab1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d80c52a-1f", "ovs_interfaceid": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd59c708c-688e-4bae-a17b-29b8bef2b4d1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjUusBlA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '015ff42a-4d69-4f60-b86c-c6bd68d23c99', 'attached_at': '', 'detached_at': '', 'volume_id': 'f27c7dcc-c45f-4ad7-819d-d89a8a89bae0', 'serial': 'f27c7dcc-c45f-4ad7-819d-d89a8a89bae0'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'd767b91c-924a-439b-a481-e278c80eb904', 'volume_type': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG nova.objects.instance [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lazy-loading 'resources' on Instance uuid 015ff42a-4d69-4f60-b86c-c6bd68d23c99 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG nova.objects.base [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Object Instance<015ff42a-4d69-4f60-b86c-c6bd68d23c99> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG nova.objects.instance [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lazy-loading 'numa_topology' on Instance uuid 015ff42a-4d69-4f60-b86c-c6bd68d23c99 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG nova.objects.base [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Object Instance<015ff42a-4d69-4f60-b86c-c6bd68d23c99> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:03:26 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:03:26 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:03:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG nova.objects.instance [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lazy-loading 'vcpu_model' on Instance uuid 015ff42a-4d69-4f60-b86c-c6bd68d23c99 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG nova.objects.base [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Object Instance<015ff42a-4d69-4f60-b86c-c6bd68d23c99> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjUusBlA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:03:26 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:03:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:03:26 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:03:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:03:26 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] CMD "cp -r /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92_resize/disk /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk" returned: 0 in 0.571s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92_resize/disk.info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk.info {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b36dfd-9044-46b6-bf59-9b14cefed9f2]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = JjUusBlA\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] CMD "cp -r /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92_resize/disk.info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk.info" returned: 0 in 0.037s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 17 03:03:26 user nova-compute[74898]: node.name = iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0
Nov 17 03:03:26 user nova-compute[74898]: node.tpgt = -1
Nov 17 03:03:26 user nova-compute[74898]: node.startup = automatic
Nov 17 03:03:26 user nova-compute[74898]: node.leading_login = No
Nov 17 03:03:26 user nova-compute[74898]: iface.iscsi_ifacename = default
Nov 17 03:03:26 user nova-compute[74898]: iface.net_ifacename = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.ipaddress = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.prefix_len = 0
Nov 17 03:03:26 user nova-compute[74898]: iface.hwaddress = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.transport_name = tcp
Nov 17 03:03:26 user nova-compute[74898]: iface.initiatorname = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.state = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.vlan_id = 0
Nov 17 03:03:26 user nova-compute[74898]: iface.vlan_priority = 0
Nov 17 03:03:26 user nova-compute[74898]: iface.vlan_state = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.iface_num = 0
Nov 17 03:03:26 user nova-compute[74898]: iface.mtu = 0
Nov 17 03:03:26 user nova-compute[74898]: iface.port = 0
Nov 17 03:03:26 user nova-compute[74898]: iface.bootproto = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.subnet_mask = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.gateway = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.dhcp_alt_client_id_state = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.dhcp_alt_client_id = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.dhcp_dns = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.dhcp_learn_iqn = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.dhcp_req_vendor_id_state = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.dhcp_vendor_id_state = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.dhcp_vendor_id = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.dhcp_slp_da = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.fragmentation = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.gratuitous_arp = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.incoming_forwarding = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.tos_state = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.tos = 0
Nov 17 03:03:26 user nova-compute[74898]: iface.ttl = 0
Nov 17 03:03:26 user nova-compute[74898]: iface.delayed_ack = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.tcp_nagle = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.tcp_wsf_state = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.tcp_wsf = 0
Nov 17 03:03:26 user nova-compute[74898]: iface.tcp_timer_scale = 0
Nov 17 03:03:26 user nova-compute[74898]: iface.tcp_timestamp = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.redirect = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.def_task_mgmt_timeout = 0
Nov 17 03:03:26 user nova-compute[74898]: iface.header_digest = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.data_digest = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.immediate_data = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.initial_r2t = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.data_seq_inorder = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.data_pdu_inorder = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.erl = 0
Nov 17 03:03:26 user nova-compute[74898]: iface.max_receive_data_len = 0
Nov 17 03:03:26 user nova-compute[74898]: iface.first_burst_len = 0
Nov 17 03:03:26 user nova-compute[74898]: iface.max_outstanding_r2t = 0
Nov 17 03:03:26 user nova-compute[74898]: iface.max_burst_len = 0
Nov 17 03:03:26 user nova-compute[74898]: iface.chap_auth = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.bidi_chap = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.strict_login_compliance = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.discovery_auth = <empty>
Nov 17 03:03:26 user nova-compute[74898]: iface.discovery_logout = <empty>
Nov 17 03:03:26 user nova-compute[74898]: node.discovery_address = <empty>
Nov 17 03:03:26 user nova-compute[74898]: node.discovery_port = 0
Nov 17 03:03:26 user nova-compute[74898]: node.discovery_type = static
Nov 17 03:03:26 user nova-compute[74898]: node.session.initial_cmdsn = 0
Nov 17 03:03:26 user nova-compute[74898]: node.session.initial_login_retry_max = 8
Nov 17 03:03:26 user nova-compute[74898]: node.session.xmit_thread_priority = -20
Nov 17 03:03:26 user nova-compute[74898]: node.session.cmds_max = 128
Nov 17 03:03:26 user nova-compute[74898]: node.session.queue_depth = 32
Nov 17 03:03:26 user nova-compute[74898]: node.session.nr_sessions = 1
Nov 17 03:03:26 user nova-compute[74898]: node.session.auth.authmethod = CHAP
Nov 17 03:03:26 user nova-compute[74898]: node.session.auth.username = JjUusBlA
Nov 17 03:03:26 user nova-compute[74898]: node.session.auth.password = ***
Nov 17 03:03:26 user nova-compute[74898]: node.session.auth.username_in = <empty>
Nov 17 03:03:26 user nova-compute[74898]: node.session.auth.password_in = <empty>
Nov 17 03:03:26 user nova-compute[74898]: node.session.auth.chap_algs = MD5
Nov 17 03:03:26 user nova-compute[74898]: node.session.timeo.replacement_timeout = 120
Nov 17 03:03:26 user nova-compute[74898]: node.session.err_timeo.abort_timeout = 15
Nov 17 03:03:26 user nova-compute[74898]: node.session.err_timeo.lu_reset_timeout = 30
Nov 17 03:03:26 user nova-compute[74898]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 17 03:03:26 user nova-compute[74898]: node.session.err_timeo.host_reset_timeout = 60
Nov 17 03:03:26 user nova-compute[74898]: node.session.iscsi.FastAbort = Yes
Nov 17 03:03:26 user nova-compute[74898]: node.session.iscsi.InitialR2T = No
Nov 17 03:03:26 user nova-compute[74898]: node.session.iscsi.ImmediateData = Yes
Nov 17 03:03:26 user nova-compute[74898]: node.session.iscsi.FirstBurstLength = 262144
Nov 17 03:03:26 user nova-compute[74898]: node.session.iscsi.MaxBurstLength = 16776192
Nov 17 03:03:26 user nova-compute[74898]: node.session.iscsi.DefaultTime2Retain = 0
Nov 17 03:03:26 user nova-compute[74898]: node.session.iscsi.DefaultTime2Wait = 2
Nov 17 03:03:26 user nova-compute[74898]: node.session.iscsi.MaxConnections = 1
Nov 17 03:03:26 user nova-compute[74898]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 17 03:03:26 user nova-compute[74898]: node.session.iscsi.ERL = 0
Nov 17 03:03:26 user nova-compute[74898]: node.session.scan = manual
Nov 17 03:03:26 user nova-compute[74898]: node.session.reopen_max = 0
Nov 17 03:03:26 user nova-compute[74898]: node.conn[0].address = 172.16.0.220
Nov 17 03:03:26 user nova-compute[74898]: node.conn[0].port = 3260
Nov 17 03:03:26 user nova-compute[74898]: node.conn[0].startup = manual
Nov 17 03:03:26 user nova-compute[74898]: node.conn[0].tcp.window_size = 524288
Nov 17 03:03:26 user nova-compute[74898]: node.conn[0].tcp.type_of_service = 0
Nov 17 03:03:26 user nova-compute[74898]: node.conn[0].timeo.logout_timeout = 15
Nov 17 03:03:26 user nova-compute[74898]: node.conn[0].timeo.login_timeout = 15
Nov 17 03:03:26 user nova-compute[74898]: node.conn[0].timeo.auth_timeout = 45
Nov 17 03:03:26 user nova-compute[74898]: node.conn[0].timeo.noop_out_interval = 5
Nov 17 03:03:26 user nova-compute[74898]: node.conn[0].timeo.noop_out_timeout = 5
Nov 17 03:03:26 user nova-compute[74898]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 17 03:03:26 user nova-compute[74898]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 17 03:03:26 user nova-compute[74898]: node.conn[0].iscsi.HeaderDigest = None
Nov 17 03:03:26 user nova-compute[74898]: node.conn[0].iscsi.DataDigest = None
Nov 17 03:03:26 user nova-compute[74898]: node.conn[0].iscsi.IFMarker = No
Nov 17 03:03:26 user nova-compute[74898]: node.conn[0].iscsi.OFMarker = No
Nov 17 03:03:26 user nova-compute[74898]: # END RECORD
Nov 17 03:03:26 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd00f2fa-019c-4eff-bbcb-0109633b027d]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[589e3cd8-d274-4d74-9942-5d4aff813c95]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JjUusBlA {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JjUusBlA" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[405336e6-72c3-489a-8db9-94c1489f300d]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JjUusBlA'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ae3d12-5ce6-4c6b-ab87-72e3c1b29d3c]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd0dc78-29f6-4d10-b4e8-19121a74633c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:03:26 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:03:26 user nova-compute[74898]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:03:26 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:03:26 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:03:26 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:03:26 user nova-compute[74898]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:03:26 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:03:26 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.180s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] HCTL ('37', '0', '0', 0) found on session 16 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:26 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b746045-b307-4ff3-ae9c-4942d7ed46d6]: (4, ('0 0 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:27 user nova-compute[74898]: DEBUG nova.compute.manager [req-5e7e1230-b516-4893-8648-9e4859e0c31d req-176b949c-78b4-4b8b-9b91-240e7d941ce9 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received event network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:03:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5e7e1230-b516-4893-8648-9e4859e0c31d req-176b949c-78b4-4b8b-9b91-240e7d941ce9 service nova] Acquiring lock "11704034-7afe-475c-ae43-1324b40f0d92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5e7e1230-b516-4893-8648-9e4859e0c31d req-176b949c-78b4-4b8b-9b91-240e7d941ce9 service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5e7e1230-b516-4893-8648-9e4859e0c31d req-176b949c-78b4-4b8b-9b91-240e7d941ce9 service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:27 user nova-compute[74898]: DEBUG nova.compute.manager [req-5e7e1230-b516-4893-8648-9e4859e0c31d req-176b949c-78b4-4b8b-9b91-240e7d941ce9 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] No waiting events found dispatching network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:03:27 user nova-compute[74898]: WARNING nova.compute.manager [req-5e7e1230-b516-4893-8648-9e4859e0c31d req-176b949c-78b4-4b8b-9b91-240e7d941ce9 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received unexpected event network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 for instance with vm_state active and task_state resize_migrating.
Nov 17 03:03:27 user nova-compute[74898]: DEBUG nova.compute.manager [req-5e7e1230-b516-4893-8648-9e4859e0c31d req-176b949c-78b4-4b8b-9b91-240e7d941ce9 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received event network-vif-unplugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:03:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5e7e1230-b516-4893-8648-9e4859e0c31d req-176b949c-78b4-4b8b-9b91-240e7d941ce9 service nova] Acquiring lock "11704034-7afe-475c-ae43-1324b40f0d92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5e7e1230-b516-4893-8648-9e4859e0c31d req-176b949c-78b4-4b8b-9b91-240e7d941ce9 service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5e7e1230-b516-4893-8648-9e4859e0c31d req-176b949c-78b4-4b8b-9b91-240e7d941ce9 service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:27 user nova-compute[74898]: DEBUG nova.compute.manager [req-5e7e1230-b516-4893-8648-9e4859e0c31d req-176b949c-78b4-4b8b-9b91-240e7d941ce9 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] No waiting events found dispatching network-vif-unplugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:03:27 user nova-compute[74898]: WARNING nova.compute.manager [req-5e7e1230-b516-4893-8648-9e4859e0c31d req-176b949c-78b4-4b8b-9b91-240e7d941ce9 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received unexpected event network-vif-unplugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 for instance with vm_state active and task_state resize_migrating.
Nov 17 03:03:27 user nova-compute[74898]: DEBUG nova.compute.manager [req-5e7e1230-b516-4893-8648-9e4859e0c31d req-176b949c-78b4-4b8b-9b91-240e7d941ce9 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received event network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:03:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5e7e1230-b516-4893-8648-9e4859e0c31d req-176b949c-78b4-4b8b-9b91-240e7d941ce9 service nova] Acquiring lock "11704034-7afe-475c-ae43-1324b40f0d92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5e7e1230-b516-4893-8648-9e4859e0c31d req-176b949c-78b4-4b8b-9b91-240e7d941ce9 service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5e7e1230-b516-4893-8648-9e4859e0c31d req-176b949c-78b4-4b8b-9b91-240e7d941ce9 service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:27 user nova-compute[74898]: DEBUG nova.compute.manager [req-5e7e1230-b516-4893-8648-9e4859e0c31d req-176b949c-78b4-4b8b-9b91-240e7d941ce9 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] No waiting events found dispatching network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:03:27 user nova-compute[74898]: WARNING nova.compute.manager [req-5e7e1230-b516-4893-8648-9e4859e0c31d req-176b949c-78b4-4b8b-9b91-240e7d941ce9 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received unexpected event network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 for instance with vm_state active and task_state resize_migrating.
Nov 17 03:03:27 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Searching for a device in session 16 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:03:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjUusBlA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:03:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.295s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:03:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] <== connect_volume: return (296ms) {'type': 'block', 'scsi_wwn': '26337306630383737', 'path': '/dev/sdf'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:03:27 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337306630383737', 'path': '/dev/sdf'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:03:27 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:59:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-79461071',display_name='tempest-ServerStableDeviceRescueTest-server-79461071',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-79461071',id=5,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3ScoMcY64cOmhLR5MRqP3FGji32oeJktiJUi4U3NwH7+yAWoEgDSQgmx/yQzS0wVqsxpjUYQDyGQwbr5p0i4LUVJlGd/b4gDnj3xIHz2RcTwm9n6DLaujAEe7PSgJ6+A==',key_name='tempest-keypair-1704675523',keypairs=<?>,launch_index=0,launched_at=2023-11-17T02:59:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74014d7708574848bee4da7056ab1f09',ramdisk_id='',reservation_id='r-75bj56av',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1390708223',owner_user_name='tempest-ServerStableDeviceRescueTest-1390708223-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:01:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14311a1fee1548f8a3dc603cebaf42dd',uuid=015ff42a-4d69-4f60-b86c-c6bd68d23c99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "address": "fa:16:3e:88:21:6c", "network": {"id": "bf964a06-b5fd-41c4-9dfe-5d485019bbdd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-848964430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-848964430-network", "vif_mac": "fa:16:3e:88:21:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74014d7708574848bee4da7056ab1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d80c52a-1f", "ovs_interfaceid": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:03:27 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Converting VIF {"id": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "address": "fa:16:3e:88:21:6c", "network": {"id": "bf964a06-b5fd-41c4-9dfe-5d485019bbdd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-848964430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-848964430-network", "vif_mac": "fa:16:3e:88:21:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74014d7708574848bee4da7056ab1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d80c52a-1f", "ovs_interfaceid": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:03:27 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:21:6c,bridge_name='br-int',has_traffic_filtering=True,id=9d80c52a-1fc2-43ca-bed1-126c6b8e204f,network=Network(bf964a06-b5fd-41c4-9dfe-5d485019bbdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d80c52a-1f') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:03:27 user nova-compute[74898]: DEBUG nova.objects.instance [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lazy-loading 'pci_devices' on Instance uuid 015ff42a-4d69-4f60-b86c-c6bd68d23c99 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:03:27 user nova-compute[74898]: DEBUG nova.objects.base [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Object Instance<015ff42a-4d69-4f60-b86c-c6bd68d23c99> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:03:27 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:03:27 user nova-compute[74898]:   <uuid>015ff42a-4d69-4f60-b86c-c6bd68d23c99</uuid>
Nov 17 03:03:27 user nova-compute[74898]:   <name>instance-00000005</name>
Nov 17 03:03:27 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:03:27 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:03:27 user nova-compute[74898]:   <metadata>
Nov 17 03:03:27 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:03:27 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:03:27 user nova-compute[74898]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-79461071</nova:name>
Nov 17 03:03:27 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:03:26</nova:creationTime>
Nov 17 03:03:27 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:03:27 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:03:27 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:03:27 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:03:27 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:03:27 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:03:27 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:03:27 user nova-compute[74898]:       <nova:owner>
Nov 17 03:03:27 user nova-compute[74898]:         <nova:user uuid="14311a1fee1548f8a3dc603cebaf42dd">tempest-ServerStableDeviceRescueTest-1390708223-project-member</nova:user>
Nov 17 03:03:27 user nova-compute[74898]:         <nova:project uuid="74014d7708574848bee4da7056ab1f09">tempest-ServerStableDeviceRescueTest-1390708223</nova:project>
Nov 17 03:03:27 user nova-compute[74898]:       </nova:owner>
Nov 17 03:03:27 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:03:27 user nova-compute[74898]:       <nova:ports>
Nov 17 03:03:27 user nova-compute[74898]:         <nova:port uuid="9d80c52a-1fc2-43ca-bed1-126c6b8e204f">
Nov 17 03:03:27 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 17 03:03:27 user nova-compute[74898]:         </nova:port>
Nov 17 03:03:27 user nova-compute[74898]:       </nova:ports>
Nov 17 03:03:27 user nova-compute[74898]:     </nova:instance>
Nov 17 03:03:27 user nova-compute[74898]:   </metadata>
Nov 17 03:03:27 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:03:27 user nova-compute[74898]:     <system>
Nov 17 03:03:27 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:03:27 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:03:27 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:03:27 user nova-compute[74898]:       <entry name="serial">015ff42a-4d69-4f60-b86c-c6bd68d23c99</entry>
Nov 17 03:03:27 user nova-compute[74898]:       <entry name="uuid">015ff42a-4d69-4f60-b86c-c6bd68d23c99</entry>
Nov 17 03:03:27 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:03:27 user nova-compute[74898]:     </system>
Nov 17 03:03:27 user nova-compute[74898]:   </sysinfo>
Nov 17 03:03:27 user nova-compute[74898]:   <os>
Nov 17 03:03:27 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:03:27 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:03:27 user nova-compute[74898]:   </os>
Nov 17 03:03:27 user nova-compute[74898]:   <features>
Nov 17 03:03:27 user nova-compute[74898]:     <acpi/>
Nov 17 03:03:27 user nova-compute[74898]:     <apic/>
Nov 17 03:03:27 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:03:27 user nova-compute[74898]:   </features>
Nov 17 03:03:27 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:03:27 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:03:27 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:03:27 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:03:27 user nova-compute[74898]:   </clock>
Nov 17 03:03:27 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:03:27 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:03:27 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:03:27 user nova-compute[74898]:   </cpu>
Nov 17 03:03:27 user nova-compute[74898]:   <devices>
Nov 17 03:03:27 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:03:27 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:03:27 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk"/>
Nov 17 03:03:27 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:03:27 user nova-compute[74898]:     </disk>
Nov 17 03:03:27 user nova-compute[74898]:     <disk type="block" device="disk">
Nov 17 03:03:27 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:03:27 user nova-compute[74898]:       <source dev="/dev/sdf"/>
Nov 17 03:03:27 user nova-compute[74898]:       <target dev="vdb" bus="virtio"/>
Nov 17 03:03:27 user nova-compute[74898]:       <serial>f27c7dcc-c45f-4ad7-819d-d89a8a89bae0</serial>
Nov 17 03:03:27 user nova-compute[74898]:     </disk>
Nov 17 03:03:27 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:03:27 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:03:27 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk.rescue"/>
Nov 17 03:03:27 user nova-compute[74898]:       <target dev="vdc" bus="virtio"/>
Nov 17 03:03:27 user nova-compute[74898]:       <boot order="1"/>
Nov 17 03:03:27 user nova-compute[74898]:     </disk>
Nov 17 03:03:27 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:03:27 user nova-compute[74898]:       <mac address="fa:16:3e:88:21:6c"/>
Nov 17 03:03:27 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:03:27 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:03:27 user nova-compute[74898]:       <target dev="tap9d80c52a-1f"/>
Nov 17 03:03:27 user nova-compute[74898]:     </interface>
Nov 17 03:03:27 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:03:27 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/console.log" append="off"/>
Nov 17 03:03:27 user nova-compute[74898]:     </serial>
Nov 17 03:03:27 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:03:27 user nova-compute[74898]:     <video>
Nov 17 03:03:27 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:03:27 user nova-compute[74898]:     </video>
Nov 17 03:03:27 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:03:27 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:03:27 user nova-compute[74898]:     </rng>
Nov 17 03:03:27 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:03:27 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:03:27 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:03:27 user nova-compute[74898]:     </memballoon>
Nov 17 03:03:27 user nova-compute[74898]:   </devices>
Nov 17 03:03:27 user nova-compute[74898]: </domain>
Nov 17 03:03:27 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:03:27 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Instance destroyed successfully.
Nov 17 03:03:27 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:03:27 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:03:27 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:03:27 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] No VIF found with MAC fa:16:3e:88:21:6c, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:03:28 user nova-compute[74898]: DEBUG nova.network.neutron [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Port 7f2d1282-0400-4c1e-890d-46a51040a8b5 binding to destination host user is already ACTIVE {{(pid=74898) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 17 03:03:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquiring lock "11704034-7afe-475c-ae43-1324b40f0d92-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquiring lock "refresh_cache-11704034-7afe-475c-ae43-1324b40f0d92" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:03:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquired lock "refresh_cache-11704034-7afe-475c-ae43-1324b40f0d92" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:03:28 user nova-compute[74898]: DEBUG nova.network.neutron [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:03:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:29 user nova-compute[74898]: DEBUG nova.compute.manager [req-926b0ea2-bccb-4583-ba9c-af287540b4f1 req-cd877d22-2134-43a3-8d31-161ffe8d63e3 service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Received event network-vif-plugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:03:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-926b0ea2-bccb-4583-ba9c-af287540b4f1 req-cd877d22-2134-43a3-8d31-161ffe8d63e3 service nova] Acquiring lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-926b0ea2-bccb-4583-ba9c-af287540b4f1 req-cd877d22-2134-43a3-8d31-161ffe8d63e3 service nova] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-926b0ea2-bccb-4583-ba9c-af287540b4f1 req-cd877d22-2134-43a3-8d31-161ffe8d63e3 service nova] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:29 user nova-compute[74898]: DEBUG nova.compute.manager [req-926b0ea2-bccb-4583-ba9c-af287540b4f1 req-cd877d22-2134-43a3-8d31-161ffe8d63e3 service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] No waiting events found dispatching network-vif-plugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:03:29 user nova-compute[74898]: WARNING nova.compute.manager [req-926b0ea2-bccb-4583-ba9c-af287540b4f1 req-cd877d22-2134-43a3-8d31-161ffe8d63e3 service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Received unexpected event network-vif-plugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f for instance with vm_state active and task_state rescuing.
Nov 17 03:03:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:29 user nova-compute[74898]: DEBUG nova.network.neutron [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Updating instance_info_cache with network_info: [{"id": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "address": "fa:16:3e:98:61:d2", "network": {"id": "ff76f13f-ae63-4dd0-a219-894c6ae65c00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1502020482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b79304b161b748c4b105640273979318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d1282-04", "ovs_interfaceid": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:03:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Releasing lock "refresh_cache-11704034-7afe-475c-ae43-1324b40f0d92" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:03:29 user nova-compute[74898]: DEBUG os_brick.utils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:03:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a985d565-ed16-4a75-9bbd-99b4d125f8ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6eda13-a4bd-4fab-bb15-b434d5173dc5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aae11d1-cd6b-4076-8838-d6eb51c2ae9e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f915d8-0698-4684-9dcd-26a39e0cbd0b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:03:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:03:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:03:29 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:03:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc87d2a-0096-4742-a857-5edaa655d3a3]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:03:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:03:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:03:29 user nova-compute[74898]: DEBUG os_brick.utils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:03:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:30 user nova-compute[74898]: DEBUG nova.compute.manager [None req-581b8f3d-a7fe-4cf6-9150-12db69289a9c tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:03:31 user nova-compute[74898]: DEBUG nova.compute.manager [req-be3ca503-af8c-4767-9359-ce8811ee297c req-ee359447-7476-4a75-b29b-42044f081976 service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Received event network-vif-plugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:03:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-be3ca503-af8c-4767-9359-ce8811ee297c req-ee359447-7476-4a75-b29b-42044f081976 service nova] Acquiring lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-be3ca503-af8c-4767-9359-ce8811ee297c req-ee359447-7476-4a75-b29b-42044f081976 service nova] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-be3ca503-af8c-4767-9359-ce8811ee297c req-ee359447-7476-4a75-b29b-42044f081976 service nova] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:31 user nova-compute[74898]: DEBUG nova.compute.manager [req-be3ca503-af8c-4767-9359-ce8811ee297c req-ee359447-7476-4a75-b29b-42044f081976 service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] No waiting events found dispatching network-vif-plugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:03:31 user nova-compute[74898]: WARNING nova.compute.manager [req-be3ca503-af8c-4767-9359-ce8811ee297c req-ee359447-7476-4a75-b29b-42044f081976 service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Received unexpected event network-vif-plugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f for instance with vm_state rescued and task_state None.
Nov 17 03:03:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:35 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Starting finish_migration {{(pid=74898) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 17 03:03:35 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Instance directory exists: not creating {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 17 03:03:35 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Creating image(s)
Nov 17 03:03:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.255s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk. size=21474836480 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk 21474836480 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk 21474836480" returned: 0 in 0.181s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Did not create local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Ensure instance console log exists: /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Start _get_guest_xml network_info=[{"id": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "address": "fa:16:3e:98:61:d2", "network": {"id": "ff76f13f-ae63-4dd0-a219-894c6ae65c00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1502020482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1502020482-network", "vif_mac": "fa:16:3e:98:61:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b79304b161b748c4b105640273979318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d1282-04", "ovs_interfaceid": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpmzNxqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '11704034-7afe-475c-ae43-1324b40f0d92', 'attached_at': '2023-11-17T03:03:36.000000', 'detached_at': '', 'volume_id': '2efad82a-fd47-4649-8ce0-ba22f7a22f45', 'serial': '2efad82a-fd47-4649-8ce0-ba22f7a22f45'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'bd5e5054-f4d9-46e0-808d-af87b4420ac2', 'volume_type': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:03:36 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:03:36 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:03:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpmzNxqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:03:36 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:03:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:03:36 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:03:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:03:36 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b479044d-50c6-4ae7-b97b-5c59074d0a22]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:03:36 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd37201b-4724-4a10-9cbc-6c7e3f23c897]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45] added
Nov 17 03:03:36 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f550a8d-59ec-4dd4-afed-b99c976cad67]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[344c92df-b1d6-4e67-9287-dc66b2a335ce]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HpmzNxqO {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HpmzNxqO" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a416eb9-8903-4001-8c44-bc2b827214b6]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HpmzNxqO'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[75db8dee-226f-4e3a-969b-5538092755ad]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e675eb79-a0b5-402a-8a6b-c10653f4da3b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:03:36 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:03:36 user nova-compute[74898]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:03:36 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:03:36 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:03:36 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:03:36 user nova-compute[74898]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:03:36 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:03:36 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[82323061-91ff-40e8-8957-0e00dc95f41c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45, portal: 172.16.0.220,3260]
Nov 17 03:03:36 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45, portal: 172.16.0.220,3260] successful.
Nov 17 03:03:36 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e149e296-5cd8-4ecb-a704-f2ed97f7e2ff]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:03:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:37 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3719c87b-6b55-4816-865f-9a2ac826d5ca]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:37 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:03:37 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:03:37 user nova-compute[74898]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:03:37 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:03:37 user nova-compute[74898]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:03:37 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:03:37 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:03:37 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:03:37 user nova-compute[74898]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:03:37 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:03:37 user nova-compute[74898]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:03:37 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:03:37 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:03:37 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:03:37 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:03:37 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:03:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:37 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a167d397-a76b-4cb3-b186-e4d77bea7ca3]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:03:37 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: None {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:03:38 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:03:38 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpmzNxqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:03:38 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:03:38 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '26136373566326237', 'path': '/dev/sdd'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:03:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136373566326237', 'path': '/dev/sdd'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:03:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2234992',display_name='tempest-ServerActionsTestOtherB-server-2234992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2234992',id=4,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDa4qtus/f7IjtzuxUsFF91hKDL1YzX3TcJUCEJl5/APKTelpFkHRN746k1MAjDCvCv80GeN8KM6dto88zEniSlfqFbxPMUk2N38IhkUm1HO5g3tqYF+QbpzM60KAg8lAA==',key_name='tempest-keypair-562322790',keypairs=<?>,launch_index=0,launched_at=2023-11-17T02:59:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b79304b161b748c4b105640273979318',ramdisk_id='',reservation_id='r-p8pu7pmp',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1831504115',owner_user_name='tempest-ServerActionsTestOtherB-1831504115-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:03:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92e234cf0f444581b2fa827b116959aa',uuid=11704034-7afe-475c-ae43-1324b40f0d92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "address": "fa:16:3e:98:61:d2", "network": {"id": "ff76f13f-ae63-4dd0-a219-894c6ae65c00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1502020482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1502020482-network", "vif_mac": "fa:16:3e:98:61:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b79304b161b748c4b105640273979318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d1282-04", "ovs_interfaceid": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:03:38 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Converting VIF {"id": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "address": "fa:16:3e:98:61:d2", "network": {"id": "ff76f13f-ae63-4dd0-a219-894c6ae65c00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1502020482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1502020482-network", "vif_mac": "fa:16:3e:98:61:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b79304b161b748c4b105640273979318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d1282-04", "ovs_interfaceid": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:03:38 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:61:d2,bridge_name='br-int',has_traffic_filtering=True,id=7f2d1282-0400-4c1e-890d-46a51040a8b5,network=Network(ff76f13f-ae63-4dd0-a219-894c6ae65c00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d1282-04') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:03:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:03:38 user nova-compute[74898]:   <uuid>11704034-7afe-475c-ae43-1324b40f0d92</uuid>
Nov 17 03:03:38 user nova-compute[74898]:   <name>instance-00000004</name>
Nov 17 03:03:38 user nova-compute[74898]:   <memory>2097152</memory>
Nov 17 03:03:38 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:03:38 user nova-compute[74898]:   <metadata>
Nov 17 03:03:38 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:03:38 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:03:38 user nova-compute[74898]:       <nova:name>tempest-ServerActionsTestOtherB-server-2234992</nova:name>
Nov 17 03:03:38 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:03:36</nova:creationTime>
Nov 17 03:03:38 user nova-compute[74898]:       <nova:flavor name="m1.small">
Nov 17 03:03:38 user nova-compute[74898]:         <nova:memory>2048</nova:memory>
Nov 17 03:03:38 user nova-compute[74898]:         <nova:disk>20</nova:disk>
Nov 17 03:03:38 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:03:38 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:03:38 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:03:38 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:03:38 user nova-compute[74898]:       <nova:owner>
Nov 17 03:03:38 user nova-compute[74898]:         <nova:user uuid="92e234cf0f444581b2fa827b116959aa">tempest-ServerActionsTestOtherB-1831504115-project-member</nova:user>
Nov 17 03:03:38 user nova-compute[74898]:         <nova:project uuid="b79304b161b748c4b105640273979318">tempest-ServerActionsTestOtherB-1831504115</nova:project>
Nov 17 03:03:38 user nova-compute[74898]:       </nova:owner>
Nov 17 03:03:38 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:03:38 user nova-compute[74898]:       <nova:ports>
Nov 17 03:03:38 user nova-compute[74898]:         <nova:port uuid="7f2d1282-0400-4c1e-890d-46a51040a8b5">
Nov 17 03:03:38 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 17 03:03:38 user nova-compute[74898]:         </nova:port>
Nov 17 03:03:38 user nova-compute[74898]:       </nova:ports>
Nov 17 03:03:38 user nova-compute[74898]:     </nova:instance>
Nov 17 03:03:38 user nova-compute[74898]:   </metadata>
Nov 17 03:03:38 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:03:38 user nova-compute[74898]:     <system>
Nov 17 03:03:38 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:03:38 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:03:38 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:03:38 user nova-compute[74898]:       <entry name="serial">11704034-7afe-475c-ae43-1324b40f0d92</entry>
Nov 17 03:03:38 user nova-compute[74898]:       <entry name="uuid">11704034-7afe-475c-ae43-1324b40f0d92</entry>
Nov 17 03:03:38 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:03:38 user nova-compute[74898]:     </system>
Nov 17 03:03:38 user nova-compute[74898]:   </sysinfo>
Nov 17 03:03:38 user nova-compute[74898]:   <os>
Nov 17 03:03:38 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:03:38 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:03:38 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:03:38 user nova-compute[74898]:   </os>
Nov 17 03:03:38 user nova-compute[74898]:   <features>
Nov 17 03:03:38 user nova-compute[74898]:     <acpi/>
Nov 17 03:03:38 user nova-compute[74898]:     <apic/>
Nov 17 03:03:38 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:03:38 user nova-compute[74898]:   </features>
Nov 17 03:03:38 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:03:38 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:03:38 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:03:38 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:03:38 user nova-compute[74898]:   </clock>
Nov 17 03:03:38 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:03:38 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:03:38 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:03:38 user nova-compute[74898]:   </cpu>
Nov 17 03:03:38 user nova-compute[74898]:   <devices>
Nov 17 03:03:38 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:03:38 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:03:38 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk"/>
Nov 17 03:03:38 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:03:38 user nova-compute[74898]:     </disk>
Nov 17 03:03:38 user nova-compute[74898]:     <disk type="block" device="disk">
Nov 17 03:03:38 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:03:38 user nova-compute[74898]:       <source dev="/dev/sdd"/>
Nov 17 03:03:38 user nova-compute[74898]:       <target dev="vdb" bus="virtio"/>
Nov 17 03:03:38 user nova-compute[74898]:       <serial>2efad82a-fd47-4649-8ce0-ba22f7a22f45</serial>
Nov 17 03:03:38 user nova-compute[74898]:     </disk>
Nov 17 03:03:38 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:03:38 user nova-compute[74898]:       <mac address="fa:16:3e:98:61:d2"/>
Nov 17 03:03:38 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:03:38 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:03:38 user nova-compute[74898]:       <target dev="tap7f2d1282-04"/>
Nov 17 03:03:38 user nova-compute[74898]:     </interface>
Nov 17 03:03:38 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:03:38 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/console.log" append="off"/>
Nov 17 03:03:38 user nova-compute[74898]:     </serial>
Nov 17 03:03:38 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:03:38 user nova-compute[74898]:     <video>
Nov 17 03:03:38 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:03:38 user nova-compute[74898]:     </video>
Nov 17 03:03:38 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:03:38 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:03:38 user nova-compute[74898]:     </rng>
Nov 17 03:03:38 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:03:38 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:03:38 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:03:38 user nova-compute[74898]:     </memballoon>
Nov 17 03:03:38 user nova-compute[74898]:   </devices>
Nov 17 03:03:38 user nova-compute[74898]: </domain>
Nov 17 03:03:38 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:03:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2234992',display_name='tempest-ServerActionsTestOtherB-server-2234992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2234992',id=4,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDa4qtus/f7IjtzuxUsFF91hKDL1YzX3TcJUCEJl5/APKTelpFkHRN746k1MAjDCvCv80GeN8KM6dto88zEniSlfqFbxPMUk2N38IhkUm1HO5g3tqYF+QbpzM60KAg8lAA==',key_name='tempest-keypair-562322790',keypairs=<?>,launch_index=0,launched_at=2023-11-17T02:59:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b79304b161b748c4b105640273979318',ramdisk_id='',reservation_id='r-p8pu7pmp',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1831504115',owner_user_name='tempest-ServerActionsTestOtherB-1831504115-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:03:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92e234cf0f444581b2fa827b116959aa',uuid=11704034-7afe-475c-ae43-1324b40f0d92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "address": "fa:16:3e:98:61:d2", "network": {"id": "ff76f13f-ae63-4dd0-a219-894c6ae65c00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1502020482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1502020482-network", "vif_mac": "fa:16:3e:98:61:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b79304b161b748c4b105640273979318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d1282-04", "ovs_interfaceid": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:03:38 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Converting VIF {"id": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "address": "fa:16:3e:98:61:d2", "network": {"id": "ff76f13f-ae63-4dd0-a219-894c6ae65c00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1502020482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1502020482-network", "vif_mac": "fa:16:3e:98:61:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b79304b161b748c4b105640273979318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d1282-04", "ovs_interfaceid": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:03:38 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:61:d2,bridge_name='br-int',has_traffic_filtering=True,id=7f2d1282-0400-4c1e-890d-46a51040a8b5,network=Network(ff76f13f-ae63-4dd0-a219-894c6ae65c00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d1282-04') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:03:38 user nova-compute[74898]: DEBUG os_vif [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:61:d2,bridge_name='br-int',has_traffic_filtering=True,id=7f2d1282-0400-4c1e-890d-46a51040a8b5,network=Network(ff76f13f-ae63-4dd0-a219-894c6ae65c00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d1282-04') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:03:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:03:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:03:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '457151b7-1d1f-509b-b2a3-45e9b9ae8a65', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:03:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:03:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f2d1282-04, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:03:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f2d1282-04, col_values=(('qos', UUID('b44ace72-e4d1-431e-adb6-ccd8c73d44a2')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:03:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f2d1282-04, col_values=(('external_ids', {'iface-id': '7f2d1282-0400-4c1e-890d-46a51040a8b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:61:d2', 'vm-uuid': '11704034-7afe-475c-ae43-1324b40f0d92'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:03:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:03:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:38 user nova-compute[74898]: INFO os_vif [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:61:d2,bridge_name='br-int',has_traffic_filtering=True,id=7f2d1282-0400-4c1e-890d-46a51040a8b5,network=Network(ff76f13f-ae63-4dd0-a219-894c6ae65c00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d1282-04')
Nov 17 03:03:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:03:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:03:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] No VIF found with MAC fa:16:3e:98:61:d2, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:03:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-b0c156ee-7f1f-4444-ba51-b1c486b9d820 req-0ab40a7d-9d92-4154-945a-a7d6a1186fc6 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received event network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:03:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b0c156ee-7f1f-4444-ba51-b1c486b9d820 req-0ab40a7d-9d92-4154-945a-a7d6a1186fc6 service nova] Acquiring lock "11704034-7afe-475c-ae43-1324b40f0d92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b0c156ee-7f1f-4444-ba51-b1c486b9d820 req-0ab40a7d-9d92-4154-945a-a7d6a1186fc6 service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b0c156ee-7f1f-4444-ba51-b1c486b9d820 req-0ab40a7d-9d92-4154-945a-a7d6a1186fc6 service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-b0c156ee-7f1f-4444-ba51-b1c486b9d820 req-0ab40a7d-9d92-4154-945a-a7d6a1186fc6 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] No waiting events found dispatching network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:03:39 user nova-compute[74898]: WARNING nova.compute.manager [req-b0c156ee-7f1f-4444-ba51-b1c486b9d820 req-0ab40a7d-9d92-4154-945a-a7d6a1186fc6 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received unexpected event network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 for instance with vm_state active and task_state resize_finish.
Nov 17 03:03:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Acquiring lock "4b869a55-acf6-4550-9354-2480273a4ee2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "4b869a55-acf6-4550-9354-2480273a4ee2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:40 user nova-compute[74898]: INFO nova.compute.manager [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Detaching volume a634de04-148d-4da4-816d-617343087019
Nov 17 03:03:40 user nova-compute[74898]: INFO nova.virt.block_device [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Attempting to driver detach volume a634de04-148d-4da4-816d-617343087019 from mountpoint /dev/vdb
Nov 17 03:03:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Attempting to detach device vdb from instance 4b869a55-acf6-4550-9354-2480273a4ee2 from the persistent domain config. {{(pid=74898) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 03:03:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:03:40 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:03:40 user nova-compute[74898]:   <source dev="/dev/sdc"/>
Nov 17 03:03:40 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:03:40 user nova-compute[74898]:   <serial>a634de04-148d-4da4-816d-617343087019</serial>
Nov 17 03:03:40 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:03:40 user nova-compute[74898]: </disk>
Nov 17 03:03:40 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:03:40 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Successfully detached device vdb from instance 4b869a55-acf6-4550-9354-2480273a4ee2 from the persistent domain config.
Nov 17 03:03:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4b869a55-acf6-4550-9354-2480273a4ee2 from the live domain config. {{(pid=74898) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 03:03:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:03:40 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:03:40 user nova-compute[74898]:   <source dev="/dev/sdc"/>
Nov 17 03:03:40 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:03:40 user nova-compute[74898]:   <serial>a634de04-148d-4da4-816d-617343087019</serial>
Nov 17 03:03:40 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:03:40 user nova-compute[74898]: </disk>
Nov 17 03:03:40 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:03:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4b869a55-acf6-4550-9354-2480273a4ee2 {{(pid=74898) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 03:03:41 user nova-compute[74898]: DEBUG nova.compute.manager [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:03:41 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Instance running successfully.
Nov 17 03:03:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Failed to set time: agent not configured {{(pid=74898) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 17 03:03:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-05ed4dfc-27d8-4ac4-a433-77bf3a808350 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] finish_migration finished successfully. {{(pid=74898) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 17 03:03:41 user nova-compute[74898]: DEBUG nova.compute.manager [req-53860cac-e582-46ff-8794-0d07fc0065d6 req-66180eb9-0379-4ec4-9bdb-fd91c7e1e79a service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received event network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:03:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-53860cac-e582-46ff-8794-0d07fc0065d6 req-66180eb9-0379-4ec4-9bdb-fd91c7e1e79a service nova] Acquiring lock "11704034-7afe-475c-ae43-1324b40f0d92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-53860cac-e582-46ff-8794-0d07fc0065d6 req-66180eb9-0379-4ec4-9bdb-fd91c7e1e79a service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-53860cac-e582-46ff-8794-0d07fc0065d6 req-66180eb9-0379-4ec4-9bdb-fd91c7e1e79a service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:41 user nova-compute[74898]: DEBUG nova.compute.manager [req-53860cac-e582-46ff-8794-0d07fc0065d6 req-66180eb9-0379-4ec4-9bdb-fd91c7e1e79a service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] No waiting events found dispatching network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:03:41 user nova-compute[74898]: WARNING nova.compute.manager [req-53860cac-e582-46ff-8794-0d07fc0065d6 req-66180eb9-0379-4ec4-9bdb-fd91c7e1e79a service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received unexpected event network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 for instance with vm_state resized and task_state None.
Nov 17 03:03:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Acquiring lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:42 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:03:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:42 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:03:42 user nova-compute[74898]: INFO nova.compute.claims [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Claim successful on node user
Nov 17 03:03:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:43 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:03:43 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:03:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:43 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:03:43 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:03:43 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:03:43 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:03:43 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:03:43 user nova-compute[74898]: DEBUG nova.policy [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f1bcce35856143b0bbd89aaaeb520954', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f0d4a6654645f49a5f57d48cc52d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:03:43 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:03:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:03:43 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Creating image(s)
Nov 17 03:03:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Acquiring lock "/opt/stack/data/nova/instances/474a469d-9ebe-4e91-9ec4-3f610bdd4d27/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lock "/opt/stack/data/nova/instances/474a469d-9ebe-4e91-9ec4-3f610bdd4d27/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lock "/opt/stack/data/nova/instances/474a469d-9ebe-4e91-9ec4-3f610bdd4d27/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.217s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.181s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/474a469d-9ebe-4e91-9ec4-3f610bdd4d27/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/474a469d-9ebe-4e91-9ec4-3f610bdd4d27/disk 1073741824" returned: 0 in 0.062s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.233s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:44 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Checking if we can resize image /opt/stack/data/nova/instances/474a469d-9ebe-4e91-9ec4-3f610bdd4d27/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:03:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474a469d-9ebe-4e91-9ec4-3f610bdd4d27/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:44 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Successfully created port: 8b4bafcd-1db9-460a-bb53-3e92498fa50c {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:03:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474a469d-9ebe-4e91-9ec4-3f610bdd4d27/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:44 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Cannot resize image /opt/stack/data/nova/instances/474a469d-9ebe-4e91-9ec4-3f610bdd4d27/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:03:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:03:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Ensure instance console log exists: /opt/stack/data/nova/instances/474a469d-9ebe-4e91-9ec4-3f610bdd4d27/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:03:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Successfully updated port: 8b4bafcd-1db9-460a-bb53-3e92498fa50c {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Acquiring lock "refresh_cache-474a469d-9ebe-4e91-9ec4-3f610bdd4d27" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Acquired lock "refresh_cache-474a469d-9ebe-4e91-9ec4-3f610bdd4d27" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.compute.manager [req-fceb3191-a616-4218-973e-8396b0639a3d req-e8364d18-5e4a-42bb-8caf-2244ef2ac94f service nova] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Received event network-changed-8b4bafcd-1db9-460a-bb53-3e92498fa50c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.compute.manager [req-fceb3191-a616-4218-973e-8396b0639a3d req-e8364d18-5e4a-42bb-8caf-2244ef2ac94f service nova] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Refreshing instance network info cache due to event network-changed-8b4bafcd-1db9-460a-bb53-3e92498fa50c. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fceb3191-a616-4218-973e-8396b0639a3d req-e8364d18-5e4a-42bb-8caf-2244ef2ac94f service nova] Acquiring lock "refresh_cache-474a469d-9ebe-4e91-9ec4-3f610bdd4d27" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Updating instance_info_cache with network_info: [{"id": "8b4bafcd-1db9-460a-bb53-3e92498fa50c", "address": "fa:16:3e:28:47:a5", "network": {"id": "253a5a85-21b7-42d7-8893-2a97d76e7849", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1666014168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f0d4a6654645f49a5f57d48cc52d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4bafcd-1d", "ovs_interfaceid": "8b4bafcd-1db9-460a-bb53-3e92498fa50c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Releasing lock "refresh_cache-474a469d-9ebe-4e91-9ec4-3f610bdd4d27" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Instance network_info: |[{"id": "8b4bafcd-1db9-460a-bb53-3e92498fa50c", "address": "fa:16:3e:28:47:a5", "network": {"id": "253a5a85-21b7-42d7-8893-2a97d76e7849", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1666014168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f0d4a6654645f49a5f57d48cc52d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4bafcd-1d", "ovs_interfaceid": "8b4bafcd-1db9-460a-bb53-3e92498fa50c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fceb3191-a616-4218-973e-8396b0639a3d req-e8364d18-5e4a-42bb-8caf-2244ef2ac94f service nova] Acquired lock "refresh_cache-474a469d-9ebe-4e91-9ec4-3f610bdd4d27" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.network.neutron [req-fceb3191-a616-4218-973e-8396b0639a3d req-e8364d18-5e4a-42bb-8caf-2244ef2ac94f service nova] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Refreshing network info cache for port 8b4bafcd-1db9-460a-bb53-3e92498fa50c {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Start _get_guest_xml network_info=[{"id": "8b4bafcd-1db9-460a-bb53-3e92498fa50c", "address": "fa:16:3e:28:47:a5", "network": {"id": "253a5a85-21b7-42d7-8893-2a97d76e7849", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1666014168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f0d4a6654645f49a5f57d48cc52d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4bafcd-1d", "ovs_interfaceid": "8b4bafcd-1db9-460a-bb53-3e92498fa50c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:03:46 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:03:46 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:03:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-832865533',display_name='tempest-TestVolumeSwap-server-832865533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-832865533',id=15,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNPMXlQY1G7ZNE0JYuewp1SXrE3SrH0Iv7QgrLPcx5q/50+8l9jbD9mx7dXbPyKGsS94r93jf40zH/ASI95F9odWDJoNLXWkYZk9XXn2X3ksAnOAED64uX0oLkBjfwW5A==',key_name='tempest-keypair-1676175423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11f0d4a6654645f49a5f57d48cc52d2e',ramdisk_id='',reservation_id='r-1bzqfumt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1425883188',owner_user_name='tempest-TestVolumeSwap-1425883188-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:03:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1bcce35856143b0bbd89aaaeb520954',uuid=474a469d-9ebe-4e91-9ec4-3f610bdd4d27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b4bafcd-1db9-460a-bb53-3e92498fa50c", "address": "fa:16:3e:28:47:a5", "network": {"id": "253a5a85-21b7-42d7-8893-2a97d76e7849", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1666014168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f0d4a6654645f49a5f57d48cc52d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4bafcd-1d", "ovs_interfaceid": "8b4bafcd-1db9-460a-bb53-3e92498fa50c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Converting VIF {"id": "8b4bafcd-1db9-460a-bb53-3e92498fa50c", "address": "fa:16:3e:28:47:a5", "network": {"id": "253a5a85-21b7-42d7-8893-2a97d76e7849", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1666014168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f0d4a6654645f49a5f57d48cc52d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4bafcd-1d", "ovs_interfaceid": "8b4bafcd-1db9-460a-bb53-3e92498fa50c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:47:a5,bridge_name='br-int',has_traffic_filtering=True,id=8b4bafcd-1db9-460a-bb53-3e92498fa50c,network=Network(253a5a85-21b7-42d7-8893-2a97d76e7849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4bafcd-1d') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.objects.instance [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lazy-loading 'pci_devices' on Instance uuid 474a469d-9ebe-4e91-9ec4-3f610bdd4d27 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:03:46 user nova-compute[74898]:   <uuid>474a469d-9ebe-4e91-9ec4-3f610bdd4d27</uuid>
Nov 17 03:03:46 user nova-compute[74898]:   <name>instance-0000000f</name>
Nov 17 03:03:46 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:03:46 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:03:46 user nova-compute[74898]:   <metadata>
Nov 17 03:03:46 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:03:46 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:03:46 user nova-compute[74898]:       <nova:name>tempest-TestVolumeSwap-server-832865533</nova:name>
Nov 17 03:03:46 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:03:46</nova:creationTime>
Nov 17 03:03:46 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:03:46 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:03:46 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:03:46 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:03:46 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:03:46 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:03:46 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:03:46 user nova-compute[74898]:       <nova:owner>
Nov 17 03:03:46 user nova-compute[74898]:         <nova:user uuid="f1bcce35856143b0bbd89aaaeb520954">tempest-TestVolumeSwap-1425883188-project-member</nova:user>
Nov 17 03:03:46 user nova-compute[74898]:         <nova:project uuid="11f0d4a6654645f49a5f57d48cc52d2e">tempest-TestVolumeSwap-1425883188</nova:project>
Nov 17 03:03:46 user nova-compute[74898]:       </nova:owner>
Nov 17 03:03:46 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:03:46 user nova-compute[74898]:       <nova:ports>
Nov 17 03:03:46 user nova-compute[74898]:         <nova:port uuid="8b4bafcd-1db9-460a-bb53-3e92498fa50c">
Nov 17 03:03:46 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 17 03:03:46 user nova-compute[74898]:         </nova:port>
Nov 17 03:03:46 user nova-compute[74898]:       </nova:ports>
Nov 17 03:03:46 user nova-compute[74898]:     </nova:instance>
Nov 17 03:03:46 user nova-compute[74898]:   </metadata>
Nov 17 03:03:46 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:03:46 user nova-compute[74898]:     <system>
Nov 17 03:03:46 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:03:46 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:03:46 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:03:46 user nova-compute[74898]:       <entry name="serial">474a469d-9ebe-4e91-9ec4-3f610bdd4d27</entry>
Nov 17 03:03:46 user nova-compute[74898]:       <entry name="uuid">474a469d-9ebe-4e91-9ec4-3f610bdd4d27</entry>
Nov 17 03:03:46 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:03:46 user nova-compute[74898]:     </system>
Nov 17 03:03:46 user nova-compute[74898]:   </sysinfo>
Nov 17 03:03:46 user nova-compute[74898]:   <os>
Nov 17 03:03:46 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:03:46 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:03:46 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:03:46 user nova-compute[74898]:   </os>
Nov 17 03:03:46 user nova-compute[74898]:   <features>
Nov 17 03:03:46 user nova-compute[74898]:     <acpi/>
Nov 17 03:03:46 user nova-compute[74898]:     <apic/>
Nov 17 03:03:46 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:03:46 user nova-compute[74898]:   </features>
Nov 17 03:03:46 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:03:46 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:03:46 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:03:46 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:03:46 user nova-compute[74898]:   </clock>
Nov 17 03:03:46 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:03:46 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:03:46 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:03:46 user nova-compute[74898]:   </cpu>
Nov 17 03:03:46 user nova-compute[74898]:   <devices>
Nov 17 03:03:46 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:03:46 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:03:46 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/474a469d-9ebe-4e91-9ec4-3f610bdd4d27/disk"/>
Nov 17 03:03:46 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:03:46 user nova-compute[74898]:     </disk>
Nov 17 03:03:46 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:03:46 user nova-compute[74898]:       <mac address="fa:16:3e:28:47:a5"/>
Nov 17 03:03:46 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:03:46 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:03:46 user nova-compute[74898]:       <target dev="tap8b4bafcd-1d"/>
Nov 17 03:03:46 user nova-compute[74898]:     </interface>
Nov 17 03:03:46 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:03:46 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/474a469d-9ebe-4e91-9ec4-3f610bdd4d27/console.log" append="off"/>
Nov 17 03:03:46 user nova-compute[74898]:     </serial>
Nov 17 03:03:46 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:03:46 user nova-compute[74898]:     <video>
Nov 17 03:03:46 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:03:46 user nova-compute[74898]:     </video>
Nov 17 03:03:46 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:03:46 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:03:46 user nova-compute[74898]:     </rng>
Nov 17 03:03:46 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:03:46 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:03:46 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:03:46 user nova-compute[74898]:     </memballoon>
Nov 17 03:03:46 user nova-compute[74898]:   </devices>
Nov 17 03:03:46 user nova-compute[74898]: </domain>
Nov 17 03:03:46 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:03:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-832865533',display_name='tempest-TestVolumeSwap-server-832865533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-832865533',id=15,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNPMXlQY1G7ZNE0JYuewp1SXrE3SrH0Iv7QgrLPcx5q/50+8l9jbD9mx7dXbPyKGsS94r93jf40zH/ASI95F9odWDJoNLXWkYZk9XXn2X3ksAnOAED64uX0oLkBjfwW5A==',key_name='tempest-keypair-1676175423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11f0d4a6654645f49a5f57d48cc52d2e',ramdisk_id='',reservation_id='r-1bzqfumt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1425883188',owner_user_name='tempest-TestVolumeSwap-1425883188-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:03:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1bcce35856143b0bbd89aaaeb520954',uuid=474a469d-9ebe-4e91-9ec4-3f610bdd4d27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b4bafcd-1db9-460a-bb53-3e92498fa50c", "address": "fa:16:3e:28:47:a5", "network": {"id": "253a5a85-21b7-42d7-8893-2a97d76e7849", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1666014168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f0d4a6654645f49a5f57d48cc52d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4bafcd-1d", "ovs_interfaceid": "8b4bafcd-1db9-460a-bb53-3e92498fa50c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Converting VIF {"id": "8b4bafcd-1db9-460a-bb53-3e92498fa50c", "address": "fa:16:3e:28:47:a5", "network": {"id": "253a5a85-21b7-42d7-8893-2a97d76e7849", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1666014168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f0d4a6654645f49a5f57d48cc52d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4bafcd-1d", "ovs_interfaceid": "8b4bafcd-1db9-460a-bb53-3e92498fa50c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:47:a5,bridge_name='br-int',has_traffic_filtering=True,id=8b4bafcd-1db9-460a-bb53-3e92498fa50c,network=Network(253a5a85-21b7-42d7-8893-2a97d76e7849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4bafcd-1d') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG os_vif [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:47:a5,bridge_name='br-int',has_traffic_filtering=True,id=8b4bafcd-1db9-460a-bb53-3e92498fa50c,network=Network(253a5a85-21b7-42d7-8893-2a97d76e7849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4bafcd-1d') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f1c8845f-de36-5534-a1df-017040978e3c', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b4bafcd-1d, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b4bafcd-1d, col_values=(('qos', UUID('446c49b2-04b9-47d6-ad67-fa63b9f77269')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b4bafcd-1d, col_values=(('external_ids', {'iface-id': '8b4bafcd-1db9-460a-bb53-3e92498fa50c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:47:a5', 'vm-uuid': '474a469d-9ebe-4e91-9ec4-3f610bdd4d27'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:46 user nova-compute[74898]: INFO os_vif [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:47:a5,bridge_name='br-int',has_traffic_filtering=True,id=8b4bafcd-1db9-460a-bb53-3e92498fa50c,network=Network(253a5a85-21b7-42d7-8893-2a97d76e7849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4bafcd-1d')
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:03:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] No VIF found with MAC fa:16:3e:28:47:a5, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:03:47 user nova-compute[74898]: DEBUG nova.network.neutron [req-fceb3191-a616-4218-973e-8396b0639a3d req-e8364d18-5e4a-42bb-8caf-2244ef2ac94f service nova] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Updated VIF entry in instance network info cache for port 8b4bafcd-1db9-460a-bb53-3e92498fa50c. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:03:47 user nova-compute[74898]: DEBUG nova.network.neutron [req-fceb3191-a616-4218-973e-8396b0639a3d req-e8364d18-5e4a-42bb-8caf-2244ef2ac94f service nova] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Updating instance_info_cache with network_info: [{"id": "8b4bafcd-1db9-460a-bb53-3e92498fa50c", "address": "fa:16:3e:28:47:a5", "network": {"id": "253a5a85-21b7-42d7-8893-2a97d76e7849", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1666014168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f0d4a6654645f49a5f57d48cc52d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4bafcd-1d", "ovs_interfaceid": "8b4bafcd-1db9-460a-bb53-3e92498fa50c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:03:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fceb3191-a616-4218-973e-8396b0639a3d req-e8364d18-5e4a-42bb-8caf-2244ef2ac94f service nova] Releasing lock "refresh_cache-474a469d-9ebe-4e91-9ec4-3f610bdd4d27" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:03:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "42994e39-187a-4fb6-a293-24a4eb57177b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "42994e39-187a-4fb6-a293-24a4eb57177b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:47 user nova-compute[74898]: DEBUG nova.compute.manager [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:03:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:47 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:03:47 user nova-compute[74898]: INFO nova.compute.claims [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Claim successful on node user
Nov 17 03:03:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:48 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:03:48 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:03:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.562s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:48 user nova-compute[74898]: DEBUG nova.compute.manager [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:03:48 user nova-compute[74898]: DEBUG nova.compute.manager [req-3e524c1a-3135-4728-ae42-29dcc9114543 req-6c342009-3322-4ba5-8e59-74c6bfe69d9d service nova] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Received event network-vif-plugged-8b4bafcd-1db9-460a-bb53-3e92498fa50c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:03:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3e524c1a-3135-4728-ae42-29dcc9114543 req-6c342009-3322-4ba5-8e59-74c6bfe69d9d service nova] Acquiring lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3e524c1a-3135-4728-ae42-29dcc9114543 req-6c342009-3322-4ba5-8e59-74c6bfe69d9d service nova] Lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3e524c1a-3135-4728-ae42-29dcc9114543 req-6c342009-3322-4ba5-8e59-74c6bfe69d9d service nova] Lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:48 user nova-compute[74898]: DEBUG nova.compute.manager [req-3e524c1a-3135-4728-ae42-29dcc9114543 req-6c342009-3322-4ba5-8e59-74c6bfe69d9d service nova] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] No waiting events found dispatching network-vif-plugged-8b4bafcd-1db9-460a-bb53-3e92498fa50c {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:03:48 user nova-compute[74898]: WARNING nova.compute.manager [req-3e524c1a-3135-4728-ae42-29dcc9114543 req-6c342009-3322-4ba5-8e59-74c6bfe69d9d service nova] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Received unexpected event network-vif-plugged-8b4bafcd-1db9-460a-bb53-3e92498fa50c for instance with vm_state building and task_state spawning.
Nov 17 03:03:48 user nova-compute[74898]: DEBUG nova.compute.manager [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:03:48 user nova-compute[74898]: DEBUG nova.network.neutron [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:03:48 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:03:48 user nova-compute[74898]: DEBUG nova.compute.manager [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:03:48 user nova-compute[74898]: DEBUG nova.policy [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '28445b2b2360414bac2607ec94166369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff82629b7d7486a86574994974fabda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:03:48 user nova-compute[74898]: DEBUG nova.compute.manager [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:03:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:03:48 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Creating image(s)
Nov 17 03:03:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "/opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "/opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "/opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.209s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.191s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk 1073741824" returned: 0 in 0.049s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.193s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:49 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:03:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:03:49 user nova-compute[74898]: DEBUG nova.network.neutron [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Successfully created port: 92a5885a-8cb1-43f8-906a-97d7fa08eb62 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:03:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:03:49 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Cannot resize image /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:03:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:03:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Ensure instance console log exists: /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:03:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:50 user nova-compute[74898]: DEBUG nova.compute.manager [req-b4406525-bb8b-4c71-8dc4-3d25528dd665 req-bb5e2227-4df9-4b03-a31f-23b84eafdbf4 service nova] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Received event network-vif-plugged-8b4bafcd-1db9-460a-bb53-3e92498fa50c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:03:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b4406525-bb8b-4c71-8dc4-3d25528dd665 req-bb5e2227-4df9-4b03-a31f-23b84eafdbf4 service nova] Acquiring lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b4406525-bb8b-4c71-8dc4-3d25528dd665 req-bb5e2227-4df9-4b03-a31f-23b84eafdbf4 service nova] Lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b4406525-bb8b-4c71-8dc4-3d25528dd665 req-bb5e2227-4df9-4b03-a31f-23b84eafdbf4 service nova] Lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:50 user nova-compute[74898]: DEBUG nova.compute.manager [req-b4406525-bb8b-4c71-8dc4-3d25528dd665 req-bb5e2227-4df9-4b03-a31f-23b84eafdbf4 service nova] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] No waiting events found dispatching network-vif-plugged-8b4bafcd-1db9-460a-bb53-3e92498fa50c {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:03:50 user nova-compute[74898]: WARNING nova.compute.manager [req-b4406525-bb8b-4c71-8dc4-3d25528dd665 req-bb5e2227-4df9-4b03-a31f-23b84eafdbf4 service nova] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Received unexpected event network-vif-plugged-8b4bafcd-1db9-460a-bb53-3e92498fa50c for instance with vm_state building and task_state spawning.
Nov 17 03:03:50 user nova-compute[74898]: DEBUG nova.network.neutron [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Successfully updated port: 92a5885a-8cb1-43f8-906a-97d7fa08eb62 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:03:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "refresh_cache-42994e39-187a-4fb6-a293-24a4eb57177b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:03:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquired lock "refresh_cache-42994e39-187a-4fb6-a293-24a4eb57177b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:03:50 user nova-compute[74898]: DEBUG nova.network.neutron [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:03:50 user nova-compute[74898]: DEBUG nova.compute.manager [req-638041df-e283-4bde-88d3-24bb247b3480 req-2bcc301f-f23c-4c06-b79f-2b0e5cebc1bc service nova] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Received event network-changed-92a5885a-8cb1-43f8-906a-97d7fa08eb62 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:03:50 user nova-compute[74898]: DEBUG nova.compute.manager [req-638041df-e283-4bde-88d3-24bb247b3480 req-2bcc301f-f23c-4c06-b79f-2b0e5cebc1bc service nova] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Refreshing instance network info cache due to event network-changed-92a5885a-8cb1-43f8-906a-97d7fa08eb62. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:03:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-638041df-e283-4bde-88d3-24bb247b3480 req-2bcc301f-f23c-4c06-b79f-2b0e5cebc1bc service nova] Acquiring lock "refresh_cache-42994e39-187a-4fb6-a293-24a4eb57177b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:03:50 user nova-compute[74898]: DEBUG nova.network.neutron [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:03:50 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:03:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:03:50 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Instance spawned successfully.
Nov 17 03:03:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:03:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:03:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:03:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:03:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:03:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:03:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:03:50 user nova-compute[74898]: INFO nova.compute.manager [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Took 7.30 seconds to spawn the instance on the hypervisor.
Nov 17 03:03:50 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.network.neutron [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Updating instance_info_cache with network_info: [{"id": "92a5885a-8cb1-43f8-906a-97d7fa08eb62", "address": "fa:16:3e:ab:28:fe", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a5885a-8c", "ovs_interfaceid": "92a5885a-8cb1-43f8-906a-97d7fa08eb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Releasing lock "refresh_cache-42994e39-187a-4fb6-a293-24a4eb57177b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.compute.manager [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Instance network_info: |[{"id": "92a5885a-8cb1-43f8-906a-97d7fa08eb62", "address": "fa:16:3e:ab:28:fe", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a5885a-8c", "ovs_interfaceid": "92a5885a-8cb1-43f8-906a-97d7fa08eb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-638041df-e283-4bde-88d3-24bb247b3480 req-2bcc301f-f23c-4c06-b79f-2b0e5cebc1bc service nova] Acquired lock "refresh_cache-42994e39-187a-4fb6-a293-24a4eb57177b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.network.neutron [req-638041df-e283-4bde-88d3-24bb247b3480 req-2bcc301f-f23c-4c06-b79f-2b0e5cebc1bc service nova] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Refreshing network info cache for port 92a5885a-8cb1-43f8-906a-97d7fa08eb62 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Start _get_guest_xml network_info=[{"id": "92a5885a-8cb1-43f8-906a-97d7fa08eb62", "address": "fa:16:3e:ab:28:fe", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a5885a-8c", "ovs_interfaceid": "92a5885a-8cb1-43f8-906a-97d7fa08eb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:03:51 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:03:51 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:03:51 user nova-compute[74898]: INFO nova.compute.manager [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Took 8.28 seconds to build instance.
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:03:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1688090851',display_name='tempest-ServerActionsTestOtherA-server-1688090851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1688090851',id=16,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGXK5tLG9vQRvq8SJwGRy2Vz7FVpdMueKXoroRQhoaTXP+S/vHTHRNXWHjGdbL7ZfWa7nQ7EpuIvdSjNY8pD+Io25QXwMjrtjgT3+jZPylEXHxX7Pj0OQhFvC17oY0/CA==',key_name='tempest-keypair-1226860529',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ff82629b7d7486a86574994974fabda',ramdisk_id='',reservation_id='r-dvxy70tq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-214359699',owner_user_name='tempest-ServerActionsTestOtherA-214359699-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:03:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28445b2b2360414bac2607ec94166369',uuid=42994e39-187a-4fb6-a293-24a4eb57177b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92a5885a-8cb1-43f8-906a-97d7fa08eb62", "address": "fa:16:3e:ab:28:fe", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a5885a-8c", "ovs_interfaceid": "92a5885a-8cb1-43f8-906a-97d7fa08eb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Converting VIF {"id": "92a5885a-8cb1-43f8-906a-97d7fa08eb62", "address": "fa:16:3e:ab:28:fe", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a5885a-8c", "ovs_interfaceid": "92a5885a-8cb1-43f8-906a-97d7fa08eb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:28:fe,bridge_name='br-int',has_traffic_filtering=True,id=92a5885a-8cb1-43f8-906a-97d7fa08eb62,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92a5885a-8c') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.objects.instance [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lazy-loading 'pci_devices' on Instance uuid 42994e39-187a-4fb6-a293-24a4eb57177b {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e20bec0e-8edc-4edf-ad7f-f731d0c5a6f8 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.411s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:03:51 user nova-compute[74898]:   <uuid>42994e39-187a-4fb6-a293-24a4eb57177b</uuid>
Nov 17 03:03:51 user nova-compute[74898]:   <name>instance-00000010</name>
Nov 17 03:03:51 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:03:51 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:03:51 user nova-compute[74898]:   <metadata>
Nov 17 03:03:51 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:03:51 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:03:51 user nova-compute[74898]:       <nova:name>tempest-ServerActionsTestOtherA-server-1688090851</nova:name>
Nov 17 03:03:51 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:03:51</nova:creationTime>
Nov 17 03:03:51 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:03:51 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:03:51 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:03:51 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:03:51 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:03:51 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:03:51 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:03:51 user nova-compute[74898]:       <nova:owner>
Nov 17 03:03:51 user nova-compute[74898]:         <nova:user uuid="28445b2b2360414bac2607ec94166369">tempest-ServerActionsTestOtherA-214359699-project-member</nova:user>
Nov 17 03:03:51 user nova-compute[74898]:         <nova:project uuid="4ff82629b7d7486a86574994974fabda">tempest-ServerActionsTestOtherA-214359699</nova:project>
Nov 17 03:03:51 user nova-compute[74898]:       </nova:owner>
Nov 17 03:03:51 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:03:51 user nova-compute[74898]:       <nova:ports>
Nov 17 03:03:51 user nova-compute[74898]:         <nova:port uuid="92a5885a-8cb1-43f8-906a-97d7fa08eb62">
Nov 17 03:03:51 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 17 03:03:51 user nova-compute[74898]:         </nova:port>
Nov 17 03:03:51 user nova-compute[74898]:       </nova:ports>
Nov 17 03:03:51 user nova-compute[74898]:     </nova:instance>
Nov 17 03:03:51 user nova-compute[74898]:   </metadata>
Nov 17 03:03:51 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:03:51 user nova-compute[74898]:     <system>
Nov 17 03:03:51 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:03:51 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:03:51 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:03:51 user nova-compute[74898]:       <entry name="serial">42994e39-187a-4fb6-a293-24a4eb57177b</entry>
Nov 17 03:03:51 user nova-compute[74898]:       <entry name="uuid">42994e39-187a-4fb6-a293-24a4eb57177b</entry>
Nov 17 03:03:51 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:03:51 user nova-compute[74898]:     </system>
Nov 17 03:03:51 user nova-compute[74898]:   </sysinfo>
Nov 17 03:03:51 user nova-compute[74898]:   <os>
Nov 17 03:03:51 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:03:51 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:03:51 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:03:51 user nova-compute[74898]:   </os>
Nov 17 03:03:51 user nova-compute[74898]:   <features>
Nov 17 03:03:51 user nova-compute[74898]:     <acpi/>
Nov 17 03:03:51 user nova-compute[74898]:     <apic/>
Nov 17 03:03:51 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:03:51 user nova-compute[74898]:   </features>
Nov 17 03:03:51 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:03:51 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:03:51 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:03:51 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:03:51 user nova-compute[74898]:   </clock>
Nov 17 03:03:51 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:03:51 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:03:51 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:03:51 user nova-compute[74898]:   </cpu>
Nov 17 03:03:51 user nova-compute[74898]:   <devices>
Nov 17 03:03:51 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:03:51 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:03:51 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk"/>
Nov 17 03:03:51 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:03:51 user nova-compute[74898]:     </disk>
Nov 17 03:03:51 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:03:51 user nova-compute[74898]:       <mac address="fa:16:3e:ab:28:fe"/>
Nov 17 03:03:51 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:03:51 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:03:51 user nova-compute[74898]:       <target dev="tap92a5885a-8c"/>
Nov 17 03:03:51 user nova-compute[74898]:     </interface>
Nov 17 03:03:51 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:03:51 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/console.log" append="off"/>
Nov 17 03:03:51 user nova-compute[74898]:     </serial>
Nov 17 03:03:51 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:03:51 user nova-compute[74898]:     <video>
Nov 17 03:03:51 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:03:51 user nova-compute[74898]:     </video>
Nov 17 03:03:51 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:03:51 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:03:51 user nova-compute[74898]:     </rng>
Nov 17 03:03:51 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:03:51 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:03:51 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:03:51 user nova-compute[74898]:     </memballoon>
Nov 17 03:03:51 user nova-compute[74898]:   </devices>
Nov 17 03:03:51 user nova-compute[74898]: </domain>
Nov 17 03:03:51 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:03:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1688090851',display_name='tempest-ServerActionsTestOtherA-server-1688090851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1688090851',id=16,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGXK5tLG9vQRvq8SJwGRy2Vz7FVpdMueKXoroRQhoaTXP+S/vHTHRNXWHjGdbL7ZfWa7nQ7EpuIvdSjNY8pD+Io25QXwMjrtjgT3+jZPylEXHxX7Pj0OQhFvC17oY0/CA==',key_name='tempest-keypair-1226860529',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ff82629b7d7486a86574994974fabda',ramdisk_id='',reservation_id='r-dvxy70tq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-214359699',owner_user_name='tempest-ServerActionsTestOtherA-214359699-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:03:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28445b2b2360414bac2607ec94166369',uuid=42994e39-187a-4fb6-a293-24a4eb57177b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92a5885a-8cb1-43f8-906a-97d7fa08eb62", "address": "fa:16:3e:ab:28:fe", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a5885a-8c", "ovs_interfaceid": "92a5885a-8cb1-43f8-906a-97d7fa08eb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Converting VIF {"id": "92a5885a-8cb1-43f8-906a-97d7fa08eb62", "address": "fa:16:3e:ab:28:fe", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a5885a-8c", "ovs_interfaceid": "92a5885a-8cb1-43f8-906a-97d7fa08eb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:28:fe,bridge_name='br-int',has_traffic_filtering=True,id=92a5885a-8cb1-43f8-906a-97d7fa08eb62,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92a5885a-8c') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG os_vif [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:28:fe,bridge_name='br-int',has_traffic_filtering=True,id=92a5885a-8cb1-43f8-906a-97d7fa08eb62,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92a5885a-8c') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6c425f4d-1fcd-51f8-ae2f-dec82db96123', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92a5885a-8c, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92a5885a-8c, col_values=(('qos', UUID('8f69eea3-1e39-4924-87a1-15447e9a9a71')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92a5885a-8c, col_values=(('external_ids', {'iface-id': '92a5885a-8cb1-43f8-906a-97d7fa08eb62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:28:fe', 'vm-uuid': '42994e39-187a-4fb6-a293-24a4eb57177b'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:51 user nova-compute[74898]: INFO os_vif [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:28:fe,bridge_name='br-int',has_traffic_filtering=True,id=92a5885a-8cb1-43f8-906a-97d7fa08eb62,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92a5885a-8c')
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] No VIF found with MAC fa:16:3e:ab:28:fe, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.network.neutron [req-638041df-e283-4bde-88d3-24bb247b3480 req-2bcc301f-f23c-4c06-b79f-2b0e5cebc1bc service nova] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Updated VIF entry in instance network info cache for port 92a5885a-8cb1-43f8-906a-97d7fa08eb62. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG nova.network.neutron [req-638041df-e283-4bde-88d3-24bb247b3480 req-2bcc301f-f23c-4c06-b79f-2b0e5cebc1bc service nova] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Updating instance_info_cache with network_info: [{"id": "92a5885a-8cb1-43f8-906a-97d7fa08eb62", "address": "fa:16:3e:ab:28:fe", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a5885a-8c", "ovs_interfaceid": "92a5885a-8cb1-43f8-906a-97d7fa08eb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:03:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-638041df-e283-4bde-88d3-24bb247b3480 req-2bcc301f-f23c-4c06-b79f-2b0e5cebc1bc service nova] Releasing lock "refresh_cache-42994e39-187a-4fb6-a293-24a4eb57177b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:03:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:53 user nova-compute[74898]: DEBUG nova.compute.manager [req-3797d0f6-965a-482f-8a5d-8890a8f385e5 req-18a1a391-1c28-4495-8ff9-2fb5d0f790dc service nova] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Received event network-vif-plugged-92a5885a-8cb1-43f8-906a-97d7fa08eb62 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:03:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3797d0f6-965a-482f-8a5d-8890a8f385e5 req-18a1a391-1c28-4495-8ff9-2fb5d0f790dc service nova] Acquiring lock "42994e39-187a-4fb6-a293-24a4eb57177b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3797d0f6-965a-482f-8a5d-8890a8f385e5 req-18a1a391-1c28-4495-8ff9-2fb5d0f790dc service nova] Lock "42994e39-187a-4fb6-a293-24a4eb57177b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3797d0f6-965a-482f-8a5d-8890a8f385e5 req-18a1a391-1c28-4495-8ff9-2fb5d0f790dc service nova] Lock "42994e39-187a-4fb6-a293-24a4eb57177b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:53 user nova-compute[74898]: DEBUG nova.compute.manager [req-3797d0f6-965a-482f-8a5d-8890a8f385e5 req-18a1a391-1c28-4495-8ff9-2fb5d0f790dc service nova] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] No waiting events found dispatching network-vif-plugged-92a5885a-8cb1-43f8-906a-97d7fa08eb62 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:03:53 user nova-compute[74898]: WARNING nova.compute.manager [req-3797d0f6-965a-482f-8a5d-8890a8f385e5 req-18a1a391-1c28-4495-8ff9-2fb5d0f790dc service nova] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Received unexpected event network-vif-plugged-92a5885a-8cb1-43f8-906a-97d7fa08eb62 for instance with vm_state building and task_state spawning.
Nov 17 03:03:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:55 user nova-compute[74898]: DEBUG nova.compute.manager [req-e7353d42-b0a5-4fec-99ac-1680b2e0907d req-ad554ac2-1868-4481-99cc-f3254b08619c service nova] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Received event network-vif-plugged-92a5885a-8cb1-43f8-906a-97d7fa08eb62 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:03:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e7353d42-b0a5-4fec-99ac-1680b2e0907d req-ad554ac2-1868-4481-99cc-f3254b08619c service nova] Acquiring lock "42994e39-187a-4fb6-a293-24a4eb57177b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:03:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e7353d42-b0a5-4fec-99ac-1680b2e0907d req-ad554ac2-1868-4481-99cc-f3254b08619c service nova] Lock "42994e39-187a-4fb6-a293-24a4eb57177b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:03:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e7353d42-b0a5-4fec-99ac-1680b2e0907d req-ad554ac2-1868-4481-99cc-f3254b08619c service nova] Lock "42994e39-187a-4fb6-a293-24a4eb57177b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:55 user nova-compute[74898]: DEBUG nova.compute.manager [req-e7353d42-b0a5-4fec-99ac-1680b2e0907d req-ad554ac2-1868-4481-99cc-f3254b08619c service nova] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] No waiting events found dispatching network-vif-plugged-92a5885a-8cb1-43f8-906a-97d7fa08eb62 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:03:55 user nova-compute[74898]: WARNING nova.compute.manager [req-e7353d42-b0a5-4fec-99ac-1680b2e0907d req-ad554ac2-1868-4481-99cc-f3254b08619c service nova] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Received unexpected event network-vif-plugged-92a5885a-8cb1-43f8-906a-97d7fa08eb62 for instance with vm_state building and task_state spawning.
Nov 17 03:03:55 user nova-compute[74898]: DEBUG nova.compute.manager [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:03:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:03:55 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Instance spawned successfully.
Nov 17 03:03:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:03:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:03:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:03:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:03:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:03:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:03:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:03:55 user nova-compute[74898]: INFO nova.compute.manager [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Took 6.56 seconds to spawn the instance on the hypervisor.
Nov 17 03:03:55 user nova-compute[74898]: DEBUG nova.compute.manager [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:03:55 user nova-compute[74898]: INFO nova.compute.manager [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Took 7.63 seconds to build instance.
Nov 17 03:03:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3c773145-9d11-42dc-b30d-acd6a92ed355 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "42994e39-187a-4fb6-a293-24a4eb57177b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.730s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:03:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:03:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:00 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4b869a55-acf6-4550-9354-2480273a4ee2 is timed out.
Nov 17 03:04:00 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Successfully detached device vdb from instance 4b869a55-acf6-4550-9354-2480273a4ee2 from the live domain config.
Nov 17 03:04:00 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Myjovkqc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:04:00 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:04:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15b7431-1ff8-4d9b-8291-c3ba8d79fb12]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:04:00 user nova-compute[74898]: No targets found.
Nov 17 03:04:00 user nova-compute[74898]: iSNS:
Nov 17 03:04:00 user nova-compute[74898]: No targets found.
Nov 17 03:04:00 user nova-compute[74898]: STATIC:
Nov 17 03:04:00 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45
Nov 17 03:04:00 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:04:00 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:04:00 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0
Nov 17 03:04:00 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:04:00 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:04:00 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4
Nov 17 03:04:00 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:04:00 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:04:00 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8
Nov 17 03:04:00 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:04:00 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:04:00 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019
Nov 17 03:04:00 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:04:00 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:04:00 user nova-compute[74898]: FIRMWARE:
Nov 17 03:04:00 user nova-compute[74898]: No targets found.
Nov 17 03:04:00 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:04:00 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:04:00 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ad0f46-0211-421a-8fb7-20df49ac5711]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1c9e63-d170-4472-9940-1969b7ee6519]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:04:00 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:04:00 user nova-compute[74898]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:04:00 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:04:00 user nova-compute[74898]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:04:00 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:04:00 user nova-compute[74898]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 (non-flash)
Nov 17 03:04:00 user nova-compute[74898]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:04:00 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:04:00 user nova-compute[74898]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:04:00 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf86db640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019'): ({'sdc'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Removing single pathed devices sdc {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c23574-87b8-47f6-85cf-2f2181ce867c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e41e163-2182-42f3-9810-4a136615f4bf]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Flushing IO for device /dev/sdc {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[52df7ea3-dea3-42d2-ae04-20b13bb51a5e]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b7ffda-9ead-4dd8-9f70-5828b523dcc6]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] SCSI volumes sdc have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[88faacc7-7c58-4ef3-b6ea-fa0bbc92dd72]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c154071f-ef72-478b-827f-6aa27f085431]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019, portal: 172.16.0.220,3260]
Nov 17 03:04:00 user nova-compute[74898]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019, portal: 172.16.0.220,3260] successful.
Nov 17 03:04:00 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:04:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:01 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a634de04-148d-4da4-816d-617343087019 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:01 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b379e30-bf70-4621-ae06-b90e1439be4f]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:01 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:04:01 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:04:01 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] <== disconnect_volume: return (387ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:04:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:04:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:01 user nova-compute[74898]: DEBUG nova.objects.instance [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lazy-loading 'flavor' on Instance uuid 4b869a55-acf6-4550-9354-2480273a4ee2 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:04:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8191c0bf-8ff7-4c7c-8331-2bbab2188686 tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "4b869a55-acf6-4550-9354-2480273a4ee2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.901s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:06 user nova-compute[74898]: INFO nova.compute.manager [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Rescuing
Nov 17 03:04:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "refresh_cache-5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:04:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquired lock "refresh_cache-5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:04:06 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:04:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "dbaabab0-92f0-480d-8f81-0db980c8f333" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "dbaabab0-92f0-480d-8f81-0db980c8f333" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:06 user nova-compute[74898]: DEBUG nova.compute.manager [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Updating instance_info_cache with network_info: [{"id": "78bdfbfa-3578-4ef5-b499-decd609cba62", "address": "fa:16:3e:b1:55:61", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78bdfbfa-35", "ovs_interfaceid": "78bdfbfa-3578-4ef5-b499-decd609cba62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Releasing lock "refresh_cache-5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:04:07 user nova-compute[74898]: INFO nova.compute.claims [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Claim successful on node user
Nov 17 03:04:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG nova.compute.manager [req-cd2bf5d0-f01d-473e-9e26-bc75cba64244 req-07babc89-5cee-4056-8bd2-265f194e5660 service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received event network-vif-unplugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-cd2bf5d0-f01d-473e-9e26-bc75cba64244 req-07babc89-5cee-4056-8bd2-265f194e5660 service nova] Acquiring lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-cd2bf5d0-f01d-473e-9e26-bc75cba64244 req-07babc89-5cee-4056-8bd2-265f194e5660 service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-cd2bf5d0-f01d-473e-9e26-bc75cba64244 req-07babc89-5cee-4056-8bd2-265f194e5660 service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG nova.compute.manager [req-cd2bf5d0-f01d-473e-9e26-bc75cba64244 req-07babc89-5cee-4056-8bd2-265f194e5660 service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] No waiting events found dispatching network-vif-unplugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:04:07 user nova-compute[74898]: WARNING nova.compute.manager [req-cd2bf5d0-f01d-473e-9e26-bc75cba64244 req-07babc89-5cee-4056-8bd2-265f194e5660 service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received unexpected event network-vif-unplugged-78bdfbfa-3578-4ef5-b499-decd609cba62 for instance with vm_state active and task_state rescuing.
Nov 17 03:04:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.517s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG nova.compute.manager [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG nova.compute.manager [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG nova.network.neutron [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:07 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:04:07 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Instance destroyed successfully.
Nov 17 03:04:07 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Attempting rescue
Nov 17 03:04:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74898) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG nova.compute.manager [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Instance directory exists: not creating {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 17 03:04:07 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Creating image(s)
Nov 17 03:04:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "/opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "/opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG nova.objects.instance [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG nova.policy [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '926d8bd27eb24824a71cb9f1969f9c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de7d05d475c49f0805f5aab5853a0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:04:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.compute.manager [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:04:08 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Creating image(s)
Nov 17 03:04:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "/opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "/opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "/opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.215s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk.rescue {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk.rescue" returned: 0 in 0.058s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.objects.instance [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lazy-loading 'migration_context' on Instance uuid 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.objects.base [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Object Instance<5b5d13c5-5d82-440a-9346-6a4c9ee63bfb> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Start _get_guest_xml network_info=[{"id": "78bdfbfa-3578-4ef5-b499-decd609cba62", "address": "fa:16:3e:b1:55:61", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "vif_mac": "fa:16:3e:b1:55:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78bdfbfa-35", "ovs_interfaceid": "78bdfbfa-3578-4ef5-b499-decd609cba62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.objects.instance [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lazy-loading 'resources' on Instance uuid 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.objects.base [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Object Instance<5b5d13c5-5d82-440a-9346-6a4c9ee63bfb> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.objects.instance [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lazy-loading 'numa_topology' on Instance uuid 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.objects.base [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Object Instance<5b5d13c5-5d82-440a-9346-6a4c9ee63bfb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:08 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:04:08 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.objects.instance [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.objects.base [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Object Instance<5b5d13c5-5d82-440a-9346-6a4c9ee63bfb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:59:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-575888772',display_name='tempest-ServerRescueNegativeTestJSON-server-575888772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-575888772',id=2,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T02:59:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9ccd434df9e458f80e5524c5c4c7a1f',ramdisk_id='',reservation_id='r-cyrur8za',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1788589536',owner_user_name='tempest-ServerRescueNegativeTestJSON-1788589536-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T02:59:32Z,user_data=None,user_id='303dca207b5f4da297e8ab1fc41ff466',uuid=5b5d13c5-5d82-440a-9346-6a4c9ee63bfb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78bdfbfa-3578-4ef5-b499-decd609cba62", "address": "fa:16:3e:b1:55:61", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "vif_mac": "fa:16:3e:b1:55:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78bdfbfa-35", "ovs_interfaceid": "78bdfbfa-3578-4ef5-b499-decd609cba62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Converting VIF {"id": "78bdfbfa-3578-4ef5-b499-decd609cba62", "address": "fa:16:3e:b1:55:61", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "vif_mac": "fa:16:3e:b1:55:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78bdfbfa-35", "ovs_interfaceid": "78bdfbfa-3578-4ef5-b499-decd609cba62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:55:61,bridge_name='br-int',has_traffic_filtering=True,id=78bdfbfa-3578-4ef5-b499-decd609cba62,network=Network(c153042b-16a0-4676-b024-f4583be62f74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78bdfbfa-35') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.objects.instance [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.objects.base [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Object Instance<5b5d13c5-5d82-440a-9346-6a4c9ee63bfb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:04:08 user nova-compute[74898]:   <uuid>5b5d13c5-5d82-440a-9346-6a4c9ee63bfb</uuid>
Nov 17 03:04:08 user nova-compute[74898]:   <name>instance-00000002</name>
Nov 17 03:04:08 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:04:08 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:04:08 user nova-compute[74898]:   <metadata>
Nov 17 03:04:08 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:04:08 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:04:08 user nova-compute[74898]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-575888772</nova:name>
Nov 17 03:04:08 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:04:08</nova:creationTime>
Nov 17 03:04:08 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:04:08 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:04:08 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:04:08 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:04:08 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:04:08 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:04:08 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:04:08 user nova-compute[74898]:       <nova:owner>
Nov 17 03:04:08 user nova-compute[74898]:         <nova:user uuid="303dca207b5f4da297e8ab1fc41ff466">tempest-ServerRescueNegativeTestJSON-1788589536-project-member</nova:user>
Nov 17 03:04:08 user nova-compute[74898]:         <nova:project uuid="f9ccd434df9e458f80e5524c5c4c7a1f">tempest-ServerRescueNegativeTestJSON-1788589536</nova:project>
Nov 17 03:04:08 user nova-compute[74898]:       </nova:owner>
Nov 17 03:04:08 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:04:08 user nova-compute[74898]:       <nova:ports>
Nov 17 03:04:08 user nova-compute[74898]:         <nova:port uuid="78bdfbfa-3578-4ef5-b499-decd609cba62">
Nov 17 03:04:08 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 17 03:04:08 user nova-compute[74898]:         </nova:port>
Nov 17 03:04:08 user nova-compute[74898]:       </nova:ports>
Nov 17 03:04:08 user nova-compute[74898]:     </nova:instance>
Nov 17 03:04:08 user nova-compute[74898]:   </metadata>
Nov 17 03:04:08 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:04:08 user nova-compute[74898]:     <system>
Nov 17 03:04:08 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:04:08 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:04:08 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:04:08 user nova-compute[74898]:       <entry name="serial">5b5d13c5-5d82-440a-9346-6a4c9ee63bfb</entry>
Nov 17 03:04:08 user nova-compute[74898]:       <entry name="uuid">5b5d13c5-5d82-440a-9346-6a4c9ee63bfb</entry>
Nov 17 03:04:08 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:04:08 user nova-compute[74898]:     </system>
Nov 17 03:04:08 user nova-compute[74898]:   </sysinfo>
Nov 17 03:04:08 user nova-compute[74898]:   <os>
Nov 17 03:04:08 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:04:08 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:04:08 user nova-compute[74898]:   </os>
Nov 17 03:04:08 user nova-compute[74898]:   <features>
Nov 17 03:04:08 user nova-compute[74898]:     <acpi/>
Nov 17 03:04:08 user nova-compute[74898]:     <apic/>
Nov 17 03:04:08 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:04:08 user nova-compute[74898]:   </features>
Nov 17 03:04:08 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:04:08 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:04:08 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:04:08 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:04:08 user nova-compute[74898]:   </clock>
Nov 17 03:04:08 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:04:08 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:04:08 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:04:08 user nova-compute[74898]:   </cpu>
Nov 17 03:04:08 user nova-compute[74898]:   <devices>
Nov 17 03:04:08 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:04:08 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:04:08 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk.rescue"/>
Nov 17 03:04:08 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:04:08 user nova-compute[74898]:     </disk>
Nov 17 03:04:08 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:04:08 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:04:08 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk"/>
Nov 17 03:04:08 user nova-compute[74898]:       <target dev="vdb" bus="virtio"/>
Nov 17 03:04:08 user nova-compute[74898]:     </disk>
Nov 17 03:04:08 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:04:08 user nova-compute[74898]:       <mac address="fa:16:3e:b1:55:61"/>
Nov 17 03:04:08 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:04:08 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:04:08 user nova-compute[74898]:       <target dev="tap78bdfbfa-35"/>
Nov 17 03:04:08 user nova-compute[74898]:     </interface>
Nov 17 03:04:08 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:04:08 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/console.log" append="off"/>
Nov 17 03:04:08 user nova-compute[74898]:     </serial>
Nov 17 03:04:08 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:04:08 user nova-compute[74898]:     <video>
Nov 17 03:04:08 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:04:08 user nova-compute[74898]:     </video>
Nov 17 03:04:08 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:04:08 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:04:08 user nova-compute[74898]:     </rng>
Nov 17 03:04:08 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:04:08 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:04:08 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:04:08 user nova-compute[74898]:     </memballoon>
Nov 17 03:04:08 user nova-compute[74898]:   </devices>
Nov 17 03:04:08 user nova-compute[74898]: </domain>
Nov 17 03:04:08 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.194s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk 1073741824" returned: 0 in 0.049s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:08 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Instance destroyed successfully.
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] No VIF found with MAC fa:16:3e:b1:55:61, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.190s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.network.neutron [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Successfully created port: 8e38fd27-07cd-40c1-bef7-67d150932e57 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Cannot resize image /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Ensure instance console log exists: /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.network.neutron [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Successfully updated port: 8e38fd27-07cd-40c1-bef7-67d150932e57 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "refresh_cache-dbaabab0-92f0-480d-8f81-0db980c8f333" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquired lock "refresh_cache-dbaabab0-92f0-480d-8f81-0db980c8f333" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.network.neutron [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.compute.manager [req-0761a898-aaea-4854-9c72-aea6bb84f741 req-4fd26f68-460b-4f5e-a229-d74e53ce3c70 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Received event network-changed-8e38fd27-07cd-40c1-bef7-67d150932e57 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.compute.manager [req-0761a898-aaea-4854-9c72-aea6bb84f741 req-4fd26f68-460b-4f5e-a229-d74e53ce3c70 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Refreshing instance network info cache due to event network-changed-8e38fd27-07cd-40c1-bef7-67d150932e57. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0761a898-aaea-4854-9c72-aea6bb84f741 req-4fd26f68-460b-4f5e-a229-d74e53ce3c70 service nova] Acquiring lock "refresh_cache-dbaabab0-92f0-480d-8f81-0db980c8f333" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.network.neutron [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.network.neutron [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Updating instance_info_cache with network_info: [{"id": "8e38fd27-07cd-40c1-bef7-67d150932e57", "address": "fa:16:3e:8b:5d:76", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e38fd27-07", "ovs_interfaceid": "8e38fd27-07cd-40c1-bef7-67d150932e57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.compute.manager [req-098bf08f-c1d2-47b3-8c04-aff022ddb01c req-b0247f07-cd13-44a9-b576-17133eed5d3c service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received event network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-098bf08f-c1d2-47b3-8c04-aff022ddb01c req-b0247f07-cd13-44a9-b576-17133eed5d3c service nova] Acquiring lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-098bf08f-c1d2-47b3-8c04-aff022ddb01c req-b0247f07-cd13-44a9-b576-17133eed5d3c service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-098bf08f-c1d2-47b3-8c04-aff022ddb01c req-b0247f07-cd13-44a9-b576-17133eed5d3c service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.compute.manager [req-098bf08f-c1d2-47b3-8c04-aff022ddb01c req-b0247f07-cd13-44a9-b576-17133eed5d3c service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] No waiting events found dispatching network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:04:09 user nova-compute[74898]: WARNING nova.compute.manager [req-098bf08f-c1d2-47b3-8c04-aff022ddb01c req-b0247f07-cd13-44a9-b576-17133eed5d3c service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received unexpected event network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 for instance with vm_state active and task_state rescuing.
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.compute.manager [req-098bf08f-c1d2-47b3-8c04-aff022ddb01c req-b0247f07-cd13-44a9-b576-17133eed5d3c service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received event network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-098bf08f-c1d2-47b3-8c04-aff022ddb01c req-b0247f07-cd13-44a9-b576-17133eed5d3c service nova] Acquiring lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-098bf08f-c1d2-47b3-8c04-aff022ddb01c req-b0247f07-cd13-44a9-b576-17133eed5d3c service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-098bf08f-c1d2-47b3-8c04-aff022ddb01c req-b0247f07-cd13-44a9-b576-17133eed5d3c service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.compute.manager [req-098bf08f-c1d2-47b3-8c04-aff022ddb01c req-b0247f07-cd13-44a9-b576-17133eed5d3c service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] No waiting events found dispatching network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:04:09 user nova-compute[74898]: WARNING nova.compute.manager [req-098bf08f-c1d2-47b3-8c04-aff022ddb01c req-b0247f07-cd13-44a9-b576-17133eed5d3c service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received unexpected event network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 for instance with vm_state active and task_state rescuing.
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.compute.manager [req-098bf08f-c1d2-47b3-8c04-aff022ddb01c req-b0247f07-cd13-44a9-b576-17133eed5d3c service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received event network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-098bf08f-c1d2-47b3-8c04-aff022ddb01c req-b0247f07-cd13-44a9-b576-17133eed5d3c service nova] Acquiring lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-098bf08f-c1d2-47b3-8c04-aff022ddb01c req-b0247f07-cd13-44a9-b576-17133eed5d3c service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-098bf08f-c1d2-47b3-8c04-aff022ddb01c req-b0247f07-cd13-44a9-b576-17133eed5d3c service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.compute.manager [req-098bf08f-c1d2-47b3-8c04-aff022ddb01c req-b0247f07-cd13-44a9-b576-17133eed5d3c service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] No waiting events found dispatching network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:04:09 user nova-compute[74898]: WARNING nova.compute.manager [req-098bf08f-c1d2-47b3-8c04-aff022ddb01c req-b0247f07-cd13-44a9-b576-17133eed5d3c service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received unexpected event network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 for instance with vm_state active and task_state rescuing.
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.compute.manager [req-098bf08f-c1d2-47b3-8c04-aff022ddb01c req-b0247f07-cd13-44a9-b576-17133eed5d3c service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received event network-vif-unplugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-098bf08f-c1d2-47b3-8c04-aff022ddb01c req-b0247f07-cd13-44a9-b576-17133eed5d3c service nova] Acquiring lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-098bf08f-c1d2-47b3-8c04-aff022ddb01c req-b0247f07-cd13-44a9-b576-17133eed5d3c service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-098bf08f-c1d2-47b3-8c04-aff022ddb01c req-b0247f07-cd13-44a9-b576-17133eed5d3c service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.compute.manager [req-098bf08f-c1d2-47b3-8c04-aff022ddb01c req-b0247f07-cd13-44a9-b576-17133eed5d3c service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] No waiting events found dispatching network-vif-unplugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:04:09 user nova-compute[74898]: WARNING nova.compute.manager [req-098bf08f-c1d2-47b3-8c04-aff022ddb01c req-b0247f07-cd13-44a9-b576-17133eed5d3c service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received unexpected event network-vif-unplugged-78bdfbfa-3578-4ef5-b499-decd609cba62 for instance with vm_state active and task_state rescuing.
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.compute.manager [req-098bf08f-c1d2-47b3-8c04-aff022ddb01c req-b0247f07-cd13-44a9-b576-17133eed5d3c service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received event network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-098bf08f-c1d2-47b3-8c04-aff022ddb01c req-b0247f07-cd13-44a9-b576-17133eed5d3c service nova] Acquiring lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-098bf08f-c1d2-47b3-8c04-aff022ddb01c req-b0247f07-cd13-44a9-b576-17133eed5d3c service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-098bf08f-c1d2-47b3-8c04-aff022ddb01c req-b0247f07-cd13-44a9-b576-17133eed5d3c service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.compute.manager [req-098bf08f-c1d2-47b3-8c04-aff022ddb01c req-b0247f07-cd13-44a9-b576-17133eed5d3c service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] No waiting events found dispatching network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:04:09 user nova-compute[74898]: WARNING nova.compute.manager [req-098bf08f-c1d2-47b3-8c04-aff022ddb01c req-b0247f07-cd13-44a9-b576-17133eed5d3c service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received unexpected event network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 for instance with vm_state active and task_state rescuing.
Nov 17 03:04:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Releasing lock "refresh_cache-dbaabab0-92f0-480d-8f81-0db980c8f333" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.compute.manager [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Instance network_info: |[{"id": "8e38fd27-07cd-40c1-bef7-67d150932e57", "address": "fa:16:3e:8b:5d:76", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e38fd27-07", "ovs_interfaceid": "8e38fd27-07cd-40c1-bef7-67d150932e57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0761a898-aaea-4854-9c72-aea6bb84f741 req-4fd26f68-460b-4f5e-a229-d74e53ce3c70 service nova] Acquired lock "refresh_cache-dbaabab0-92f0-480d-8f81-0db980c8f333" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.network.neutron [req-0761a898-aaea-4854-9c72-aea6bb84f741 req-4fd26f68-460b-4f5e-a229-d74e53ce3c70 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Refreshing network info cache for port 8e38fd27-07cd-40c1-bef7-67d150932e57 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Start _get_guest_xml network_info=[{"id": "8e38fd27-07cd-40c1-bef7-67d150932e57", "address": "fa:16:3e:8b:5d:76", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e38fd27-07", "ovs_interfaceid": "8e38fd27-07cd-40c1-bef7-67d150932e57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:04:09 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:04:09 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-702287873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-702287873',id=17,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEl2EjQvjTqov68hcm1AeEL6uEvsYKfdioCWHBY36ZV+F59uTU3I4mzgJuvGNcYThtmuN40EjuxjcwIBe1nJp1ArnA81m6C50PEcotvfJhejuAEZ67UJtWnOWyPgfw3LKw==',key_name='tempest-keypair-742675604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3de7d05d475c49f0805f5aab5853a0b2',ramdisk_id='',reservation_id='r-1c58hjg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-940982522',owner_user_name='tempest-AttachVolumeShelveTestJSON-940982522-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='926d8bd27eb24824a71cb9f1969f9c45',uuid=dbaabab0-92f0-480d-8f81-0db980c8f333,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e38fd27-07cd-40c1-bef7-67d150932e57", "address": "fa:16:3e:8b:5d:76", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e38fd27-07", "ovs_interfaceid": "8e38fd27-07cd-40c1-bef7-67d150932e57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Converting VIF {"id": "8e38fd27-07cd-40c1-bef7-67d150932e57", "address": "fa:16:3e:8b:5d:76", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e38fd27-07", "ovs_interfaceid": "8e38fd27-07cd-40c1-bef7-67d150932e57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:5d:76,bridge_name='br-int',has_traffic_filtering=True,id=8e38fd27-07cd-40c1-bef7-67d150932e57,network=Network(c92bc72d-7b33-49a8-96e5-ca2ed117fa48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e38fd27-07') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.objects.instance [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lazy-loading 'pci_devices' on Instance uuid dbaabab0-92f0-480d-8f81-0db980c8f333 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:04:09 user nova-compute[74898]:   <uuid>dbaabab0-92f0-480d-8f81-0db980c8f333</uuid>
Nov 17 03:04:09 user nova-compute[74898]:   <name>instance-00000011</name>
Nov 17 03:04:09 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:04:09 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:04:09 user nova-compute[74898]:   <metadata>
Nov 17 03:04:09 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:04:09 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:04:09 user nova-compute[74898]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-702287873</nova:name>
Nov 17 03:04:09 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:04:09</nova:creationTime>
Nov 17 03:04:09 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:04:09 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:04:09 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:04:09 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:04:09 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:04:09 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:04:09 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:04:09 user nova-compute[74898]:       <nova:owner>
Nov 17 03:04:09 user nova-compute[74898]:         <nova:user uuid="926d8bd27eb24824a71cb9f1969f9c45">tempest-AttachVolumeShelveTestJSON-940982522-project-member</nova:user>
Nov 17 03:04:09 user nova-compute[74898]:         <nova:project uuid="3de7d05d475c49f0805f5aab5853a0b2">tempest-AttachVolumeShelveTestJSON-940982522</nova:project>
Nov 17 03:04:09 user nova-compute[74898]:       </nova:owner>
Nov 17 03:04:09 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:04:09 user nova-compute[74898]:       <nova:ports>
Nov 17 03:04:09 user nova-compute[74898]:         <nova:port uuid="8e38fd27-07cd-40c1-bef7-67d150932e57">
Nov 17 03:04:09 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 17 03:04:09 user nova-compute[74898]:         </nova:port>
Nov 17 03:04:09 user nova-compute[74898]:       </nova:ports>
Nov 17 03:04:09 user nova-compute[74898]:     </nova:instance>
Nov 17 03:04:09 user nova-compute[74898]:   </metadata>
Nov 17 03:04:09 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:04:09 user nova-compute[74898]:     <system>
Nov 17 03:04:09 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:04:09 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:04:09 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:04:09 user nova-compute[74898]:       <entry name="serial">dbaabab0-92f0-480d-8f81-0db980c8f333</entry>
Nov 17 03:04:09 user nova-compute[74898]:       <entry name="uuid">dbaabab0-92f0-480d-8f81-0db980c8f333</entry>
Nov 17 03:04:09 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:04:09 user nova-compute[74898]:     </system>
Nov 17 03:04:09 user nova-compute[74898]:   </sysinfo>
Nov 17 03:04:09 user nova-compute[74898]:   <os>
Nov 17 03:04:09 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:04:09 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:04:09 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:04:09 user nova-compute[74898]:   </os>
Nov 17 03:04:09 user nova-compute[74898]:   <features>
Nov 17 03:04:09 user nova-compute[74898]:     <acpi/>
Nov 17 03:04:09 user nova-compute[74898]:     <apic/>
Nov 17 03:04:09 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:04:09 user nova-compute[74898]:   </features>
Nov 17 03:04:09 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:04:09 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:04:09 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:04:09 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:04:09 user nova-compute[74898]:   </clock>
Nov 17 03:04:09 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:04:09 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:04:09 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:04:09 user nova-compute[74898]:   </cpu>
Nov 17 03:04:09 user nova-compute[74898]:   <devices>
Nov 17 03:04:09 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:04:09 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:04:09 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk"/>
Nov 17 03:04:09 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:04:09 user nova-compute[74898]:     </disk>
Nov 17 03:04:09 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:04:09 user nova-compute[74898]:       <mac address="fa:16:3e:8b:5d:76"/>
Nov 17 03:04:09 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:04:09 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:04:09 user nova-compute[74898]:       <target dev="tap8e38fd27-07"/>
Nov 17 03:04:09 user nova-compute[74898]:     </interface>
Nov 17 03:04:09 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:04:09 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/console.log" append="off"/>
Nov 17 03:04:09 user nova-compute[74898]:     </serial>
Nov 17 03:04:09 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:04:09 user nova-compute[74898]:     <video>
Nov 17 03:04:09 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:04:09 user nova-compute[74898]:     </video>
Nov 17 03:04:09 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:04:09 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:04:09 user nova-compute[74898]:     </rng>
Nov 17 03:04:09 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:04:09 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:04:09 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:04:09 user nova-compute[74898]:     </memballoon>
Nov 17 03:04:09 user nova-compute[74898]:   </devices>
Nov 17 03:04:09 user nova-compute[74898]: </domain>
Nov 17 03:04:09 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-702287873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-702287873',id=17,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEl2EjQvjTqov68hcm1AeEL6uEvsYKfdioCWHBY36ZV+F59uTU3I4mzgJuvGNcYThtmuN40EjuxjcwIBe1nJp1ArnA81m6C50PEcotvfJhejuAEZ67UJtWnOWyPgfw3LKw==',key_name='tempest-keypair-742675604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3de7d05d475c49f0805f5aab5853a0b2',ramdisk_id='',reservation_id='r-1c58hjg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-940982522',owner_user_name='tempest-AttachVolumeShelveTestJSON-940982522-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='926d8bd27eb24824a71cb9f1969f9c45',uuid=dbaabab0-92f0-480d-8f81-0db980c8f333,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e38fd27-07cd-40c1-bef7-67d150932e57", "address": "fa:16:3e:8b:5d:76", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e38fd27-07", "ovs_interfaceid": "8e38fd27-07cd-40c1-bef7-67d150932e57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Converting VIF {"id": "8e38fd27-07cd-40c1-bef7-67d150932e57", "address": "fa:16:3e:8b:5d:76", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e38fd27-07", "ovs_interfaceid": "8e38fd27-07cd-40c1-bef7-67d150932e57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:5d:76,bridge_name='br-int',has_traffic_filtering=True,id=8e38fd27-07cd-40c1-bef7-67d150932e57,network=Network(c92bc72d-7b33-49a8-96e5-ca2ed117fa48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e38fd27-07') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG os_vif [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:5d:76,bridge_name='br-int',has_traffic_filtering=True,id=8e38fd27-07cd-40c1-bef7-67d150932e57,network=Network(c92bc72d-7b33-49a8-96e5-ca2ed117fa48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e38fd27-07') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '72ebc98e-75bd-5e0f-be8f-eff997acd27e', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e38fd27-07, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e38fd27-07, col_values=(('qos', UUID('ed0ff2d6-231d-4991-904d-26fce71bdb5b')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e38fd27-07, col_values=(('external_ids', {'iface-id': '8e38fd27-07cd-40c1-bef7-67d150932e57', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:5d:76', 'vm-uuid': 'dbaabab0-92f0-480d-8f81-0db980c8f333'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:09 user nova-compute[74898]: INFO os_vif [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:5d:76,bridge_name='br-int',has_traffic_filtering=True,id=8e38fd27-07cd-40c1-bef7-67d150932e57,network=Network(c92bc72d-7b33-49a8-96e5-ca2ed117fa48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e38fd27-07')
Nov 17 03:04:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:04:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] No VIF found with MAC fa:16:3e:8b:5d:76, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:04:10 user nova-compute[74898]: DEBUG nova.network.neutron [req-0761a898-aaea-4854-9c72-aea6bb84f741 req-4fd26f68-460b-4f5e-a229-d74e53ce3c70 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Updated VIF entry in instance network info cache for port 8e38fd27-07cd-40c1-bef7-67d150932e57. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:04:10 user nova-compute[74898]: DEBUG nova.network.neutron [req-0761a898-aaea-4854-9c72-aea6bb84f741 req-4fd26f68-460b-4f5e-a229-d74e53ce3c70 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Updating instance_info_cache with network_info: [{"id": "8e38fd27-07cd-40c1-bef7-67d150932e57", "address": "fa:16:3e:8b:5d:76", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e38fd27-07", "ovs_interfaceid": "8e38fd27-07cd-40c1-bef7-67d150932e57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:04:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0761a898-aaea-4854-9c72-aea6bb84f741 req-4fd26f68-460b-4f5e-a229-d74e53ce3c70 service nova] Releasing lock "refresh_cache-dbaabab0-92f0-480d-8f81-0db980c8f333" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:04:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-0960bdb8-b0b0-4378-acc9-61b43a6ba288 req-ff39081e-8b5a-45d3-8024-df302b179344 service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received event network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0960bdb8-b0b0-4378-acc9-61b43a6ba288 req-ff39081e-8b5a-45d3-8024-df302b179344 service nova] Acquiring lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0960bdb8-b0b0-4378-acc9-61b43a6ba288 req-ff39081e-8b5a-45d3-8024-df302b179344 service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0960bdb8-b0b0-4378-acc9-61b43a6ba288 req-ff39081e-8b5a-45d3-8024-df302b179344 service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-0960bdb8-b0b0-4378-acc9-61b43a6ba288 req-ff39081e-8b5a-45d3-8024-df302b179344 service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] No waiting events found dispatching network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:04:11 user nova-compute[74898]: WARNING nova.compute.manager [req-0960bdb8-b0b0-4378-acc9-61b43a6ba288 req-ff39081e-8b5a-45d3-8024-df302b179344 service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received unexpected event network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 for instance with vm_state active and task_state rescuing.
Nov 17 03:04:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-0960bdb8-b0b0-4378-acc9-61b43a6ba288 req-ff39081e-8b5a-45d3-8024-df302b179344 service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received event network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0960bdb8-b0b0-4378-acc9-61b43a6ba288 req-ff39081e-8b5a-45d3-8024-df302b179344 service nova] Acquiring lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0960bdb8-b0b0-4378-acc9-61b43a6ba288 req-ff39081e-8b5a-45d3-8024-df302b179344 service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0960bdb8-b0b0-4378-acc9-61b43a6ba288 req-ff39081e-8b5a-45d3-8024-df302b179344 service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-0960bdb8-b0b0-4378-acc9-61b43a6ba288 req-ff39081e-8b5a-45d3-8024-df302b179344 service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] No waiting events found dispatching network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:04:11 user nova-compute[74898]: WARNING nova.compute.manager [req-0960bdb8-b0b0-4378-acc9-61b43a6ba288 req-ff39081e-8b5a-45d3-8024-df302b179344 service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received unexpected event network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 for instance with vm_state active and task_state rescuing.
Nov 17 03:04:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-0960bdb8-b0b0-4378-acc9-61b43a6ba288 req-ff39081e-8b5a-45d3-8024-df302b179344 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Received event network-vif-plugged-8e38fd27-07cd-40c1-bef7-67d150932e57 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0960bdb8-b0b0-4378-acc9-61b43a6ba288 req-ff39081e-8b5a-45d3-8024-df302b179344 service nova] Acquiring lock "dbaabab0-92f0-480d-8f81-0db980c8f333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0960bdb8-b0b0-4378-acc9-61b43a6ba288 req-ff39081e-8b5a-45d3-8024-df302b179344 service nova] Lock "dbaabab0-92f0-480d-8f81-0db980c8f333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0960bdb8-b0b0-4378-acc9-61b43a6ba288 req-ff39081e-8b5a-45d3-8024-df302b179344 service nova] Lock "dbaabab0-92f0-480d-8f81-0db980c8f333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-0960bdb8-b0b0-4378-acc9-61b43a6ba288 req-ff39081e-8b5a-45d3-8024-df302b179344 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] No waiting events found dispatching network-vif-plugged-8e38fd27-07cd-40c1-bef7-67d150932e57 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:04:11 user nova-compute[74898]: WARNING nova.compute.manager [req-0960bdb8-b0b0-4378-acc9-61b43a6ba288 req-ff39081e-8b5a-45d3-8024-df302b179344 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Received unexpected event network-vif-plugged-8e38fd27-07cd-40c1-bef7-67d150932e57 for instance with vm_state building and task_state spawning.
Nov 17 03:04:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:13 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e570c0f6-714e-4f00-8de3-6ccd81050352 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:04:13 user nova-compute[74898]: DEBUG nova.compute.manager [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:04:13 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:04:13 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Instance spawned successfully.
Nov 17 03:04:13 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:04:13 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:04:13 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:04:13 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:04:13 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:04:13 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:04:13 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:04:13 user nova-compute[74898]: INFO nova.compute.manager [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Took 5.88 seconds to spawn the instance on the hypervisor.
Nov 17 03:04:13 user nova-compute[74898]: DEBUG nova.compute.manager [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:04:13 user nova-compute[74898]: DEBUG nova.compute.manager [req-160c9c36-091f-40e1-8212-4967858ad046 req-ee015a92-d94e-4270-a0d1-99f3842b10c4 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Received event network-vif-plugged-8e38fd27-07cd-40c1-bef7-67d150932e57 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-160c9c36-091f-40e1-8212-4967858ad046 req-ee015a92-d94e-4270-a0d1-99f3842b10c4 service nova] Acquiring lock "dbaabab0-92f0-480d-8f81-0db980c8f333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-160c9c36-091f-40e1-8212-4967858ad046 req-ee015a92-d94e-4270-a0d1-99f3842b10c4 service nova] Lock "dbaabab0-92f0-480d-8f81-0db980c8f333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-160c9c36-091f-40e1-8212-4967858ad046 req-ee015a92-d94e-4270-a0d1-99f3842b10c4 service nova] Lock "dbaabab0-92f0-480d-8f81-0db980c8f333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:13 user nova-compute[74898]: DEBUG nova.compute.manager [req-160c9c36-091f-40e1-8212-4967858ad046 req-ee015a92-d94e-4270-a0d1-99f3842b10c4 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] No waiting events found dispatching network-vif-plugged-8e38fd27-07cd-40c1-bef7-67d150932e57 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:04:13 user nova-compute[74898]: WARNING nova.compute.manager [req-160c9c36-091f-40e1-8212-4967858ad046 req-ee015a92-d94e-4270-a0d1-99f3842b10c4 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Received unexpected event network-vif-plugged-8e38fd27-07cd-40c1-bef7-67d150932e57 for instance with vm_state building and task_state spawning.
Nov 17 03:04:14 user nova-compute[74898]: INFO nova.compute.manager [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Took 6.92 seconds to build instance.
Nov 17 03:04:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-65a7fef5-d8dd-4600-9d37-ebe718a7ba50 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "dbaabab0-92f0-480d-8f81-0db980c8f333" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.093s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:14 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:04:14 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:04:14 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-015ff42a-4d69-4f60-b86c-c6bd68d23c99" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:04:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-015ff42a-4d69-4f60-b86c-c6bd68d23c99" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:04:15 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:04:15 user nova-compute[74898]: INFO nova.compute.manager [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Rebuilding instance
Nov 17 03:04:15 user nova-compute[74898]: DEBUG nova.compute.manager [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:04:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:15 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Updating instance_info_cache with network_info: [{"id": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "address": "fa:16:3e:88:21:6c", "network": {"id": "bf964a06-b5fd-41c4-9dfe-5d485019bbdd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-848964430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74014d7708574848bee4da7056ab1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d80c52a-1f", "ovs_interfaceid": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:04:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-015ff42a-4d69-4f60-b86c-c6bd68d23c99" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:04:15 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:04:15 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:04:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:15 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:04:15 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:04:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:15 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:04:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:15 user nova-compute[74898]: DEBUG nova.compute.manager [req-520fd937-3ebd-44d6-8623-a7addab95c3b req-88a7cbba-543d-4ebb-9016-6b133d6ffa06 service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Received event network-changed-5415aaa1-723f-4f35-971c-509caa04575d {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:15 user nova-compute[74898]: DEBUG nova.compute.manager [req-520fd937-3ebd-44d6-8623-a7addab95c3b req-88a7cbba-543d-4ebb-9016-6b133d6ffa06 service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Refreshing instance network info cache due to event network-changed-5415aaa1-723f-4f35-971c-509caa04575d. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:04:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-520fd937-3ebd-44d6-8623-a7addab95c3b req-88a7cbba-543d-4ebb-9016-6b133d6ffa06 service nova] Acquiring lock "refresh_cache-36e687c0-9481-4126-b365-f7f9707e2338" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:04:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-520fd937-3ebd-44d6-8623-a7addab95c3b req-88a7cbba-543d-4ebb-9016-6b133d6ffa06 service nova] Acquired lock "refresh_cache-36e687c0-9481-4126-b365-f7f9707e2338" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:04:16 user nova-compute[74898]: DEBUG nova.network.neutron [req-520fd937-3ebd-44d6-8623-a7addab95c3b req-88a7cbba-543d-4ebb-9016-6b133d6ffa06 service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Refreshing network info cache for port 5415aaa1-723f-4f35-971c-509caa04575d {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:04:16 user nova-compute[74898]: DEBUG nova.network.neutron [req-520fd937-3ebd-44d6-8623-a7addab95c3b req-88a7cbba-543d-4ebb-9016-6b133d6ffa06 service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Updated VIF entry in instance network info cache for port 5415aaa1-723f-4f35-971c-509caa04575d. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:04:16 user nova-compute[74898]: DEBUG nova.network.neutron [req-520fd937-3ebd-44d6-8623-a7addab95c3b req-88a7cbba-543d-4ebb-9016-6b133d6ffa06 service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Updating instance_info_cache with network_info: [{"id": "5415aaa1-723f-4f35-971c-509caa04575d", "address": "fa:16:3e:6f:9f:8e", "network": {"id": "4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-545743352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ed77effbea441eb58507f436033c3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5415aaa1-72", "ovs_interfaceid": "5415aaa1-723f-4f35-971c-509caa04575d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:04:16 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:04:16 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Instance destroyed successfully.
Nov 17 03:04:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-520fd937-3ebd-44d6-8623-a7addab95c3b req-88a7cbba-543d-4ebb-9016-6b133d6ffa06 service nova] Releasing lock "refresh_cache-36e687c0-9481-4126-b365-f7f9707e2338" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:04:17 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Instance destroyed successfully.
Nov 17 03:04:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:02:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1864987777',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1142928320',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFxXq1bg8SNfYclLKbHjQo8K7gYin+VKFCZjgxMqEfzsP02ZdMm/i+ADtVzCoWZvNZrQLncAAgkXtb7MJSmkiivDIZZxRPOsrvSXR9fx5NB8X7uJk83pxZNQE+yr12IYQ==',key_name='tempest-keypair-2063298515',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:02:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a1ed77effbea441eb58507f436033c3c',ramdisk_id='',reservation_id='r-ez9l9sip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1334889751',owner_user_name='tempest-ServerActionsV293TestJSON-1334889751-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:04:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbc18ee9aea24d6db4a9a71f4cf2d723',uuid=36e687c0-9481-4126-b365-f7f9707e2338,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5415aaa1-723f-4f35-971c-509caa04575d", "address": "fa:16:3e:6f:9f:8e", "network": {"id": "4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-545743352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ed77effbea441eb58507f436033c3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5415aaa1-72", "ovs_interfaceid": "5415aaa1-723f-4f35-971c-509caa04575d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Converting VIF {"id": "5415aaa1-723f-4f35-971c-509caa04575d", "address": "fa:16:3e:6f:9f:8e", "network": {"id": "4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-545743352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ed77effbea441eb58507f436033c3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5415aaa1-72", "ovs_interfaceid": "5415aaa1-723f-4f35-971c-509caa04575d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:9f:8e,bridge_name='br-int',has_traffic_filtering=True,id=5415aaa1-723f-4f35-971c-509caa04575d,network=Network(4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5415aaa1-72') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_vif [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:9f:8e,bridge_name='br-int',has_traffic_filtering=True,id=5415aaa1-723f-4f35-971c-509caa04575d,network=Network(4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5415aaa1-72') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5415aaa1-72, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5fa1d332-6894-4dd8-b94d-48301b2f8818) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:17 user nova-compute[74898]: INFO os_vif [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:9f:8e,bridge_name='br-int',has_traffic_filtering=True,id=5415aaa1-723f-4f35-971c-509caa04575d,network=Network(4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5415aaa1-72')
Nov 17 03:04:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFdrlUym', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:04:17 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc0661e-4073-4e0c-a7ac-89a8361424fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:04:17 user nova-compute[74898]: No targets found.
Nov 17 03:04:17 user nova-compute[74898]: iSNS:
Nov 17 03:04:17 user nova-compute[74898]: No targets found.
Nov 17 03:04:17 user nova-compute[74898]: STATIC:
Nov 17 03:04:17 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45
Nov 17 03:04:17 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:04:17 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:04:17 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0
Nov 17 03:04:17 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:04:17 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:04:17 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4
Nov 17 03:04:17 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:04:17 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:04:17 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8
Nov 17 03:04:17 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:04:17 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:04:17 user nova-compute[74898]: FIRMWARE:
Nov 17 03:04:17 user nova-compute[74898]: No targets found.
Nov 17 03:04:17 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:04:17 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:04:17 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde20b3a-fdfc-45e6-9a14-5b2e76a7126a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e2bc78-71c9-4ad9-9242-cbad6bcc7ed8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:04:17 user nova-compute[74898]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:04:17 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:04:17 user nova-compute[74898]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:04:17 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:04:17 user nova-compute[74898]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:04:17 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:04:17 user nova-compute[74898]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:04:17 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf8505630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4'): ({'sdb'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Removing single pathed devices sdb {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[654b6320-be16-4c8e-9aed-fe5acf46d8cf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1110de17-cf16-48c5-8fc9-7ba3a4657a28]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Flushing IO for device /dev/sdb {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3587e618-d530-46e9-ab4a-d9e6ab9d7fb3]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22f7802-5203-4fe2-9e5c-bf93643bbf07]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b8a70a-18d8-4992-8d62-262de51b8c09]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4b2c4d-b80e-45cc-9446-32b98b739caf]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4, portal: 172.16.0.220,3260]
Nov 17 03:04:17 user nova-compute[74898]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4, portal: 172.16.0.220,3260] successful.
Nov 17 03:04:17 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9be293-dbbd-42ae-aa91-ee650dadd1fe]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] <== disconnect_volume: return (372ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:04:17 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Deleting instance files /opt/stack/data/nova/instances/36e687c0-9481-4126-b365-f7f9707e2338_del
Nov 17 03:04:17 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Deletion of /opt/stack/data/nova/instances/36e687c0-9481-4126-b365-f7f9707e2338_del complete
Nov 17 03:04:17 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 36e687c0-9481-4126-b365-f7f9707e2338 could not be found.
Nov 17 03:04:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFdrlUym', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:04:17 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c733a3bf-0f82-4d09-89eb-4af2150b8d19]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:04:17 user nova-compute[74898]: No targets found.
Nov 17 03:04:17 user nova-compute[74898]: iSNS:
Nov 17 03:04:17 user nova-compute[74898]: No targets found.
Nov 17 03:04:17 user nova-compute[74898]: STATIC:
Nov 17 03:04:17 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45
Nov 17 03:04:17 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:04:17 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:04:17 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0
Nov 17 03:04:17 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:04:17 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:04:17 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8
Nov 17 03:04:17 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:04:17 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:04:17 user nova-compute[74898]: FIRMWARE:
Nov 17 03:04:17 user nova-compute[74898]: No targets found.
Nov 17 03:04:17 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:04:17 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:04:17 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f25241a-ebc9-4f03-b3ac-fe011dd14581]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d45c150-4ee2-4273-ae16-0b172ce94cc6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:04:17 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:04:17 user nova-compute[74898]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:04:17 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:04:17 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:04:17 user nova-compute[74898]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:04:17 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf86da830>, {}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Disconnecting from: [] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.097s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] <== disconnect_volume: return (97ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:04:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:04:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:18 user nova-compute[74898]: DEBUG nova.compute.manager [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Preparing to wait for external event volume-reimaged-637a8d80-8ef7-46f9-806c-cb8fdf7699c4 {{(pid=74898) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 17 03:04:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Acquiring lock "36e687c0-9481-4126-b365-f7f9707e2338-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "36e687c0-9481-4126-b365-f7f9707e2338-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "36e687c0-9481-4126-b365-f7f9707e2338-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b869a55-acf6-4550-9354-2480273a4ee2/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b869a55-acf6-4550-9354-2480273a4ee2/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b869a55-acf6-4550-9354-2480273a4ee2/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b869a55-acf6-4550-9354-2480273a4ee2/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:19 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:04:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:20 user nova-compute[74898]: DEBUG nova.compute.manager [req-97f3a8bc-6803-4377-9241-9597615c836c req-8f2f580e-a967-4c2d-9906-5ba94b686948 service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Received event network-vif-unplugged-5415aaa1-723f-4f35-971c-509caa04575d {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-97f3a8bc-6803-4377-9241-9597615c836c req-8f2f580e-a967-4c2d-9906-5ba94b686948 service nova] Acquiring lock "36e687c0-9481-4126-b365-f7f9707e2338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-97f3a8bc-6803-4377-9241-9597615c836c req-8f2f580e-a967-4c2d-9906-5ba94b686948 service nova] Lock "36e687c0-9481-4126-b365-f7f9707e2338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-97f3a8bc-6803-4377-9241-9597615c836c req-8f2f580e-a967-4c2d-9906-5ba94b686948 service nova] Lock "36e687c0-9481-4126-b365-f7f9707e2338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:20 user nova-compute[74898]: DEBUG nova.compute.manager [req-97f3a8bc-6803-4377-9241-9597615c836c req-8f2f580e-a967-4c2d-9906-5ba94b686948 service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] No event matching network-vif-unplugged-5415aaa1-723f-4f35-971c-509caa04575d in dict_keys([('volume-reimaged', '637a8d80-8ef7-46f9-806c-cb8fdf7699c4')]) {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Nov 17 03:04:20 user nova-compute[74898]: WARNING nova.compute.manager [req-97f3a8bc-6803-4377-9241-9597615c836c req-8f2f580e-a967-4c2d-9906-5ba94b686948 service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Received unexpected event network-vif-unplugged-5415aaa1-723f-4f35-971c-509caa04575d for instance with vm_state active and task_state rebuilding.
Nov 17 03:04:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba39a7b9-8b0a-421c-80d1-6bd3f32aef42/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba39a7b9-8b0a-421c-80d1-6bd3f32aef42/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba39a7b9-8b0a-421c-80d1-6bd3f32aef42/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba39a7b9-8b0a-421c-80d1-6bd3f32aef42/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:22 user nova-compute[74898]: DEBUG nova.compute.manager [req-e87d79f5-8489-4709-bd06-b0a8281198d4 req-354e2bc8-4b74-4539-aade-0224ab166b9d service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Received event network-vif-plugged-5415aaa1-723f-4f35-971c-509caa04575d {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e87d79f5-8489-4709-bd06-b0a8281198d4 req-354e2bc8-4b74-4539-aade-0224ab166b9d service nova] Acquiring lock "36e687c0-9481-4126-b365-f7f9707e2338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e87d79f5-8489-4709-bd06-b0a8281198d4 req-354e2bc8-4b74-4539-aade-0224ab166b9d service nova] Lock "36e687c0-9481-4126-b365-f7f9707e2338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e87d79f5-8489-4709-bd06-b0a8281198d4 req-354e2bc8-4b74-4539-aade-0224ab166b9d service nova] Lock "36e687c0-9481-4126-b365-f7f9707e2338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:22 user nova-compute[74898]: DEBUG nova.compute.manager [req-e87d79f5-8489-4709-bd06-b0a8281198d4 req-354e2bc8-4b74-4539-aade-0224ab166b9d service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] No event matching network-vif-plugged-5415aaa1-723f-4f35-971c-509caa04575d in dict_keys([('volume-reimaged', '637a8d80-8ef7-46f9-806c-cb8fdf7699c4')]) {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Nov 17 03:04:22 user nova-compute[74898]: WARNING nova.compute.manager [req-e87d79f5-8489-4709-bd06-b0a8281198d4 req-354e2bc8-4b74-4539-aade-0224ab166b9d service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Received unexpected event network-vif-plugged-5415aaa1-723f-4f35-971c-509caa04575d for instance with vm_state active and task_state rebuilding.
Nov 17 03:04:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:04:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:23 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:04:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474a469d-9ebe-4e91-9ec4-3f610bdd4d27/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474a469d-9ebe-4e91-9ec4-3f610bdd4d27/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474a469d-9ebe-4e91-9ec4-3f610bdd4d27/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474a469d-9ebe-4e91-9ec4-3f610bdd4d27/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:24 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:04:24 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:04:24 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=7274MB free_disk=25.371734619140625GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:04:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:24 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Applying migration context for instance 11704034-7afe-475c-ae43-1324b40f0d92 as it has an incoming, in-progress migration e64df685-1998-4c22-aa5c-6dae1f6f2fe9. Migration status is finished {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 17 03:04:24 user nova-compute[74898]: INFO nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Updating resource usage from migration e64df685-1998-4c22-aa5c-6dae1f6f2fe9
Nov 17 03:04:24 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:04:24 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance e733574a-56ba-4e24-babd-855bcb5bda61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:04:24 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 015ff42a-4d69-4f60-b86c-c6bd68d23c99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:04:24 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:04:24 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 4b869a55-acf6-4550-9354-2480273a4ee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:04:24 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance d1ee03a5-13fb-47e7-8712-ea31aed36643 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:04:24 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 36e687c0-9481-4126-b365-f7f9707e2338 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:04:24 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance ba39a7b9-8b0a-421c-80d1-6bd3f32aef42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:04:24 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Migration e64df685-1998-4c22-aa5c-6dae1f6f2fe9 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 17 03:04:24 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 11704034-7afe-475c-ae43-1324b40f0d92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:04:24 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 474a469d-9ebe-4e91-9ec4-3f610bdd4d27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:04:24 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 42994e39-187a-4fb6-a293-24a4eb57177b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:04:24 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance dbaabab0-92f0-480d-8f81-0db980c8f333 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:04:24 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:04:24 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:04:24 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:04:24 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:04:24 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:04:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.633s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:26 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:04:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ed15df89-5555-4937-baf0-491a6e4dccfc tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Acquiring lock "4b869a55-acf6-4550-9354-2480273a4ee2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ed15df89-5555-4937-baf0-491a6e4dccfc tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "4b869a55-acf6-4550-9354-2480273a4ee2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ed15df89-5555-4937-baf0-491a6e4dccfc tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Acquiring lock "4b869a55-acf6-4550-9354-2480273a4ee2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ed15df89-5555-4937-baf0-491a6e4dccfc tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "4b869a55-acf6-4550-9354-2480273a4ee2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ed15df89-5555-4937-baf0-491a6e4dccfc tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "4b869a55-acf6-4550-9354-2480273a4ee2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:30 user nova-compute[74898]: INFO nova.compute.manager [None req-ed15df89-5555-4937-baf0-491a6e4dccfc tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Terminating instance
Nov 17 03:04:30 user nova-compute[74898]: DEBUG nova.compute.manager [None req-ed15df89-5555-4937-baf0-491a6e4dccfc tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:04:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:30 user nova-compute[74898]: DEBUG nova.compute.manager [req-f872039d-4df7-460f-baaf-6a96f183710a req-d879aa45-db76-4a95-8543-192239379b91 service nova] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Received event network-vif-unplugged-edcbb515-e95f-4dee-a4be-ca8b4e2191c4 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f872039d-4df7-460f-baaf-6a96f183710a req-d879aa45-db76-4a95-8543-192239379b91 service nova] Acquiring lock "4b869a55-acf6-4550-9354-2480273a4ee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f872039d-4df7-460f-baaf-6a96f183710a req-d879aa45-db76-4a95-8543-192239379b91 service nova] Lock "4b869a55-acf6-4550-9354-2480273a4ee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f872039d-4df7-460f-baaf-6a96f183710a req-d879aa45-db76-4a95-8543-192239379b91 service nova] Lock "4b869a55-acf6-4550-9354-2480273a4ee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:30 user nova-compute[74898]: DEBUG nova.compute.manager [req-f872039d-4df7-460f-baaf-6a96f183710a req-d879aa45-db76-4a95-8543-192239379b91 service nova] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] No waiting events found dispatching network-vif-unplugged-edcbb515-e95f-4dee-a4be-ca8b4e2191c4 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:04:30 user nova-compute[74898]: DEBUG nova.compute.manager [req-f872039d-4df7-460f-baaf-6a96f183710a req-d879aa45-db76-4a95-8543-192239379b91 service nova] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Received event network-vif-unplugged-edcbb515-e95f-4dee-a4be-ca8b4e2191c4 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:04:31 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Instance destroyed successfully.
Nov 17 03:04:31 user nova-compute[74898]: DEBUG nova.objects.instance [None req-ed15df89-5555-4937-baf0-491a6e4dccfc tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lazy-loading 'resources' on Instance uuid 4b869a55-acf6-4550-9354-2480273a4ee2 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:04:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-ed15df89-5555-4937-baf0-491a6e4dccfc tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:00:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-349146135',display_name='tempest-TestServerVolumeAttachmentScenario-server-349146135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-349146135',id=11,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1C3vk7XLcPHGJ7XhRnb7qPtFY6UKbHX3jryNoe+V4NSq+LPfmGHjkkhP7l9SQPjd46XiCZvWOLAU4hUSl8ispg0tsgqb+YlaUfuJE1GhaBVSUR+lN2NuBQIPYLqsrVbg==',key_name='tempest-keypair-638123582',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:00:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd898b2b6f76441aa5cc13fd96d668f2',ramdisk_id='',reservation_id='r-uq3cyxhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1653593012',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1653593012-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:00:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83af8ef9a30143d5a46127cabba702f5',uuid=4b869a55-acf6-4550-9354-2480273a4ee2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edcbb515-e95f-4dee-a4be-ca8b4e2191c4", "address": "fa:16:3e:cd:e9:3a", "network": {"id": "d0089735-d511-4277-92cc-f97083a06ac5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1908721109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd898b2b6f76441aa5cc13fd96d668f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedcbb515-e9", "ovs_interfaceid": "edcbb515-e95f-4dee-a4be-ca8b4e2191c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:04:31 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-ed15df89-5555-4937-baf0-491a6e4dccfc tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Converting VIF {"id": "edcbb515-e95f-4dee-a4be-ca8b4e2191c4", "address": "fa:16:3e:cd:e9:3a", "network": {"id": "d0089735-d511-4277-92cc-f97083a06ac5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1908721109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd898b2b6f76441aa5cc13fd96d668f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedcbb515-e9", "ovs_interfaceid": "edcbb515-e95f-4dee-a4be-ca8b4e2191c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:04:31 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-ed15df89-5555-4937-baf0-491a6e4dccfc tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:e9:3a,bridge_name='br-int',has_traffic_filtering=True,id=edcbb515-e95f-4dee-a4be-ca8b4e2191c4,network=Network(d0089735-d511-4277-92cc-f97083a06ac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedcbb515-e9') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:04:31 user nova-compute[74898]: DEBUG os_vif [None req-ed15df89-5555-4937-baf0-491a6e4dccfc tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:e9:3a,bridge_name='br-int',has_traffic_filtering=True,id=edcbb515-e95f-4dee-a4be-ca8b4e2191c4,network=Network(d0089735-d511-4277-92cc-f97083a06ac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedcbb515-e9') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:04:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapedcbb515-e9, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:04:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:04:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d65c1fab-2477-49a3-89e4-01c9026d769a) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:04:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:04:31 user nova-compute[74898]: INFO os_vif [None req-ed15df89-5555-4937-baf0-491a6e4dccfc tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:e9:3a,bridge_name='br-int',has_traffic_filtering=True,id=edcbb515-e95f-4dee-a4be-ca8b4e2191c4,network=Network(d0089735-d511-4277-92cc-f97083a06ac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedcbb515-e9')
Nov 17 03:04:31 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-ed15df89-5555-4937-baf0-491a6e4dccfc tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Deleting instance files /opt/stack/data/nova/instances/4b869a55-acf6-4550-9354-2480273a4ee2_del
Nov 17 03:04:31 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-ed15df89-5555-4937-baf0-491a6e4dccfc tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Deletion of /opt/stack/data/nova/instances/4b869a55-acf6-4550-9354-2480273a4ee2_del complete
Nov 17 03:04:31 user nova-compute[74898]: INFO nova.compute.manager [None req-ed15df89-5555-4937-baf0-491a6e4dccfc tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 17 03:04:31 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-ed15df89-5555-4937-baf0-491a6e4dccfc tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:04:31 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:04:31 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:04:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e080fae7-cdde-4443-91cf-334946c79e49 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Acquiring lock "ba39a7b9-8b0a-421c-80d1-6bd3f32aef42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e080fae7-cdde-4443-91cf-334946c79e49 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "ba39a7b9-8b0a-421c-80d1-6bd3f32aef42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e080fae7-cdde-4443-91cf-334946c79e49 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Acquiring lock "ba39a7b9-8b0a-421c-80d1-6bd3f32aef42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e080fae7-cdde-4443-91cf-334946c79e49 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "ba39a7b9-8b0a-421c-80d1-6bd3f32aef42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e080fae7-cdde-4443-91cf-334946c79e49 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "ba39a7b9-8b0a-421c-80d1-6bd3f32aef42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:31 user nova-compute[74898]: INFO nova.compute.manager [None req-e080fae7-cdde-4443-91cf-334946c79e49 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Terminating instance
Nov 17 03:04:31 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e080fae7-cdde-4443-91cf-334946c79e49 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:04:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:31 user nova-compute[74898]: DEBUG nova.compute.manager [req-483452a2-5393-4e51-8d06-32eec04a1857 req-4356a71c-2c98-410d-af10-6bc88696ab25 service nova] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Received event network-vif-unplugged-944fd53e-41fc-471e-b185-cda1e137d8b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-483452a2-5393-4e51-8d06-32eec04a1857 req-4356a71c-2c98-410d-af10-6bc88696ab25 service nova] Acquiring lock "ba39a7b9-8b0a-421c-80d1-6bd3f32aef42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-483452a2-5393-4e51-8d06-32eec04a1857 req-4356a71c-2c98-410d-af10-6bc88696ab25 service nova] Lock "ba39a7b9-8b0a-421c-80d1-6bd3f32aef42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-483452a2-5393-4e51-8d06-32eec04a1857 req-4356a71c-2c98-410d-af10-6bc88696ab25 service nova] Lock "ba39a7b9-8b0a-421c-80d1-6bd3f32aef42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:31 user nova-compute[74898]: DEBUG nova.compute.manager [req-483452a2-5393-4e51-8d06-32eec04a1857 req-4356a71c-2c98-410d-af10-6bc88696ab25 service nova] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] No waiting events found dispatching network-vif-unplugged-944fd53e-41fc-471e-b185-cda1e137d8b5 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:04:31 user nova-compute[74898]: DEBUG nova.compute.manager [req-483452a2-5393-4e51-8d06-32eec04a1857 req-4356a71c-2c98-410d-af10-6bc88696ab25 service nova] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Received event network-vif-unplugged-944fd53e-41fc-471e-b185-cda1e137d8b5 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:04:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:32 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Instance destroyed successfully.
Nov 17 03:04:32 user nova-compute[74898]: DEBUG nova.objects.instance [None req-e080fae7-cdde-4443-91cf-334946c79e49 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lazy-loading 'resources' on Instance uuid ba39a7b9-8b0a-421c-80d1-6bd3f32aef42 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:04:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-e080fae7-cdde-4443-91cf-334946c79e49 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-294260331',display_name='tempest-VolumesAdminNegativeTest-server-294260331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-294260331',id=14,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:02:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d29dfc5e055942b4af680a17e5b1de13',ramdisk_id='',reservation_id='r-zokasr2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1538245231',owner_user_name='tempest-VolumesAdminNegativeTest-1538245231-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:02:41Z,user_data=None,user_id='7a8202cbeb204cd38b3f8daa90578dbf',uuid=ba39a7b9-8b0a-421c-80d1-6bd3f32aef42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "944fd53e-41fc-471e-b185-cda1e137d8b5", "address": "fa:16:3e:a6:ae:f0", "network": {"id": "7ed585ab-8901-4ced-a881-2dd15371baa7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-738644687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d29dfc5e055942b4af680a17e5b1de13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap944fd53e-41", "ovs_interfaceid": "944fd53e-41fc-471e-b185-cda1e137d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:04:32 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-e080fae7-cdde-4443-91cf-334946c79e49 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Converting VIF {"id": "944fd53e-41fc-471e-b185-cda1e137d8b5", "address": "fa:16:3e:a6:ae:f0", "network": {"id": "7ed585ab-8901-4ced-a881-2dd15371baa7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-738644687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d29dfc5e055942b4af680a17e5b1de13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap944fd53e-41", "ovs_interfaceid": "944fd53e-41fc-471e-b185-cda1e137d8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:04:32 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-e080fae7-cdde-4443-91cf-334946c79e49 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:ae:f0,bridge_name='br-int',has_traffic_filtering=True,id=944fd53e-41fc-471e-b185-cda1e137d8b5,network=Network(7ed585ab-8901-4ced-a881-2dd15371baa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap944fd53e-41') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:04:32 user nova-compute[74898]: DEBUG os_vif [None req-e080fae7-cdde-4443-91cf-334946c79e49 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:ae:f0,bridge_name='br-int',has_traffic_filtering=True,id=944fd53e-41fc-471e-b185-cda1e137d8b5,network=Network(7ed585ab-8901-4ced-a881-2dd15371baa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap944fd53e-41') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:04:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap944fd53e-41, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:04:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:04:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea521657-b435-44a1-8231-4ccf0b87f666) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:04:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:04:32 user nova-compute[74898]: INFO os_vif [None req-e080fae7-cdde-4443-91cf-334946c79e49 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:ae:f0,bridge_name='br-int',has_traffic_filtering=True,id=944fd53e-41fc-471e-b185-cda1e137d8b5,network=Network(7ed585ab-8901-4ced-a881-2dd15371baa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap944fd53e-41')
Nov 17 03:04:32 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-e080fae7-cdde-4443-91cf-334946c79e49 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Deleting instance files /opt/stack/data/nova/instances/ba39a7b9-8b0a-421c-80d1-6bd3f32aef42_del
Nov 17 03:04:32 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-e080fae7-cdde-4443-91cf-334946c79e49 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Deletion of /opt/stack/data/nova/instances/ba39a7b9-8b0a-421c-80d1-6bd3f32aef42_del complete
Nov 17 03:04:32 user nova-compute[74898]: INFO nova.compute.manager [None req-e080fae7-cdde-4443-91cf-334946c79e49 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 17 03:04:32 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-e080fae7-cdde-4443-91cf-334946c79e49 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:04:32 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:04:32 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:04:32 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:04:32 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Took 1.06 seconds to deallocate network for instance.
Nov 17 03:04:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ed15df89-5555-4937-baf0-491a6e4dccfc tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ed15df89-5555-4937-baf0-491a6e4dccfc tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:32 user nova-compute[74898]: DEBUG nova.compute.manager [req-414126bd-fbae-4fa2-861a-e69caba3179e req-7cabace8-43f9-44c6-9b16-a373a2cf3df9 service nova] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Received event network-vif-deleted-edcbb515-e95f-4dee-a4be-ca8b4e2191c4 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:32 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:04:32 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Took 0.48 seconds to deallocate network for instance.
Nov 17 03:04:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e080fae7-cdde-4443-91cf-334946c79e49 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:32 user nova-compute[74898]: DEBUG nova.compute.manager [req-1b3b641a-6e6f-4cf6-bfe8-b37846b42d0f req-b16c03f2-da0e-4e0e-b8f9-89e9439d0b68 service nova] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Received event network-vif-plugged-edcbb515-e95f-4dee-a4be-ca8b4e2191c4 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1b3b641a-6e6f-4cf6-bfe8-b37846b42d0f req-b16c03f2-da0e-4e0e-b8f9-89e9439d0b68 service nova] Acquiring lock "4b869a55-acf6-4550-9354-2480273a4ee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1b3b641a-6e6f-4cf6-bfe8-b37846b42d0f req-b16c03f2-da0e-4e0e-b8f9-89e9439d0b68 service nova] Lock "4b869a55-acf6-4550-9354-2480273a4ee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1b3b641a-6e6f-4cf6-bfe8-b37846b42d0f req-b16c03f2-da0e-4e0e-b8f9-89e9439d0b68 service nova] Lock "4b869a55-acf6-4550-9354-2480273a4ee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:32 user nova-compute[74898]: DEBUG nova.compute.manager [req-1b3b641a-6e6f-4cf6-bfe8-b37846b42d0f req-b16c03f2-da0e-4e0e-b8f9-89e9439d0b68 service nova] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] No waiting events found dispatching network-vif-plugged-edcbb515-e95f-4dee-a4be-ca8b4e2191c4 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:04:32 user nova-compute[74898]: WARNING nova.compute.manager [req-1b3b641a-6e6f-4cf6-bfe8-b37846b42d0f req-b16c03f2-da0e-4e0e-b8f9-89e9439d0b68 service nova] [instance: 4b869a55-acf6-4550-9354-2480273a4ee2] Received unexpected event network-vif-plugged-edcbb515-e95f-4dee-a4be-ca8b4e2191c4 for instance with vm_state deleted and task_state None.
Nov 17 03:04:32 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-ed15df89-5555-4937-baf0-491a6e4dccfc tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:04:32 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-ed15df89-5555-4937-baf0-491a6e4dccfc tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:04:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ed15df89-5555-4937-baf0-491a6e4dccfc tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.486s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e080fae7-cdde-4443-91cf-334946c79e49 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.201s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:33 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-ed15df89-5555-4937-baf0-491a6e4dccfc tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Deleted allocations for instance 4b869a55-acf6-4550-9354-2480273a4ee2
Nov 17 03:04:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ed15df89-5555-4937-baf0-491a6e4dccfc tempest-TestServerVolumeAttachmentScenario-1653593012 tempest-TestServerVolumeAttachmentScenario-1653593012-project-member] Lock "4b869a55-acf6-4550-9354-2480273a4ee2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.674s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:33 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e080fae7-cdde-4443-91cf-334946c79e49 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:04:33 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e080fae7-cdde-4443-91cf-334946c79e49 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:04:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e080fae7-cdde-4443-91cf-334946c79e49 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:33 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-e080fae7-cdde-4443-91cf-334946c79e49 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Deleted allocations for instance ba39a7b9-8b0a-421c-80d1-6bd3f32aef42
Nov 17 03:04:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e080fae7-cdde-4443-91cf-334946c79e49 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "ba39a7b9-8b0a-421c-80d1-6bd3f32aef42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.951s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:33 user nova-compute[74898]: DEBUG nova.compute.manager [req-159aaf3f-d9bb-4463-b194-9ac337386f29 req-e8899a34-2eb7-4c23-bc80-f3f7bf4adf88 service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Received event volume-reimaged-637a8d80-8ef7-46f9-806c-cb8fdf7699c4 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-159aaf3f-d9bb-4463-b194-9ac337386f29 req-e8899a34-2eb7-4c23-bc80-f3f7bf4adf88 service nova] Acquiring lock "36e687c0-9481-4126-b365-f7f9707e2338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-159aaf3f-d9bb-4463-b194-9ac337386f29 req-e8899a34-2eb7-4c23-bc80-f3f7bf4adf88 service nova] Lock "36e687c0-9481-4126-b365-f7f9707e2338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-159aaf3f-d9bb-4463-b194-9ac337386f29 req-e8899a34-2eb7-4c23-bc80-f3f7bf4adf88 service nova] Lock "36e687c0-9481-4126-b365-f7f9707e2338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:33 user nova-compute[74898]: DEBUG nova.compute.manager [req-159aaf3f-d9bb-4463-b194-9ac337386f29 req-e8899a34-2eb7-4c23-bc80-f3f7bf4adf88 service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Processing event volume-reimaged-637a8d80-8ef7-46f9-806c-cb8fdf7699c4 {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 17 03:04:33 user nova-compute[74898]: DEBUG nova.compute.manager [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Instance event wait completed in 14 seconds for volume-reimaged {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:04:33 user nova-compute[74898]: INFO nova.virt.block_device [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Booting with volume 637a8d80-8ef7-46f9-806c-cb8fdf7699c4 at /dev/vda
Nov 17 03:04:33 user nova-compute[74898]: DEBUG os_brick.utils [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:04:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0594b15c-650b-4915-8953-1b6b9ea32aa5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8c8be7-0ed4-47be-8ad0-d2cecd3e60ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:33 user nova-compute[74898]: DEBUG nova.compute.manager [req-4c7d50f6-a7b6-4e2b-82cb-c91300c536fe req-023cec38-356b-4b95-acaf-ca5dc09f2461 service nova] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Received event network-vif-plugged-944fd53e-41fc-471e-b185-cda1e137d8b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4c7d50f6-a7b6-4e2b-82cb-c91300c536fe req-023cec38-356b-4b95-acaf-ca5dc09f2461 service nova] Acquiring lock "ba39a7b9-8b0a-421c-80d1-6bd3f32aef42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4c7d50f6-a7b6-4e2b-82cb-c91300c536fe req-023cec38-356b-4b95-acaf-ca5dc09f2461 service nova] Lock "ba39a7b9-8b0a-421c-80d1-6bd3f32aef42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4c7d50f6-a7b6-4e2b-82cb-c91300c536fe req-023cec38-356b-4b95-acaf-ca5dc09f2461 service nova] Lock "ba39a7b9-8b0a-421c-80d1-6bd3f32aef42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:33 user nova-compute[74898]: DEBUG nova.compute.manager [req-4c7d50f6-a7b6-4e2b-82cb-c91300c536fe req-023cec38-356b-4b95-acaf-ca5dc09f2461 service nova] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] No waiting events found dispatching network-vif-plugged-944fd53e-41fc-471e-b185-cda1e137d8b5 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:04:33 user nova-compute[74898]: WARNING nova.compute.manager [req-4c7d50f6-a7b6-4e2b-82cb-c91300c536fe req-023cec38-356b-4b95-acaf-ca5dc09f2461 service nova] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Received unexpected event network-vif-plugged-944fd53e-41fc-471e-b185-cda1e137d8b5 for instance with vm_state deleted and task_state None.
Nov 17 03:04:33 user nova-compute[74898]: DEBUG nova.compute.manager [req-4c7d50f6-a7b6-4e2b-82cb-c91300c536fe req-023cec38-356b-4b95-acaf-ca5dc09f2461 service nova] [instance: ba39a7b9-8b0a-421c-80d1-6bd3f32aef42] Received event network-vif-deleted-944fd53e-41fc-471e-b185-cda1e137d8b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf4231c-3b7c-4de7-8fe1-c0bb60af0f83]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[34604f2f-228c-4b31-995d-baef2b31cdcc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:04:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:04:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:04:34 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:04:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[80789e1c-8d0f-4643-afd6-955d88c043a1]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:04:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:04:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:04:34 user nova-compute[74898]: DEBUG os_brick.utils [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:04:34 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Updating existing volume attachment record: f1ffa6f7-817c-464b-8f69-348f508bc9d9 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:04:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:38 user nova-compute[74898]: DEBUG nova.compute.manager [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:04:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:38 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:04:38 user nova-compute[74898]: INFO nova.compute.claims [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Claim successful on node user
Nov 17 03:04:38 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:04:38 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG nova.compute.manager [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG nova.compute.manager [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG nova.network.neutron [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:04:39 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:04:39 user nova-compute[74898]: DEBUG nova.compute.manager [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:04:39 user nova-compute[74898]: INFO nova.virt.block_device [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Booting with volume 59c7c3e8-f2e8-471c-8a4a-75bcd771c248 at /dev/vda
Nov 17 03:04:39 user nova-compute[74898]: DEBUG nova.policy [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bedf3f8df3e946b88a32ce4c78ee358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b8bb76f54b4f5fa95f603550c269dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG os_brick.utils [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf2fc72-05c4-4251-bead-798dd27ba417]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5837cd-106b-45ad-a18f-56fb25079d15]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9043d9b1-98dd-4caa-9749-295fd02226bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[112e34e8-9162-48f3-bc6c-6eb59f463cf3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:04:39 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:04:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d7b5ed-3455-4673-941b-eb1f93ada08f]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG os_brick.utils [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Updating existing volume attachment record: 6afbb732-e0f4-41d9-9bd8-75b532906732 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG nova.network.neutron [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Successfully created port: 58ede42b-dcc4-45f2-8be6-f1fba65e9f4c {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:04:39 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Creating image(s)
Nov 17 03:04:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Did not create local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Ensure instance console log exists: /opt/stack/data/nova/instances/36e687c0-9481-4126-b365-f7f9707e2338/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Start _get_guest_xml network_info=[{"id": "5415aaa1-723f-4f35-971c-509caa04575d", "address": "fa:16:3e:6f:9f:8e", "network": {"id": "4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-545743352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ed77effbea441eb58507f436033c3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5415aaa1-72", "ovs_interfaceid": "5415aaa1-723f-4f35-971c-509caa04575d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFdrlUym', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '36e687c0-9481-4126-b365-f7f9707e2338', 'attached_at': '', 'detached_at': '', 'volume_id': '637a8d80-8ef7-46f9-806c-cb8fdf7699c4', 'serial': '637a8d80-8ef7-46f9-806c-cb8fdf7699c4'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'f1ffa6f7-817c-464b-8f69-348f508bc9d9', 'volume_type': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:04:39 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 17 03:04:39 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 17 03:04:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:04:39 user nova-compute[74898]: DEBUG nova.objects.instance [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lazy-loading 'vcpu_model' on Instance uuid 36e687c0-9481-4126-b365-f7f9707e2338 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFdrlUym', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:04:40 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 17 03:04:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:04:40 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 17 03:04:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:04:40 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[463e71fa-11c5-4cfe-8bf4-0aa36b9010ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:04:40 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f20a21-2c1c-4e75-8cee-eaf972d336b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4] added
Nov 17 03:04:40 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d8ceea-0e35-463b-9b00-0e849e53656b]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfced4b2-1af8-45d6-a38c-1bef8b0034cd]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kFdrlUym {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kFdrlUym" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[287be1d7-e8fd-474f-bc94-873d2b66ab30]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kFdrlUym'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[58eff656-7afb-4fbb-8c5a-22a2f79cb349]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe3a8f1-bcaf-429e-8339-9bbea5a90170]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:04:40 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:04:40 user nova-compute[74898]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:04:40 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:04:40 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:04:40 user nova-compute[74898]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:04:40 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[23950ae3-eaf6-4b8c-9da0-2cb8c080273c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4, portal: 172.16.0.220,3260]
Nov 17 03:04:40 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4, portal: 172.16.0.220,3260] successful.
Nov 17 03:04:40 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2622b762-c7bc-4124-bb60-8129cdb7247f]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[355bde5e-8564-48bd-ad01-3d144fde6717]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:04:40 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:04:40 user nova-compute[74898]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:04:40 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:04:40 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:04:40 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:04:40 user nova-compute[74898]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:04:40 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:04:40 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[370681f0-72cb-4554-a72f-c1535796d4cf]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: None {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG nova.network.neutron [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Successfully created port: 857da07e-b7c7-4bb9-805a-8c9a7d30d6bf {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:04:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:41 user nova-compute[74898]: DEBUG nova.network.neutron [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Successfully created port: 86a69795-c167-4353-b46e-0137384a0af5 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:04:41 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:04:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFdrlUym', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:04:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:04:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23135373636363233', 'path': '/dev/sdb'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:04:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135373636363233', 'path': '/dev/sdb'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:04:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-17T03:02:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1864987777',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1142928320',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFxXq1bg8SNfYclLKbHjQo8K7gYin+VKFCZjgxMqEfzsP02ZdMm/i+ADtVzCoWZvNZrQLncAAgkXtb7MJSmkiivDIZZxRPOsrvSXR9fx5NB8X7uJk83pxZNQE+yr12IYQ==',key_name='tempest-keypair-2063298515',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:02:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a1ed77effbea441eb58507f436033c3c',ramdisk_id='',reservation_id='r-ez9l9sip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1334889751',owner_user_name='tempest-ServerActionsV293TestJSON-1334889751-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:04:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbc18ee9aea24d6db4a9a71f4cf2d723',uuid=36e687c0-9481-4126-b365-f7f9707e2338,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5415aaa1-723f-4f35-971c-509caa04575d", "address": "fa:16:3e:6f:9f:8e", "network": {"id": "4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-545743352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ed77effbea441eb58507f436033c3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5415aaa1-72", "ovs_interfaceid": "5415aaa1-723f-4f35-971c-509caa04575d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:04:41 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Converting VIF {"id": "5415aaa1-723f-4f35-971c-509caa04575d", "address": "fa:16:3e:6f:9f:8e", "network": {"id": "4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-545743352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ed77effbea441eb58507f436033c3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5415aaa1-72", "ovs_interfaceid": "5415aaa1-723f-4f35-971c-509caa04575d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:04:41 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:9f:8e,bridge_name='br-int',has_traffic_filtering=True,id=5415aaa1-723f-4f35-971c-509caa04575d,network=Network(4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5415aaa1-72') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:04:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:04:41 user nova-compute[74898]:   <uuid>36e687c0-9481-4126-b365-f7f9707e2338</uuid>
Nov 17 03:04:41 user nova-compute[74898]:   <name>instance-0000000d</name>
Nov 17 03:04:41 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:04:41 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:04:41 user nova-compute[74898]:   <metadata>
Nov 17 03:04:41 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:04:41 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:04:41 user nova-compute[74898]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1864987777</nova:name>
Nov 17 03:04:41 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:04:39</nova:creationTime>
Nov 17 03:04:41 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:04:41 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:04:41 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:04:41 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:04:41 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:04:41 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:04:41 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:04:41 user nova-compute[74898]:       <nova:owner>
Nov 17 03:04:41 user nova-compute[74898]:         <nova:user uuid="dbc18ee9aea24d6db4a9a71f4cf2d723">tempest-ServerActionsV293TestJSON-1334889751-project-member</nova:user>
Nov 17 03:04:41 user nova-compute[74898]:         <nova:project uuid="a1ed77effbea441eb58507f436033c3c">tempest-ServerActionsV293TestJSON-1334889751</nova:project>
Nov 17 03:04:41 user nova-compute[74898]:       </nova:owner>
Nov 17 03:04:41 user nova-compute[74898]:       <nova:ports>
Nov 17 03:04:41 user nova-compute[74898]:         <nova:port uuid="5415aaa1-723f-4f35-971c-509caa04575d">
Nov 17 03:04:41 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 17 03:04:41 user nova-compute[74898]:         </nova:port>
Nov 17 03:04:41 user nova-compute[74898]:       </nova:ports>
Nov 17 03:04:41 user nova-compute[74898]:     </nova:instance>
Nov 17 03:04:41 user nova-compute[74898]:   </metadata>
Nov 17 03:04:41 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:04:41 user nova-compute[74898]:     <system>
Nov 17 03:04:41 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:04:41 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:04:41 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:04:41 user nova-compute[74898]:       <entry name="serial">36e687c0-9481-4126-b365-f7f9707e2338</entry>
Nov 17 03:04:41 user nova-compute[74898]:       <entry name="uuid">36e687c0-9481-4126-b365-f7f9707e2338</entry>
Nov 17 03:04:41 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:04:41 user nova-compute[74898]:     </system>
Nov 17 03:04:41 user nova-compute[74898]:   </sysinfo>
Nov 17 03:04:41 user nova-compute[74898]:   <os>
Nov 17 03:04:41 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:04:41 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:04:41 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:04:41 user nova-compute[74898]:   </os>
Nov 17 03:04:41 user nova-compute[74898]:   <features>
Nov 17 03:04:41 user nova-compute[74898]:     <acpi/>
Nov 17 03:04:41 user nova-compute[74898]:     <apic/>
Nov 17 03:04:41 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:04:41 user nova-compute[74898]:   </features>
Nov 17 03:04:41 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:04:41 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:04:41 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:04:41 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:04:41 user nova-compute[74898]:   </clock>
Nov 17 03:04:41 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:04:41 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:04:41 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:04:41 user nova-compute[74898]:   </cpu>
Nov 17 03:04:41 user nova-compute[74898]:   <devices>
Nov 17 03:04:41 user nova-compute[74898]:     <disk type="block" device="disk">
Nov 17 03:04:41 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:04:41 user nova-compute[74898]:       <source dev="/dev/sdb"/>
Nov 17 03:04:41 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:04:41 user nova-compute[74898]:       <serial>637a8d80-8ef7-46f9-806c-cb8fdf7699c4</serial>
Nov 17 03:04:41 user nova-compute[74898]:     </disk>
Nov 17 03:04:41 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:04:41 user nova-compute[74898]:       <mac address="fa:16:3e:6f:9f:8e"/>
Nov 17 03:04:41 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:04:41 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:04:41 user nova-compute[74898]:       <target dev="tap5415aaa1-72"/>
Nov 17 03:04:41 user nova-compute[74898]:     </interface>
Nov 17 03:04:41 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:04:41 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/36e687c0-9481-4126-b365-f7f9707e2338/console.log" append="off"/>
Nov 17 03:04:41 user nova-compute[74898]:     </serial>
Nov 17 03:04:41 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:04:41 user nova-compute[74898]:     <video>
Nov 17 03:04:41 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:04:41 user nova-compute[74898]:     </video>
Nov 17 03:04:41 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:04:41 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:04:41 user nova-compute[74898]:     </rng>
Nov 17 03:04:41 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:04:41 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:04:41 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:04:41 user nova-compute[74898]:     </memballoon>
Nov 17 03:04:41 user nova-compute[74898]:   </devices>
Nov 17 03:04:41 user nova-compute[74898]: </domain>
Nov 17 03:04:41 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:04:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-17T03:02:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1864987777',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1142928320',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFxXq1bg8SNfYclLKbHjQo8K7gYin+VKFCZjgxMqEfzsP02ZdMm/i+ADtVzCoWZvNZrQLncAAgkXtb7MJSmkiivDIZZxRPOsrvSXR9fx5NB8X7uJk83pxZNQE+yr12IYQ==',key_name='tempest-keypair-2063298515',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:02:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a1ed77effbea441eb58507f436033c3c',ramdisk_id='',reservation_id='r-ez9l9sip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1334889751',owner_user_name='tempest-ServerActionsV293TestJSON-1334889751-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:04:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbc18ee9aea24d6db4a9a71f4cf2d723',uuid=36e687c0-9481-4126-b365-f7f9707e2338,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5415aaa1-723f-4f35-971c-509caa04575d", "address": "fa:16:3e:6f:9f:8e", "network": {"id": "4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-545743352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ed77effbea441eb58507f436033c3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5415aaa1-72", "ovs_interfaceid": "5415aaa1-723f-4f35-971c-509caa04575d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:04:41 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Converting VIF {"id": "5415aaa1-723f-4f35-971c-509caa04575d", "address": "fa:16:3e:6f:9f:8e", "network": {"id": "4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-545743352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ed77effbea441eb58507f436033c3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5415aaa1-72", "ovs_interfaceid": "5415aaa1-723f-4f35-971c-509caa04575d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:04:41 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:9f:8e,bridge_name='br-int',has_traffic_filtering=True,id=5415aaa1-723f-4f35-971c-509caa04575d,network=Network(4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5415aaa1-72') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:04:41 user nova-compute[74898]: DEBUG os_vif [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:9f:8e,bridge_name='br-int',has_traffic_filtering=True,id=5415aaa1-723f-4f35-971c-509caa04575d,network=Network(4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5415aaa1-72') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:04:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:04:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:04:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32831a78-4539-5f72-9d80-c35b0b3090b2', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:04:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:04:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5415aaa1-72, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:04:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5415aaa1-72, col_values=(('qos', UUID('d953c4c8-f57f-4b12-920e-c31df5ac4107')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:04:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5415aaa1-72, col_values=(('external_ids', {'iface-id': '5415aaa1-723f-4f35-971c-509caa04575d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:9f:8e', 'vm-uuid': '36e687c0-9481-4126-b365-f7f9707e2338'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:04:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:04:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:41 user nova-compute[74898]: INFO os_vif [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:9f:8e,bridge_name='br-int',has_traffic_filtering=True,id=5415aaa1-723f-4f35-971c-509caa04575d,network=Network(4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5415aaa1-72')
Nov 17 03:04:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:04:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] No VIF found with MAC fa:16:3e:6f:9f:8e, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:04:41 user nova-compute[74898]: DEBUG nova.network.neutron [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Successfully created port: 189360e5-7bc0-4711-8069-8939c57a28d7 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:04:42 user nova-compute[74898]: DEBUG nova.network.neutron [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Successfully created port: 0559955f-ea89-4f72-93dd-22b0df42e380 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:04:42 user nova-compute[74898]: DEBUG nova.network.neutron [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Successfully updated port: 58ede42b-dcc4-45f2-8be6-f1fba65e9f4c {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:04:42 user nova-compute[74898]: DEBUG nova.compute.manager [req-63fdd752-3162-4db9-9041-bdbf2c04c282 req-211230e0-bd55-41d7-82cf-ff5a38d85d6b service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-changed-58ede42b-dcc4-45f2-8be6-f1fba65e9f4c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:42 user nova-compute[74898]: DEBUG nova.compute.manager [req-63fdd752-3162-4db9-9041-bdbf2c04c282 req-211230e0-bd55-41d7-82cf-ff5a38d85d6b service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Refreshing instance network info cache due to event network-changed-58ede42b-dcc4-45f2-8be6-f1fba65e9f4c. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:04:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-63fdd752-3162-4db9-9041-bdbf2c04c282 req-211230e0-bd55-41d7-82cf-ff5a38d85d6b service nova] Acquiring lock "refresh_cache-b94a0a17-77e9-41cf-9919-37b57b364ff2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:04:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-63fdd752-3162-4db9-9041-bdbf2c04c282 req-211230e0-bd55-41d7-82cf-ff5a38d85d6b service nova] Acquired lock "refresh_cache-b94a0a17-77e9-41cf-9919-37b57b364ff2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:04:42 user nova-compute[74898]: DEBUG nova.network.neutron [req-63fdd752-3162-4db9-9041-bdbf2c04c282 req-211230e0-bd55-41d7-82cf-ff5a38d85d6b service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Refreshing network info cache for port 58ede42b-dcc4-45f2-8be6-f1fba65e9f4c {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:04:42 user nova-compute[74898]: DEBUG nova.network.neutron [req-63fdd752-3162-4db9-9041-bdbf2c04c282 req-211230e0-bd55-41d7-82cf-ff5a38d85d6b service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:04:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:43 user nova-compute[74898]: DEBUG nova.network.neutron [req-63fdd752-3162-4db9-9041-bdbf2c04c282 req-211230e0-bd55-41d7-82cf-ff5a38d85d6b service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:04:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-63fdd752-3162-4db9-9041-bdbf2c04c282 req-211230e0-bd55-41d7-82cf-ff5a38d85d6b service nova] Releasing lock "refresh_cache-b94a0a17-77e9-41cf-9919-37b57b364ff2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:04:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:43 user nova-compute[74898]: DEBUG nova.network.neutron [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Successfully updated port: 704c171d-d5bc-4f60-af76-4b00f98191c6 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:04:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:44 user nova-compute[74898]: DEBUG nova.network.neutron [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Successfully updated port: 178a5871-43af-4e36-9665-07cdd3ecf1d7 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:04:44 user nova-compute[74898]: DEBUG nova.compute.manager [req-e287e03e-52be-4605-b016-a4dbdc3db7df req-18808d56-4622-4417-bd0f-c52b7440b2fe service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Received event network-vif-plugged-5415aaa1-723f-4f35-971c-509caa04575d {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e287e03e-52be-4605-b016-a4dbdc3db7df req-18808d56-4622-4417-bd0f-c52b7440b2fe service nova] Acquiring lock "36e687c0-9481-4126-b365-f7f9707e2338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e287e03e-52be-4605-b016-a4dbdc3db7df req-18808d56-4622-4417-bd0f-c52b7440b2fe service nova] Lock "36e687c0-9481-4126-b365-f7f9707e2338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e287e03e-52be-4605-b016-a4dbdc3db7df req-18808d56-4622-4417-bd0f-c52b7440b2fe service nova] Lock "36e687c0-9481-4126-b365-f7f9707e2338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:44 user nova-compute[74898]: DEBUG nova.compute.manager [req-e287e03e-52be-4605-b016-a4dbdc3db7df req-18808d56-4622-4417-bd0f-c52b7440b2fe service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] No waiting events found dispatching network-vif-plugged-5415aaa1-723f-4f35-971c-509caa04575d {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:04:44 user nova-compute[74898]: WARNING nova.compute.manager [req-e287e03e-52be-4605-b016-a4dbdc3db7df req-18808d56-4622-4417-bd0f-c52b7440b2fe service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Received unexpected event network-vif-plugged-5415aaa1-723f-4f35-971c-509caa04575d for instance with vm_state active and task_state rebuild_spawning.
Nov 17 03:04:44 user nova-compute[74898]: DEBUG nova.compute.manager [req-e287e03e-52be-4605-b016-a4dbdc3db7df req-18808d56-4622-4417-bd0f-c52b7440b2fe service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Received event network-vif-plugged-5415aaa1-723f-4f35-971c-509caa04575d {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e287e03e-52be-4605-b016-a4dbdc3db7df req-18808d56-4622-4417-bd0f-c52b7440b2fe service nova] Acquiring lock "36e687c0-9481-4126-b365-f7f9707e2338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e287e03e-52be-4605-b016-a4dbdc3db7df req-18808d56-4622-4417-bd0f-c52b7440b2fe service nova] Lock "36e687c0-9481-4126-b365-f7f9707e2338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e287e03e-52be-4605-b016-a4dbdc3db7df req-18808d56-4622-4417-bd0f-c52b7440b2fe service nova] Lock "36e687c0-9481-4126-b365-f7f9707e2338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:44 user nova-compute[74898]: DEBUG nova.compute.manager [req-e287e03e-52be-4605-b016-a4dbdc3db7df req-18808d56-4622-4417-bd0f-c52b7440b2fe service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] No waiting events found dispatching network-vif-plugged-5415aaa1-723f-4f35-971c-509caa04575d {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:04:44 user nova-compute[74898]: WARNING nova.compute.manager [req-e287e03e-52be-4605-b016-a4dbdc3db7df req-18808d56-4622-4417-bd0f-c52b7440b2fe service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Received unexpected event network-vif-plugged-5415aaa1-723f-4f35-971c-509caa04575d for instance with vm_state active and task_state rebuild_spawning.
Nov 17 03:04:44 user nova-compute[74898]: DEBUG nova.compute.manager [req-e287e03e-52be-4605-b016-a4dbdc3db7df req-18808d56-4622-4417-bd0f-c52b7440b2fe service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-changed-704c171d-d5bc-4f60-af76-4b00f98191c6 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:44 user nova-compute[74898]: DEBUG nova.compute.manager [req-e287e03e-52be-4605-b016-a4dbdc3db7df req-18808d56-4622-4417-bd0f-c52b7440b2fe service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Refreshing instance network info cache due to event network-changed-704c171d-d5bc-4f60-af76-4b00f98191c6. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:04:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e287e03e-52be-4605-b016-a4dbdc3db7df req-18808d56-4622-4417-bd0f-c52b7440b2fe service nova] Acquiring lock "refresh_cache-b94a0a17-77e9-41cf-9919-37b57b364ff2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:04:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e287e03e-52be-4605-b016-a4dbdc3db7df req-18808d56-4622-4417-bd0f-c52b7440b2fe service nova] Acquired lock "refresh_cache-b94a0a17-77e9-41cf-9919-37b57b364ff2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:04:44 user nova-compute[74898]: DEBUG nova.network.neutron [req-e287e03e-52be-4605-b016-a4dbdc3db7df req-18808d56-4622-4417-bd0f-c52b7440b2fe service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Refreshing network info cache for port 704c171d-d5bc-4f60-af76-4b00f98191c6 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:04:44 user nova-compute[74898]: DEBUG nova.network.neutron [req-e287e03e-52be-4605-b016-a4dbdc3db7df req-18808d56-4622-4417-bd0f-c52b7440b2fe service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG nova.network.neutron [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Successfully updated port: 857da07e-b7c7-4bb9-805a-8c9a7d30d6bf {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG nova.network.neutron [req-e287e03e-52be-4605-b016-a4dbdc3db7df req-18808d56-4622-4417-bd0f-c52b7440b2fe service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e287e03e-52be-4605-b016-a4dbdc3db7df req-18808d56-4622-4417-bd0f-c52b7440b2fe service nova] Releasing lock "refresh_cache-b94a0a17-77e9-41cf-9919-37b57b364ff2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG nova.compute.manager [req-e287e03e-52be-4605-b016-a4dbdc3db7df req-18808d56-4622-4417-bd0f-c52b7440b2fe service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-changed-178a5871-43af-4e36-9665-07cdd3ecf1d7 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG nova.compute.manager [req-e287e03e-52be-4605-b016-a4dbdc3db7df req-18808d56-4622-4417-bd0f-c52b7440b2fe service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Refreshing instance network info cache due to event network-changed-178a5871-43af-4e36-9665-07cdd3ecf1d7. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e287e03e-52be-4605-b016-a4dbdc3db7df req-18808d56-4622-4417-bd0f-c52b7440b2fe service nova] Acquiring lock "refresh_cache-b94a0a17-77e9-41cf-9919-37b57b364ff2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e287e03e-52be-4605-b016-a4dbdc3db7df req-18808d56-4622-4417-bd0f-c52b7440b2fe service nova] Acquired lock "refresh_cache-b94a0a17-77e9-41cf-9919-37b57b364ff2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG nova.network.neutron [req-e287e03e-52be-4605-b016-a4dbdc3db7df req-18808d56-4622-4417-bd0f-c52b7440b2fe service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Refreshing network info cache for port 178a5871-43af-4e36-9665-07cdd3ecf1d7 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG nova.network.neutron [req-e287e03e-52be-4605-b016-a4dbdc3db7df req-18808d56-4622-4417-bd0f-c52b7440b2fe service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG nova.compute.manager [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:04:45 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Instance spawned successfully.
Nov 17 03:04:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG nova.compute.manager [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG nova.network.neutron [req-e287e03e-52be-4605-b016-a4dbdc3db7df req-18808d56-4622-4417-bd0f-c52b7440b2fe service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:04:45 user nova-compute[74898]: INFO nova.virt.block_device [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Booting with volume 3f795638-f9a2-4bfc-afb7-416e6274b484 at /dev/vdb
Nov 17 03:04:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e287e03e-52be-4605-b016-a4dbdc3db7df req-18808d56-4622-4417-bd0f-c52b7440b2fe service nova] Releasing lock "refresh_cache-b94a0a17-77e9-41cf-9919-37b57b364ff2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG nova.objects.instance [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74898) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG os_brick.utils [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf9eec4-6688-45b9-b7f2-4c3f74c63361]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf8304c-bd95-429a-b832-6f86c016b96f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[91378403-925d-47c1-860b-7d25f4e0239d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a090ca1-3439-457b-93d8-4ef21c5a15d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-159aaf3f-d9bb-4463-b194-9ac337386f29 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.128s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:04:45 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:04:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bfb491-17f7-4dc2-98b7-ffecf2f4f312]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG os_brick.utils [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Updating existing volume attachment record: c0e11a48-700c-4eba-8b03-51c52e18977a {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:45 user nova-compute[74898]: DEBUG nova.network.neutron [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Successfully updated port: 86a69795-c167-4353-b46e-0137384a0af5 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:04:46 user nova-compute[74898]: DEBUG nova.network.neutron [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Successfully updated port: 189360e5-7bc0-4711-8069-8939c57a28d7 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:04:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:46 user nova-compute[74898]: DEBUG nova.compute.manager [req-ffa9b58b-6946-4598-90ef-c078e5112add req-5776c341-48bb-4bad-bdf0-cacdf59d329a service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-changed-857da07e-b7c7-4bb9-805a-8c9a7d30d6bf {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:46 user nova-compute[74898]: DEBUG nova.compute.manager [req-ffa9b58b-6946-4598-90ef-c078e5112add req-5776c341-48bb-4bad-bdf0-cacdf59d329a service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Refreshing instance network info cache due to event network-changed-857da07e-b7c7-4bb9-805a-8c9a7d30d6bf. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:04:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ffa9b58b-6946-4598-90ef-c078e5112add req-5776c341-48bb-4bad-bdf0-cacdf59d329a service nova] Acquiring lock "refresh_cache-b94a0a17-77e9-41cf-9919-37b57b364ff2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:04:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ffa9b58b-6946-4598-90ef-c078e5112add req-5776c341-48bb-4bad-bdf0-cacdf59d329a service nova] Acquired lock "refresh_cache-b94a0a17-77e9-41cf-9919-37b57b364ff2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:04:46 user nova-compute[74898]: DEBUG nova.network.neutron [req-ffa9b58b-6946-4598-90ef-c078e5112add req-5776c341-48bb-4bad-bdf0-cacdf59d329a service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Refreshing network info cache for port 857da07e-b7c7-4bb9-805a-8c9a7d30d6bf {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:04:46 user nova-compute[74898]: DEBUG nova.network.neutron [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Successfully updated port: 0559955f-ea89-4f72-93dd-22b0df42e380 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:04:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Acquiring lock "refresh_cache-b94a0a17-77e9-41cf-9919-37b57b364ff2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:04:47 user nova-compute[74898]: DEBUG nova.network.neutron [req-ffa9b58b-6946-4598-90ef-c078e5112add req-5776c341-48bb-4bad-bdf0-cacdf59d329a service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:04:47 user nova-compute[74898]: DEBUG nova.network.neutron [req-ffa9b58b-6946-4598-90ef-c078e5112add req-5776c341-48bb-4bad-bdf0-cacdf59d329a service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:04:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ffa9b58b-6946-4598-90ef-c078e5112add req-5776c341-48bb-4bad-bdf0-cacdf59d329a service nova] Releasing lock "refresh_cache-b94a0a17-77e9-41cf-9919-37b57b364ff2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:04:47 user nova-compute[74898]: DEBUG nova.compute.manager [req-ffa9b58b-6946-4598-90ef-c078e5112add req-5776c341-48bb-4bad-bdf0-cacdf59d329a service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-changed-86a69795-c167-4353-b46e-0137384a0af5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:47 user nova-compute[74898]: DEBUG nova.compute.manager [req-ffa9b58b-6946-4598-90ef-c078e5112add req-5776c341-48bb-4bad-bdf0-cacdf59d329a service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Refreshing instance network info cache due to event network-changed-86a69795-c167-4353-b46e-0137384a0af5. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:04:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ffa9b58b-6946-4598-90ef-c078e5112add req-5776c341-48bb-4bad-bdf0-cacdf59d329a service nova] Acquiring lock "refresh_cache-b94a0a17-77e9-41cf-9919-37b57b364ff2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:04:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ffa9b58b-6946-4598-90ef-c078e5112add req-5776c341-48bb-4bad-bdf0-cacdf59d329a service nova] Acquired lock "refresh_cache-b94a0a17-77e9-41cf-9919-37b57b364ff2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:04:47 user nova-compute[74898]: DEBUG nova.network.neutron [req-ffa9b58b-6946-4598-90ef-c078e5112add req-5776c341-48bb-4bad-bdf0-cacdf59d329a service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Refreshing network info cache for port 86a69795-c167-4353-b46e-0137384a0af5 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:04:47 user nova-compute[74898]: DEBUG nova.network.neutron [req-ffa9b58b-6946-4598-90ef-c078e5112add req-5776c341-48bb-4bad-bdf0-cacdf59d329a service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:04:47 user nova-compute[74898]: DEBUG nova.network.neutron [req-ffa9b58b-6946-4598-90ef-c078e5112add req-5776c341-48bb-4bad-bdf0-cacdf59d329a service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:04:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ffa9b58b-6946-4598-90ef-c078e5112add req-5776c341-48bb-4bad-bdf0-cacdf59d329a service nova] Releasing lock "refresh_cache-b94a0a17-77e9-41cf-9919-37b57b364ff2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:04:47 user nova-compute[74898]: DEBUG nova.compute.manager [req-ffa9b58b-6946-4598-90ef-c078e5112add req-5776c341-48bb-4bad-bdf0-cacdf59d329a service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-changed-189360e5-7bc0-4711-8069-8939c57a28d7 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:47 user nova-compute[74898]: DEBUG nova.compute.manager [req-ffa9b58b-6946-4598-90ef-c078e5112add req-5776c341-48bb-4bad-bdf0-cacdf59d329a service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Refreshing instance network info cache due to event network-changed-189360e5-7bc0-4711-8069-8939c57a28d7. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:04:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ffa9b58b-6946-4598-90ef-c078e5112add req-5776c341-48bb-4bad-bdf0-cacdf59d329a service nova] Acquiring lock "refresh_cache-b94a0a17-77e9-41cf-9919-37b57b364ff2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:04:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ffa9b58b-6946-4598-90ef-c078e5112add req-5776c341-48bb-4bad-bdf0-cacdf59d329a service nova] Acquired lock "refresh_cache-b94a0a17-77e9-41cf-9919-37b57b364ff2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:04:47 user nova-compute[74898]: DEBUG nova.network.neutron [req-ffa9b58b-6946-4598-90ef-c078e5112add req-5776c341-48bb-4bad-bdf0-cacdf59d329a service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Refreshing network info cache for port 189360e5-7bc0-4711-8069-8939c57a28d7 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:04:47 user nova-compute[74898]: DEBUG nova.network.neutron [req-ffa9b58b-6946-4598-90ef-c078e5112add req-5776c341-48bb-4bad-bdf0-cacdf59d329a service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:04:47 user nova-compute[74898]: DEBUG nova.network.neutron [req-ffa9b58b-6946-4598-90ef-c078e5112add req-5776c341-48bb-4bad-bdf0-cacdf59d329a service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:04:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ffa9b58b-6946-4598-90ef-c078e5112add req-5776c341-48bb-4bad-bdf0-cacdf59d329a service nova] Releasing lock "refresh_cache-b94a0a17-77e9-41cf-9919-37b57b364ff2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:04:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Acquired lock "refresh_cache-b94a0a17-77e9-41cf-9919-37b57b364ff2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:04:47 user nova-compute[74898]: DEBUG nova.network.neutron [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:04:48 user nova-compute[74898]: DEBUG nova.network.neutron [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:04:49 user nova-compute[74898]: DEBUG nova.compute.manager [req-606af965-96b1-486f-9dd4-42987eca4499 req-dd06e671-501d-44d3-a379-5ec0d626c59b service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-changed-0559955f-ea89-4f72-93dd-22b0df42e380 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:49 user nova-compute[74898]: DEBUG nova.compute.manager [req-606af965-96b1-486f-9dd4-42987eca4499 req-dd06e671-501d-44d3-a379-5ec0d626c59b service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Refreshing instance network info cache due to event network-changed-0559955f-ea89-4f72-93dd-22b0df42e380. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:04:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-606af965-96b1-486f-9dd4-42987eca4499 req-dd06e671-501d-44d3-a379-5ec0d626c59b service nova] Acquiring lock "refresh_cache-b94a0a17-77e9-41cf-9919-37b57b364ff2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:04:49 user nova-compute[74898]: DEBUG nova.network.neutron [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Updating instance_info_cache with network_info: [{"id": "58ede42b-dcc4-45f2-8be6-f1fba65e9f4c", "address": "fa:16:3e:26:35:f5", "network": {"id": "2e9858af-0eb1-4e7c-bd29-7238d7eb070e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1878259197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ede42b-dc", "ovs_interfaceid": "58ede42b-dcc4-45f2-8be6-f1fba65e9f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "704c171d-d5bc-4f60-af76-4b00f98191c6", "address": "fa:16:3e:d8:69:fc", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704c171d-d5", "ovs_interfaceid": "704c171d-d5bc-4f60-af76-4b00f98191c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "178a5871-43af-4e36-9665-07cdd3ecf1d7", "address": "fa:16:3e:f6:ff:91", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178a5871-43", "ovs_interfaceid": "178a5871-43af-4e36-9665-07cdd3ecf1d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "857da07e-b7c7-4bb9-805a-8c9a7d30d6bf", "address": "fa:16:3e:e1:48:b9", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap857da07e-b7", "ovs_interfaceid": "857da07e-b7c7-4bb9-805a-8c9a7d30d6bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86a69795-c167-4353-b46e-0137384a0af5", "address": "fa:16:3e:8b:e1:c7", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a69795-c1", "ovs_interfaceid": "86a69795-c167-4353-b46e-0137384a0af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "189360e5-7bc0-4711-8069-8939c57a28d7", "address": "fa:16:3e:45:f0:2c", "network": {"id": "0e992b1f-b626-47b5-b861-9b1420f22a3d", "bridge": "br-int", "label": "tempest-device-tagging-net2-855379110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189360e5-7b", "ovs_interfaceid": "189360e5-7bc0-4711-8069-8939c57a28d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0559955f-ea89-4f72-93dd-22b0df42e380", "address": "fa:16:3e:cb:58:f5", "network": {"id": "0e992b1f-b626-47b5-b861-9b1420f22a3d", "bridge": "br-int", "label": "tempest-device-tagging-net2-855379110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0559955f-ea", "ovs_interfaceid": "0559955f-ea89-4f72-93dd-22b0df42e380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:04:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Releasing lock "refresh_cache-b94a0a17-77e9-41cf-9919-37b57b364ff2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:04:49 user nova-compute[74898]: DEBUG nova.compute.manager [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Instance network_info: |[{"id": "58ede42b-dcc4-45f2-8be6-f1fba65e9f4c", "address": "fa:16:3e:26:35:f5", "network": {"id": "2e9858af-0eb1-4e7c-bd29-7238d7eb070e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1878259197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ede42b-dc", "ovs_interfaceid": "58ede42b-dcc4-45f2-8be6-f1fba65e9f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "704c171d-d5bc-4f60-af76-4b00f98191c6", "address": "fa:16:3e:d8:69:fc", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704c171d-d5", "ovs_interfaceid": "704c171d-d5bc-4f60-af76-4b00f98191c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "178a5871-43af-4e36-9665-07cdd3ecf1d7", "address": "fa:16:3e:f6:ff:91", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178a5871-43", "ovs_interfaceid": "178a5871-43af-4e36-9665-07cdd3ecf1d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "857da07e-b7c7-4bb9-805a-8c9a7d30d6bf", "address": "fa:16:3e:e1:48:b9", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap857da07e-b7", "ovs_interfaceid": "857da07e-b7c7-4bb9-805a-8c9a7d30d6bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86a69795-c167-4353-b46e-0137384a0af5", "address": "fa:16:3e:8b:e1:c7", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a69795-c1", "ovs_interfaceid": "86a69795-c167-4353-b46e-0137384a0af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "189360e5-7bc0-4711-8069-8939c57a28d7", "address": "fa:16:3e:45:f0:2c", "network": {"id": "0e992b1f-b626-47b5-b861-9b1420f22a3d", "bridge": "br-int", "label": "tempest-device-tagging-net2-855379110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189360e5-7b", "ovs_interfaceid": "189360e5-7bc0-4711-8069-8939c57a28d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0559955f-ea89-4f72-93dd-22b0df42e380", "address": "fa:16:3e:cb:58:f5", "network": {"id": "0e992b1f-b626-47b5-b861-9b1420f22a3d", "bridge": "br-int", "label": "tempest-device-tagging-net2-855379110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0559955f-ea", "ovs_interfaceid": "0559955f-ea89-4f72-93dd-22b0df42e380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:04:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-606af965-96b1-486f-9dd4-42987eca4499 req-dd06e671-501d-44d3-a379-5ec0d626c59b service nova] Acquired lock "refresh_cache-b94a0a17-77e9-41cf-9919-37b57b364ff2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:04:49 user nova-compute[74898]: DEBUG nova.network.neutron [req-606af965-96b1-486f-9dd4-42987eca4499 req-dd06e671-501d-44d3-a379-5ec0d626c59b service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Refreshing network info cache for port 0559955f-ea89-4f72-93dd-22b0df42e380 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:04:50 user nova-compute[74898]: DEBUG nova.network.neutron [req-606af965-96b1-486f-9dd4-42987eca4499 req-dd06e671-501d-44d3-a379-5ec0d626c59b service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Updated VIF entry in instance network info cache for port 0559955f-ea89-4f72-93dd-22b0df42e380. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:04:50 user nova-compute[74898]: DEBUG nova.network.neutron [req-606af965-96b1-486f-9dd4-42987eca4499 req-dd06e671-501d-44d3-a379-5ec0d626c59b service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Updating instance_info_cache with network_info: [{"id": "58ede42b-dcc4-45f2-8be6-f1fba65e9f4c", "address": "fa:16:3e:26:35:f5", "network": {"id": "2e9858af-0eb1-4e7c-bd29-7238d7eb070e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1878259197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ede42b-dc", "ovs_interfaceid": "58ede42b-dcc4-45f2-8be6-f1fba65e9f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "704c171d-d5bc-4f60-af76-4b00f98191c6", "address": "fa:16:3e:d8:69:fc", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704c171d-d5", "ovs_interfaceid": "704c171d-d5bc-4f60-af76-4b00f98191c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "178a5871-43af-4e36-9665-07cdd3ecf1d7", "address": "fa:16:3e:f6:ff:91", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178a5871-43", "ovs_interfaceid": "178a5871-43af-4e36-9665-07cdd3ecf1d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "857da07e-b7c7-4bb9-805a-8c9a7d30d6bf", "address": "fa:16:3e:e1:48:b9", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap857da07e-b7", "ovs_interfaceid": "857da07e-b7c7-4bb9-805a-8c9a7d30d6bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86a69795-c167-4353-b46e-0137384a0af5", "address": "fa:16:3e:8b:e1:c7", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a69795-c1", "ovs_interfaceid": "86a69795-c167-4353-b46e-0137384a0af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "189360e5-7bc0-4711-8069-8939c57a28d7", "address": "fa:16:3e:45:f0:2c", "network": {"id": "0e992b1f-b626-47b5-b861-9b1420f22a3d", "bridge": "br-int", "label": "tempest-device-tagging-net2-855379110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189360e5-7b", "ovs_interfaceid": "189360e5-7bc0-4711-8069-8939c57a28d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0559955f-ea89-4f72-93dd-22b0df42e380", "address": "fa:16:3e:cb:58:f5", "network": {"id": "0e992b1f-b626-47b5-b861-9b1420f22a3d", "bridge": "br-int", "label": "tempest-device-tagging-net2-855379110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0559955f-ea", "ovs_interfaceid": "0559955f-ea89-4f72-93dd-22b0df42e380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:04:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-606af965-96b1-486f-9dd4-42987eca4499 req-dd06e671-501d-44d3-a379-5ec0d626c59b service nova] Releasing lock "refresh_cache-b94a0a17-77e9-41cf-9919-37b57b364ff2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:04:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:51 user nova-compute[74898]: INFO nova.virt.block_device [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Booting with volume 4d87f49d-4f84-4e40-a806-f8c534350981 at /dev/vdc
Nov 17 03:04:51 user nova-compute[74898]: DEBUG os_brick.utils [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:04:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3636396d-cb8a-4018-a832-ad6eb38bc422]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b07d931-7ec0-4155-80b0-89f455412f30]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[676a1649-bdbd-4997-b123-701c849f4a23]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45fbc34-c730-4510-8c5c-f134cfdf30ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:04:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:04:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:04:51 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:04:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[649edb27-ae71-4e7d-b72c-3af00c4a75e4]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:04:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:04:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:04:51 user nova-compute[74898]: DEBUG os_brick.utils [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:04:51 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Updating existing volume attachment record: e4a0cb3c-650d-49e8-8c4e-9789b6ec1987 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:04:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG nova.compute.manager [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:04:57 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Creating image(s)
Nov 17 03:04:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Did not create local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Ensure instance console log exists: /opt/stack/data/nova/instances/b94a0a17-77e9-41cf-9919-37b57b364ff2/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Start _get_guest_xml network_info=[{"id": "58ede42b-dcc4-45f2-8be6-f1fba65e9f4c", "address": "fa:16:3e:26:35:f5", "network": {"id": "2e9858af-0eb1-4e7c-bd29-7238d7eb070e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1878259197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ede42b-dc", "ovs_interfaceid": "58ede42b-dcc4-45f2-8be6-f1fba65e9f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "704c171d-d5bc-4f60-af76-4b00f98191c6", "address": "fa:16:3e:d8:69:fc", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704c171d-d5", "ovs_interfaceid": "704c171d-d5bc-4f60-af76-4b00f98191c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "178a5871-43af-4e36-9665-07cdd3ecf1d7", "address": "fa:16:3e:f6:ff:91", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178a5871-43", "ovs_interfaceid": "178a5871-43af-4e36-9665-07cdd3ecf1d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "857da07e-b7c7-4bb9-805a-8c9a7d30d6bf", "address": "fa:16:3e:e1:48:b9", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap857da07e-b7", "ovs_interfaceid": "857da07e-b7c7-4bb9-805a-8c9a7d30d6bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86a69795-c167-4353-b46e-0137384a0af5", "address": "fa:16:3e:8b:e1:c7", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a69795-c1", "ovs_interfaceid": "86a69795-c167-4353-b46e-0137384a0af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "189360e5-7bc0-4711-8069-8939c57a28d7", "address": "fa:16:3e:45:f0:2c", "network": {"id": "0e992b1f-b626-47b5-b861-9b1420f22a3d", "bridge": "br-int", "label": "tempest-device-tagging-net2-855379110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189360e5-7b", "ovs_interfaceid": "189360e5-7bc0-4711-8069-8939c57a28d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0559955f-ea89-4f72-93dd-22b0df42e380", "address": "fa:16:3e:cb:58:f5", "network": {"id": "0e992b1f-b626-47b5-b861-9b1420f22a3d", "bridge": "br-int", "label": "tempest-device-tagging-net2-855379110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0559955f-ea", "ovs_interfaceid": "0559955f-ea89-4f72-93dd-22b0df42e380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SvfAsLhz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b94a0a17-77e9-41cf-9919-37b57b364ff2', 'attached_at': '', 'detached_at': '', 'volume_id': '59c7c3e8-f2e8-471c-8a4a-75bcd771c248', 'serial': '59c7c3e8-f2e8-471c-8a4a-75bcd771c248'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '6afbb732-e0f4-41d9-9bd8-75b532906732', 'volume_type': None}, {'boot_index': 1, 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZkFQSWyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b94a0a17-77e9-41cf-9919-37b57b364ff2', 'attached_at': '', 'detached_at': '', 'volume_id': '3f795638-f9a2-4bfc-afb7-416e6274b484', 'serial': '3f795638-f9a2-4bfc-afb7-416e6274b484'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'c0e11a48-700c-4eba-8b03-51c52e18977a', 'volume_type': None}, {'boot_index': 2, 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBZpwrLx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b94a0a17-77e9-41cf-9919-37b57b364ff2', 'attached_at': '', 'detached_at': '', 'volume_id': '4d87f49d-4f84-4e40-a806-f8c534350981', 'serial': '4d87f49d-4f84-4e40-a806-f8c534350981'}, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'e4a0cb3c-650d-49e8-8c4e-9789b6ec1987', 'volume_type': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:04:57 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:04:57 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:04:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SvfAsLhz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:04:57 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:04:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:04:57 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:04:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:04:57 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c045b0-63e0-423d-bc62-fd7f23961b1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:04:57 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f0c879-e51c-4735-81ff-ad06b3bb4d8c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248] added
Nov 17 03:04:57 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c059fbc6-e6dc-41f3-868b-0bf7891273bf]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca46ea89-b12a-466f-bf7f-fe583ebc698e]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SvfAsLhz {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SvfAsLhz" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fbdbfb-b10d-4edf-a01c-e81f3c0eb14c]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SvfAsLhz'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7858745-a5a5-4e3a-8404-45ba4586f622]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8242900-eaf4-4585-9743-7740fb2f729f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:04:57 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:04:57 user nova-compute[74898]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:04:57 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:04:57 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:04:57 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:04:57 user nova-compute[74898]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:04:57 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:04:57 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ee23ef-a2f9-469d-9272-d4463a3bc511]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248, portal: 172.16.0.220,3260]
Nov 17 03:04:57 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248, portal: 172.16.0.220,3260] successful.
Nov 17 03:04:57 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef383bc2-72cb-4373-a857-49bd6b01d822]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71536bb-6b39-4fdb-94a2-a118155a81d6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:04:57 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:04:57 user nova-compute[74898]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:04:57 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:04:57 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:04:57 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:04:57 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:04:57 user nova-compute[74898]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:04:57 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:04:57 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:04:57 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28e652b-d911-4ad7-9483-bb50c967a7a9]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:04:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SvfAsLhz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:04:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:04:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26261346638373662', 'path': '/dev/sdc'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:04:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261346638373662', 'path': '/dev/sdc'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:04:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:04:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZkFQSWyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:04:58 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:04:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:04:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:04:58 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:04:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:04:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:04:58 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:04:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5e8f80-748a-4c72-b175-d41d0956fcbf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:04:58 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:04:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d332037f-138b-48a2-beb2-a62ca7778604]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484] added
Nov 17 03:04:58 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:04:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db3898f-f3a3-4a8b-8189-fa6ac99fec14]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:04:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e30a855-a209-47d3-94a1-1451fbb95b17]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:04:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZkFQSWyw {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZkFQSWyw" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[92741ce4-ed79-40d5-819d-91b052027764]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZkFQSWyw'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:04:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0543e449-1a3e-48e3-87ae-e1176916d69f]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f8e069-a916-4b6f-bc22-c9d278ec33bc]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:04:59 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:04:59 user nova-compute[74898]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:04:59 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:04:59 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:04:59 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:04:59 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:04:59 user nova-compute[74898]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:04:59 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:04:59 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:04:59 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ef2038-748e-438e-89cc-8cd58022289b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484, portal: 172.16.0.220,3260]
Nov 17 03:04:59 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484, portal: 172.16.0.220,3260] successful.
Nov 17 03:04:59 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4142f1d7-a3dd-46f3-9782-47c7763bc207]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c27945-1c64-41e3-b009-aed71164a9a8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:04:59 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:04:59 user nova-compute[74898]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:04:59 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:04:59 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:04:59 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:04:59 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:04:59 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:04:59 user nova-compute[74898]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:04:59 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:04:59 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:04:59 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:04:59 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] HCTL ('38', '-', '-', 0) found on session 21 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b723946-bc1b-4c14-af30-bbe19316abde]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Searching for a device in session 21 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZkFQSWyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-cf1bb69d-dcce-4a4a-bab3-82bd2266078f req-3a3dbc89-8584-4b27-8ca2-8b136ed71389 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Received event network-changed-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-cf1bb69d-dcce-4a4a-bab3-82bd2266078f req-3a3dbc89-8584-4b27-8ca2-8b136ed71389 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Refreshing instance network info cache due to event network-changed-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-cf1bb69d-dcce-4a4a-bab3-82bd2266078f req-3a3dbc89-8584-4b27-8ca2-8b136ed71389 service nova] Acquiring lock "refresh_cache-d1ee03a5-13fb-47e7-8712-ea31aed36643" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-cf1bb69d-dcce-4a4a-bab3-82bd2266078f req-3a3dbc89-8584-4b27-8ca2-8b136ed71389 service nova] Acquired lock "refresh_cache-d1ee03a5-13fb-47e7-8712-ea31aed36643" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG nova.network.neutron [req-cf1bb69d-dcce-4a4a-bab3-82bd2266078f req-3a3dbc89-8584-4b27-8ca2-8b136ed71389 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Refreshing network info cache for port 4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG nova.network.neutron [req-cf1bb69d-dcce-4a4a-bab3-82bd2266078f req-3a3dbc89-8584-4b27-8ca2-8b136ed71389 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Updated VIF entry in instance network info cache for port 4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG nova.network.neutron [req-cf1bb69d-dcce-4a4a-bab3-82bd2266078f req-3a3dbc89-8584-4b27-8ca2-8b136ed71389 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Updating instance_info_cache with network_info: [{"id": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "address": "fa:16:3e:46:e0:47", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cfbdbfd-83", "ovs_interfaceid": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:04:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-cf1bb69d-dcce-4a4a-bab3-82bd2266078f req-3a3dbc89-8584-4b27-8ca2-8b136ed71389 service nova] Releasing lock "refresh_cache-d1ee03a5-13fb-47e7-8712-ea31aed36643" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26631343839303832', 'path': '/dev/sdg'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631343839303832', 'path': '/dev/sdg'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBZpwrLx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:05:00 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:05:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:05:00 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:05:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:05:00 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d358679-94ec-4f60-a6d4-26d1529ac8cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:05:00 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[778e74d0-edcc-4378-96bf-9a8b1f9a754c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981] added
Nov 17 03:05:00 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG nova.compute.manager [req-b7430ea9-33f8-4ff5-b841-c593ebded864 req-67e5f373-c861-44f7-8448-3f62cdebd9bf service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Received event network-changed-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG nova.compute.manager [req-b7430ea9-33f8-4ff5-b841-c593ebded864 req-67e5f373-c861-44f7-8448-3f62cdebd9bf service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Refreshing instance network info cache due to event network-changed-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b7430ea9-33f8-4ff5-b841-c593ebded864 req-67e5f373-c861-44f7-8448-3f62cdebd9bf service nova] Acquiring lock "refresh_cache-d1ee03a5-13fb-47e7-8712-ea31aed36643" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b7430ea9-33f8-4ff5-b841-c593ebded864 req-67e5f373-c861-44f7-8448-3f62cdebd9bf service nova] Acquired lock "refresh_cache-d1ee03a5-13fb-47e7-8712-ea31aed36643" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG nova.network.neutron [req-b7430ea9-33f8-4ff5-b841-c593ebded864 req-67e5f373-c861-44f7-8448-3f62cdebd9bf service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Refreshing network info cache for port 4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d001368-40ab-4460-9fe7-b153c4dd30ce]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.068s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c168f5-fc18-4509-8732-d5f1e91d6c63]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zBZpwrLx {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zBZpwrLx" returned: 0 in 0.170s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77ea4c1-30ab-42bb-8c3b-bfe84c5f9218]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zBZpwrLx'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "d1ee03a5-13fb-47e7-8712-ea31aed36643" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "d1ee03a5-13fb-47e7-8712-ea31aed36643" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:00 user nova-compute[74898]: INFO nova.compute.manager [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Detaching volume 441761f8-0044-43bc-8437-f31147d6c4f8
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[027da595-1916-456f-ad23-50af0ebf3709]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3540bc3e-b3e3-498e-8b08-349eda20ec88]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:05:00 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:05:00 user nova-compute[74898]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:05:00 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:05:00 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:05:00 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:05:00 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:05:00 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:05:00 user nova-compute[74898]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:05:00 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:05:00 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:05:00 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:05:00 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:00 user nova-compute[74898]: INFO nova.virt.block_device [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Attempting to driver detach volume 441761f8-0044-43bc-8437-f31147d6c4f8 from mountpoint /dev/vdb
Nov 17 03:05:00 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Attempting to detach device vdb from instance d1ee03a5-13fb-47e7-8712-ea31aed36643 from the persistent domain config. {{(pid=74898) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:05:00 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:05:00 user nova-compute[74898]:   <source dev="/dev/sde"/>
Nov 17 03:05:00 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:05:00 user nova-compute[74898]:   <serial>441761f8-0044-43bc-8437-f31147d6c4f8</serial>
Nov 17 03:05:00 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 17 03:05:00 user nova-compute[74898]: </disk>
Nov 17 03:05:00 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:05:00 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Successfully detached device vdb from instance d1ee03a5-13fb-47e7-8712-ea31aed36643 from the persistent domain config.
Nov 17 03:05:00 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d1ee03a5-13fb-47e7-8712-ea31aed36643 from the live domain config. {{(pid=74898) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:05:00 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:05:00 user nova-compute[74898]:   <source dev="/dev/sde"/>
Nov 17 03:05:00 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:05:00 user nova-compute[74898]:   <serial>441761f8-0044-43bc-8437-f31147d6c4f8</serial>
Nov 17 03:05:00 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 17 03:05:00 user nova-compute[74898]: </disk>
Nov 17 03:05:00 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG nova.network.neutron [req-b7430ea9-33f8-4ff5-b841-c593ebded864 req-67e5f373-c861-44f7-8448-3f62cdebd9bf service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Updated VIF entry in instance network info cache for port 4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG nova.network.neutron [req-b7430ea9-33f8-4ff5-b841-c593ebded864 req-67e5f373-c861-44f7-8448-3f62cdebd9bf service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Updating instance_info_cache with network_info: [{"id": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "address": "fa:16:3e:46:e0:47", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cfbdbfd-83", "ovs_interfaceid": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa05571-a6cb-46c0-8bbd-415a327cfcb5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981, portal: 172.16.0.220,3260]
Nov 17 03:05:00 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981, portal: 172.16.0.220,3260] successful.
Nov 17 03:05:00 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b7430ea9-33f8-4ff5-b841-c593ebded864 req-67e5f373-c861-44f7-8448-3f62cdebd9bf service nova] Releasing lock "refresh_cache-d1ee03a5-13fb-47e7-8712-ea31aed36643" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fd04dd-93a9-489c-9898-67fa2f2356e3]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b334130-0614-44e2-ba3a-982c94eb6861]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:05:00 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:05:00 user nova-compute[74898]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:05:00 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:05:00 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:05:00 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:05:00 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:05:00 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:05:00 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:05:00 user nova-compute[74898]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:05:00 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:05:00 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:05:00 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:05:00 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:05:00 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.547s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] HCTL ('39', '-', '-', 0) found on session 22 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf288b4-d7e8-4fe2-b392-3f97d4b623d9]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Searching for a device in session 22 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:05:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBZpwrLx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d1ee03a5-13fb-47e7-8712-ea31aed36643 {{(pid=74898) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.581s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] <== connect_volume: return (1583ms) {'type': 'block', 'scsi_wwn': '23034333761656335', 'path': '/dev/sdh'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034333761656335', 'path': '/dev/sdh'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778206541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1778206541',id=18,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyGmJYYbvr3QyeCIw1kBCEDSS3NCSiXW2VlUSJ3BJlyvfl1x3dvUE6dFKqzhvQizyxSx5x1rl4z0TjriBVD80sj4GqrlXMNMQraj8GWH5vb9kWh+w6HjvRfrn66x/EO9g==',key_name='tempest-keypair-530835063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67b8bb76f54b4f5fa95f603550c269dd',ramdisk_id='',reservation_id='r-fz50cvhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1244088613',owner_user_name='tempest-TaggedBootDevicesTest_v242-1244088613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:04:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bedf3f8df3e946b88a32ce4c78ee358c',uuid=b94a0a17-77e9-41cf-9919-37b57b364ff2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58ede42b-dcc4-45f2-8be6-f1fba65e9f4c", "address": "fa:16:3e:26:35:f5", "network": {"id": "2e9858af-0eb1-4e7c-bd29-7238d7eb070e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1878259197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ede42b-dc", "ovs_interfaceid": "58ede42b-dcc4-45f2-8be6-f1fba65e9f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converting VIF {"id": "58ede42b-dcc4-45f2-8be6-f1fba65e9f4c", "address": "fa:16:3e:26:35:f5", "network": {"id": "2e9858af-0eb1-4e7c-bd29-7238d7eb070e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1878259197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ede42b-dc", "ovs_interfaceid": "58ede42b-dcc4-45f2-8be6-f1fba65e9f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:35:f5,bridge_name='br-int',has_traffic_filtering=True,id=58ede42b-dcc4-45f2-8be6-f1fba65e9f4c,network=Network(2e9858af-0eb1-4e7c-bd29-7238d7eb070e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ede42b-dc') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778206541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1778206541',id=18,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyGmJYYbvr3QyeCIw1kBCEDSS3NCSiXW2VlUSJ3BJlyvfl1x3dvUE6dFKqzhvQizyxSx5x1rl4z0TjriBVD80sj4GqrlXMNMQraj8GWH5vb9kWh+w6HjvRfrn66x/EO9g==',key_name='tempest-keypair-530835063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67b8bb76f54b4f5fa95f603550c269dd',ramdisk_id='',reservation_id='r-fz50cvhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1244088613',owner_user_name='tempest-TaggedBootDevicesTest_v242-1244088613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:04:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bedf3f8df3e946b88a32ce4c78ee358c',uuid=b94a0a17-77e9-41cf-9919-37b57b364ff2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "704c171d-d5bc-4f60-af76-4b00f98191c6", "address": "fa:16:3e:d8:69:fc", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704c171d-d5", "ovs_interfaceid": "704c171d-d5bc-4f60-af76-4b00f98191c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converting VIF {"id": "704c171d-d5bc-4f60-af76-4b00f98191c6", "address": "fa:16:3e:d8:69:fc", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704c171d-d5", "ovs_interfaceid": "704c171d-d5bc-4f60-af76-4b00f98191c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:69:fc,bridge_name='br-int',has_traffic_filtering=True,id=704c171d-d5bc-4f60-af76-4b00f98191c6,network=Network(4180a6e3-2590-404c-a60c-3337b57fe61f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap704c171d-d5') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778206541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1778206541',id=18,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyGmJYYbvr3QyeCIw1kBCEDSS3NCSiXW2VlUSJ3BJlyvfl1x3dvUE6dFKqzhvQizyxSx5x1rl4z0TjriBVD80sj4GqrlXMNMQraj8GWH5vb9kWh+w6HjvRfrn66x/EO9g==',key_name='tempest-keypair-530835063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67b8bb76f54b4f5fa95f603550c269dd',ramdisk_id='',reservation_id='r-fz50cvhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1244088613',owner_user_name='tempest-TaggedBootDevicesTest_v242-1244088613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:04:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bedf3f8df3e946b88a32ce4c78ee358c',uuid=b94a0a17-77e9-41cf-9919-37b57b364ff2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "178a5871-43af-4e36-9665-07cdd3ecf1d7", "address": "fa:16:3e:f6:ff:91", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178a5871-43", "ovs_interfaceid": "178a5871-43af-4e36-9665-07cdd3ecf1d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converting VIF {"id": "178a5871-43af-4e36-9665-07cdd3ecf1d7", "address": "fa:16:3e:f6:ff:91", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178a5871-43", "ovs_interfaceid": "178a5871-43af-4e36-9665-07cdd3ecf1d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ff:91,bridge_name='br-int',has_traffic_filtering=True,id=178a5871-43af-4e36-9665-07cdd3ecf1d7,network=Network(4180a6e3-2590-404c-a60c-3337b57fe61f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap178a5871-43') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778206541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1778206541',id=18,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyGmJYYbvr3QyeCIw1kBCEDSS3NCSiXW2VlUSJ3BJlyvfl1x3dvUE6dFKqzhvQizyxSx5x1rl4z0TjriBVD80sj4GqrlXMNMQraj8GWH5vb9kWh+w6HjvRfrn66x/EO9g==',key_name='tempest-keypair-530835063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67b8bb76f54b4f5fa95f603550c269dd',ramdisk_id='',reservation_id='r-fz50cvhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1244088613',owner_user_name='tempest-TaggedBootDevicesTest_v242-1244088613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:04:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bedf3f8df3e946b88a32ce4c78ee358c',uuid=b94a0a17-77e9-41cf-9919-37b57b364ff2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "857da07e-b7c7-4bb9-805a-8c9a7d30d6bf", "address": "fa:16:3e:e1:48:b9", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap857da07e-b7", "ovs_interfaceid": "857da07e-b7c7-4bb9-805a-8c9a7d30d6bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converting VIF {"id": "857da07e-b7c7-4bb9-805a-8c9a7d30d6bf", "address": "fa:16:3e:e1:48:b9", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap857da07e-b7", "ovs_interfaceid": "857da07e-b7c7-4bb9-805a-8c9a7d30d6bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:48:b9,bridge_name='br-int',has_traffic_filtering=True,id=857da07e-b7c7-4bb9-805a-8c9a7d30d6bf,network=Network(4180a6e3-2590-404c-a60c-3337b57fe61f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap857da07e-b7') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778206541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1778206541',id=18,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyGmJYYbvr3QyeCIw1kBCEDSS3NCSiXW2VlUSJ3BJlyvfl1x3dvUE6dFKqzhvQizyxSx5x1rl4z0TjriBVD80sj4GqrlXMNMQraj8GWH5vb9kWh+w6HjvRfrn66x/EO9g==',key_name='tempest-keypair-530835063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67b8bb76f54b4f5fa95f603550c269dd',ramdisk_id='',reservation_id='r-fz50cvhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1244088613',owner_user_name='tempest-TaggedBootDevicesTest_v242-1244088613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:04:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bedf3f8df3e946b88a32ce4c78ee358c',uuid=b94a0a17-77e9-41cf-9919-37b57b364ff2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86a69795-c167-4353-b46e-0137384a0af5", "address": "fa:16:3e:8b:e1:c7", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a69795-c1", "ovs_interfaceid": "86a69795-c167-4353-b46e-0137384a0af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converting VIF {"id": "86a69795-c167-4353-b46e-0137384a0af5", "address": "fa:16:3e:8b:e1:c7", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a69795-c1", "ovs_interfaceid": "86a69795-c167-4353-b46e-0137384a0af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e1:c7,bridge_name='br-int',has_traffic_filtering=True,id=86a69795-c167-4353-b46e-0137384a0af5,network=Network(4180a6e3-2590-404c-a60c-3337b57fe61f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a69795-c1') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778206541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1778206541',id=18,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyGmJYYbvr3QyeCIw1kBCEDSS3NCSiXW2VlUSJ3BJlyvfl1x3dvUE6dFKqzhvQizyxSx5x1rl4z0TjriBVD80sj4GqrlXMNMQraj8GWH5vb9kWh+w6HjvRfrn66x/EO9g==',key_name='tempest-keypair-530835063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67b8bb76f54b4f5fa95f603550c269dd',ramdisk_id='',reservation_id='r-fz50cvhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1244088613',owner_user_name='tempest-TaggedBootDevicesTest_v242-1244088613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:04:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bedf3f8df3e946b88a32ce4c78ee358c',uuid=b94a0a17-77e9-41cf-9919-37b57b364ff2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "189360e5-7bc0-4711-8069-8939c57a28d7", "address": "fa:16:3e:45:f0:2c", "network": {"id": "0e992b1f-b626-47b5-b861-9b1420f22a3d", "bridge": "br-int", "label": "tempest-device-tagging-net2-855379110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189360e5-7b", "ovs_interfaceid": "189360e5-7bc0-4711-8069-8939c57a28d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converting VIF {"id": "189360e5-7bc0-4711-8069-8939c57a28d7", "address": "fa:16:3e:45:f0:2c", "network": {"id": "0e992b1f-b626-47b5-b861-9b1420f22a3d", "bridge": "br-int", "label": "tempest-device-tagging-net2-855379110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189360e5-7b", "ovs_interfaceid": "189360e5-7bc0-4711-8069-8939c57a28d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:f0:2c,bridge_name='br-int',has_traffic_filtering=True,id=189360e5-7bc0-4711-8069-8939c57a28d7,network=Network(0e992b1f-b626-47b5-b861-9b1420f22a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189360e5-7b') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778206541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1778206541',id=18,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyGmJYYbvr3QyeCIw1kBCEDSS3NCSiXW2VlUSJ3BJlyvfl1x3dvUE6dFKqzhvQizyxSx5x1rl4z0TjriBVD80sj4GqrlXMNMQraj8GWH5vb9kWh+w6HjvRfrn66x/EO9g==',key_name='tempest-keypair-530835063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67b8bb76f54b4f5fa95f603550c269dd',ramdisk_id='',reservation_id='r-fz50cvhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1244088613',owner_user_name='tempest-TaggedBootDevicesTest_v242-1244088613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:04:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bedf3f8df3e946b88a32ce4c78ee358c',uuid=b94a0a17-77e9-41cf-9919-37b57b364ff2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0559955f-ea89-4f72-93dd-22b0df42e380", "address": "fa:16:3e:cb:58:f5", "network": {"id": "0e992b1f-b626-47b5-b861-9b1420f22a3d", "bridge": "br-int", "label": "tempest-device-tagging-net2-855379110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0559955f-ea", "ovs_interfaceid": "0559955f-ea89-4f72-93dd-22b0df42e380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converting VIF {"id": "0559955f-ea89-4f72-93dd-22b0df42e380", "address": "fa:16:3e:cb:58:f5", "network": {"id": "0e992b1f-b626-47b5-b861-9b1420f22a3d", "bridge": "br-int", "label": "tempest-device-tagging-net2-855379110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0559955f-ea", "ovs_interfaceid": "0559955f-ea89-4f72-93dd-22b0df42e380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:58:f5,bridge_name='br-int',has_traffic_filtering=True,id=0559955f-ea89-4f72-93dd-22b0df42e380,network=Network(0e992b1f-b626-47b5-b861-9b1420f22a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0559955f-ea') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.objects.instance [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lazy-loading 'pci_devices' on Instance uuid b94a0a17-77e9-41cf-9919-37b57b364ff2 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:05:01 user nova-compute[74898]:   <uuid>b94a0a17-77e9-41cf-9919-37b57b364ff2</uuid>
Nov 17 03:05:01 user nova-compute[74898]:   <name>instance-00000012</name>
Nov 17 03:05:01 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:05:01 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:05:01 user nova-compute[74898]:   <metadata>
Nov 17 03:05:01 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:05:01 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:05:01 user nova-compute[74898]:       <nova:name>tempest-device-tagging-server-1778206541</nova:name>
Nov 17 03:05:01 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:04:57</nova:creationTime>
Nov 17 03:05:01 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:05:01 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:05:01 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:05:01 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:05:01 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:05:01 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:05:01 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:05:01 user nova-compute[74898]:       <nova:owner>
Nov 17 03:05:01 user nova-compute[74898]:         <nova:user uuid="bedf3f8df3e946b88a32ce4c78ee358c">tempest-TaggedBootDevicesTest_v242-1244088613-project-member</nova:user>
Nov 17 03:05:01 user nova-compute[74898]:         <nova:project uuid="67b8bb76f54b4f5fa95f603550c269dd">tempest-TaggedBootDevicesTest_v242-1244088613</nova:project>
Nov 17 03:05:01 user nova-compute[74898]:       </nova:owner>
Nov 17 03:05:01 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:05:01 user nova-compute[74898]:       <nova:ports>
Nov 17 03:05:01 user nova-compute[74898]:         <nova:port uuid="58ede42b-dcc4-45f2-8be6-f1fba65e9f4c">
Nov 17 03:05:01 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 17 03:05:01 user nova-compute[74898]:         </nova:port>
Nov 17 03:05:01 user nova-compute[74898]:         <nova:port uuid="704c171d-d5bc-4f60-af76-4b00f98191c6">
Nov 17 03:05:01 user nova-compute[74898]:           <nova:ip type="fixed" address="10.1.1.72" ipVersion="4"/>
Nov 17 03:05:01 user nova-compute[74898]:         </nova:port>
Nov 17 03:05:01 user nova-compute[74898]:         <nova:port uuid="178a5871-43af-4e36-9665-07cdd3ecf1d7">
Nov 17 03:05:01 user nova-compute[74898]:           <nova:ip type="fixed" address="10.1.1.101" ipVersion="4"/>
Nov 17 03:05:01 user nova-compute[74898]:         </nova:port>
Nov 17 03:05:01 user nova-compute[74898]:         <nova:port uuid="857da07e-b7c7-4bb9-805a-8c9a7d30d6bf">
Nov 17 03:05:01 user nova-compute[74898]:           <nova:ip type="fixed" address="10.1.1.170" ipVersion="4"/>
Nov 17 03:05:01 user nova-compute[74898]:         </nova:port>
Nov 17 03:05:01 user nova-compute[74898]:         <nova:port uuid="86a69795-c167-4353-b46e-0137384a0af5">
Nov 17 03:05:01 user nova-compute[74898]:           <nova:ip type="fixed" address="10.1.1.203" ipVersion="4"/>
Nov 17 03:05:01 user nova-compute[74898]:         </nova:port>
Nov 17 03:05:01 user nova-compute[74898]:         <nova:port uuid="189360e5-7bc0-4711-8069-8939c57a28d7">
Nov 17 03:05:01 user nova-compute[74898]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 17 03:05:01 user nova-compute[74898]:         </nova:port>
Nov 17 03:05:01 user nova-compute[74898]:         <nova:port uuid="0559955f-ea89-4f72-93dd-22b0df42e380">
Nov 17 03:05:01 user nova-compute[74898]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 17 03:05:01 user nova-compute[74898]:         </nova:port>
Nov 17 03:05:01 user nova-compute[74898]:       </nova:ports>
Nov 17 03:05:01 user nova-compute[74898]:     </nova:instance>
Nov 17 03:05:01 user nova-compute[74898]:   </metadata>
Nov 17 03:05:01 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:05:01 user nova-compute[74898]:     <system>
Nov 17 03:05:01 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:05:01 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:05:01 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:05:01 user nova-compute[74898]:       <entry name="serial">b94a0a17-77e9-41cf-9919-37b57b364ff2</entry>
Nov 17 03:05:01 user nova-compute[74898]:       <entry name="uuid">b94a0a17-77e9-41cf-9919-37b57b364ff2</entry>
Nov 17 03:05:01 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:05:01 user nova-compute[74898]:     </system>
Nov 17 03:05:01 user nova-compute[74898]:   </sysinfo>
Nov 17 03:05:01 user nova-compute[74898]:   <os>
Nov 17 03:05:01 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:05:01 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:05:01 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:05:01 user nova-compute[74898]:   </os>
Nov 17 03:05:01 user nova-compute[74898]:   <features>
Nov 17 03:05:01 user nova-compute[74898]:     <acpi/>
Nov 17 03:05:01 user nova-compute[74898]:     <apic/>
Nov 17 03:05:01 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:05:01 user nova-compute[74898]:   </features>
Nov 17 03:05:01 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:05:01 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:05:01 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:05:01 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:05:01 user nova-compute[74898]:   </clock>
Nov 17 03:05:01 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:05:01 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:05:01 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:05:01 user nova-compute[74898]:   </cpu>
Nov 17 03:05:01 user nova-compute[74898]:   <devices>
Nov 17 03:05:01 user nova-compute[74898]:     <disk type="file" device="cdrom">
Nov 17 03:05:01 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none"/>
Nov 17 03:05:01 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/b94a0a17-77e9-41cf-9919-37b57b364ff2/disk.config"/>
Nov 17 03:05:01 user nova-compute[74898]:       <target dev="hda" bus="ide"/>
Nov 17 03:05:01 user nova-compute[74898]:     </disk>
Nov 17 03:05:01 user nova-compute[74898]:     <disk type="block" device="disk">
Nov 17 03:05:01 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:05:01 user nova-compute[74898]:       <source dev="/dev/sdc"/>
Nov 17 03:05:01 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:05:01 user nova-compute[74898]:       <serial>59c7c3e8-f2e8-471c-8a4a-75bcd771c248</serial>
Nov 17 03:05:01 user nova-compute[74898]:     </disk>
Nov 17 03:05:01 user nova-compute[74898]:     <disk type="block" device="disk">
Nov 17 03:05:01 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:05:01 user nova-compute[74898]:       <source dev="/dev/sdg"/>
Nov 17 03:05:01 user nova-compute[74898]:       <target dev="vdb" bus="virtio"/>
Nov 17 03:05:01 user nova-compute[74898]:       <serial>3f795638-f9a2-4bfc-afb7-416e6274b484</serial>
Nov 17 03:05:01 user nova-compute[74898]:     </disk>
Nov 17 03:05:01 user nova-compute[74898]:     <disk type="block" device="disk">
Nov 17 03:05:01 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:05:01 user nova-compute[74898]:       <source dev="/dev/sdh"/>
Nov 17 03:05:01 user nova-compute[74898]:       <target dev="vdc" bus="virtio"/>
Nov 17 03:05:01 user nova-compute[74898]:       <serial>4d87f49d-4f84-4e40-a806-f8c534350981</serial>
Nov 17 03:05:01 user nova-compute[74898]:     </disk>
Nov 17 03:05:01 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:05:01 user nova-compute[74898]:       <mac address="fa:16:3e:26:35:f5"/>
Nov 17 03:05:01 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:05:01 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:05:01 user nova-compute[74898]:       <target dev="tap58ede42b-dc"/>
Nov 17 03:05:01 user nova-compute[74898]:     </interface>
Nov 17 03:05:01 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:05:01 user nova-compute[74898]:       <mac address="fa:16:3e:d8:69:fc"/>
Nov 17 03:05:01 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:05:01 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:05:01 user nova-compute[74898]:       <target dev="tap704c171d-d5"/>
Nov 17 03:05:01 user nova-compute[74898]:     </interface>
Nov 17 03:05:01 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:05:01 user nova-compute[74898]:       <mac address="fa:16:3e:f6:ff:91"/>
Nov 17 03:05:01 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:05:01 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:05:01 user nova-compute[74898]:       <target dev="tap178a5871-43"/>
Nov 17 03:05:01 user nova-compute[74898]:     </interface>
Nov 17 03:05:01 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:05:01 user nova-compute[74898]:       <mac address="fa:16:3e:e1:48:b9"/>
Nov 17 03:05:01 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:05:01 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:05:01 user nova-compute[74898]:       <target dev="tap857da07e-b7"/>
Nov 17 03:05:01 user nova-compute[74898]:     </interface>
Nov 17 03:05:01 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:05:01 user nova-compute[74898]:       <mac address="fa:16:3e:8b:e1:c7"/>
Nov 17 03:05:01 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:05:01 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:05:01 user nova-compute[74898]:       <target dev="tap86a69795-c1"/>
Nov 17 03:05:01 user nova-compute[74898]:     </interface>
Nov 17 03:05:01 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:05:01 user nova-compute[74898]:       <mac address="fa:16:3e:45:f0:2c"/>
Nov 17 03:05:01 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:05:01 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:05:01 user nova-compute[74898]:       <target dev="tap189360e5-7b"/>
Nov 17 03:05:01 user nova-compute[74898]:     </interface>
Nov 17 03:05:01 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:05:01 user nova-compute[74898]:       <mac address="fa:16:3e:cb:58:f5"/>
Nov 17 03:05:01 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:05:01 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:05:01 user nova-compute[74898]:       <target dev="tap0559955f-ea"/>
Nov 17 03:05:01 user nova-compute[74898]:     </interface>
Nov 17 03:05:01 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:05:01 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/b94a0a17-77e9-41cf-9919-37b57b364ff2/console.log" append="off"/>
Nov 17 03:05:01 user nova-compute[74898]:     </serial>
Nov 17 03:05:01 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:05:01 user nova-compute[74898]:     <video>
Nov 17 03:05:01 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:05:01 user nova-compute[74898]:     </video>
Nov 17 03:05:01 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:05:01 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:05:01 user nova-compute[74898]:     </rng>
Nov 17 03:05:01 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:05:01 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:05:01 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:05:01 user nova-compute[74898]:     </memballoon>
Nov 17 03:05:01 user nova-compute[74898]:   </devices>
Nov 17 03:05:01 user nova-compute[74898]: </domain>
Nov 17 03:05:01 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778206541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1778206541',id=18,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyGmJYYbvr3QyeCIw1kBCEDSS3NCSiXW2VlUSJ3BJlyvfl1x3dvUE6dFKqzhvQizyxSx5x1rl4z0TjriBVD80sj4GqrlXMNMQraj8GWH5vb9kWh+w6HjvRfrn66x/EO9g==',key_name='tempest-keypair-530835063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67b8bb76f54b4f5fa95f603550c269dd',ramdisk_id='',reservation_id='r-fz50cvhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1244088613',owner_user_name='tempest-TaggedBootDevicesTest_v242-1244088613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:04:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bedf3f8df3e946b88a32ce4c78ee358c',uuid=b94a0a17-77e9-41cf-9919-37b57b364ff2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58ede42b-dcc4-45f2-8be6-f1fba65e9f4c", "address": "fa:16:3e:26:35:f5", "network": {"id": "2e9858af-0eb1-4e7c-bd29-7238d7eb070e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1878259197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ede42b-dc", "ovs_interfaceid": "58ede42b-dcc4-45f2-8be6-f1fba65e9f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converting VIF {"id": "58ede42b-dcc4-45f2-8be6-f1fba65e9f4c", "address": "fa:16:3e:26:35:f5", "network": {"id": "2e9858af-0eb1-4e7c-bd29-7238d7eb070e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1878259197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ede42b-dc", "ovs_interfaceid": "58ede42b-dcc4-45f2-8be6-f1fba65e9f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:35:f5,bridge_name='br-int',has_traffic_filtering=True,id=58ede42b-dcc4-45f2-8be6-f1fba65e9f4c,network=Network(2e9858af-0eb1-4e7c-bd29-7238d7eb070e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ede42b-dc') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG os_vif [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:35:f5,bridge_name='br-int',has_traffic_filtering=True,id=58ede42b-dcc4-45f2-8be6-f1fba65e9f4c,network=Network(2e9858af-0eb1-4e7c-bd29-7238d7eb070e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ede42b-dc') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5924a9cd-45fd-599e-9d53-fd1d2a1ebe3a', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58ede42b-dc, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap58ede42b-dc, col_values=(('qos', UUID('9a998ac6-a158-4d9b-8c9f-e52aa8b53532')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap58ede42b-dc, col_values=(('external_ids', {'iface-id': '58ede42b-dcc4-45f2-8be6-f1fba65e9f4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:35:f5', 'vm-uuid': 'b94a0a17-77e9-41cf-9919-37b57b364ff2'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:01 user nova-compute[74898]: INFO os_vif [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:35:f5,bridge_name='br-int',has_traffic_filtering=True,id=58ede42b-dcc4-45f2-8be6-f1fba65e9f4c,network=Network(2e9858af-0eb1-4e7c-bd29-7238d7eb070e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ede42b-dc')
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778206541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1778206541',id=18,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyGmJYYbvr3QyeCIw1kBCEDSS3NCSiXW2VlUSJ3BJlyvfl1x3dvUE6dFKqzhvQizyxSx5x1rl4z0TjriBVD80sj4GqrlXMNMQraj8GWH5vb9kWh+w6HjvRfrn66x/EO9g==',key_name='tempest-keypair-530835063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67b8bb76f54b4f5fa95f603550c269dd',ramdisk_id='',reservation_id='r-fz50cvhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1244088613',owner_user_name='tempest-TaggedBootDevicesTest_v242-1244088613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:04:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bedf3f8df3e946b88a32ce4c78ee358c',uuid=b94a0a17-77e9-41cf-9919-37b57b364ff2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "704c171d-d5bc-4f60-af76-4b00f98191c6", "address": "fa:16:3e:d8:69:fc", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704c171d-d5", "ovs_interfaceid": "704c171d-d5bc-4f60-af76-4b00f98191c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converting VIF {"id": "704c171d-d5bc-4f60-af76-4b00f98191c6", "address": "fa:16:3e:d8:69:fc", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704c171d-d5", "ovs_interfaceid": "704c171d-d5bc-4f60-af76-4b00f98191c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:69:fc,bridge_name='br-int',has_traffic_filtering=True,id=704c171d-d5bc-4f60-af76-4b00f98191c6,network=Network(4180a6e3-2590-404c-a60c-3337b57fe61f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap704c171d-d5') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG os_vif [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:69:fc,bridge_name='br-int',has_traffic_filtering=True,id=704c171d-d5bc-4f60-af76-4b00f98191c6,network=Network(4180a6e3-2590-404c-a60c-3337b57fe61f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap704c171d-d5') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '18f8aa80-b5f9-5124-a508-cc31f4d05652', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap704c171d-d5, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap704c171d-d5, col_values=(('qos', UUID('8d71e0e6-1b20-46ba-851c-8b8998f3fc83')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap704c171d-d5, col_values=(('external_ids', {'iface-id': '704c171d-d5bc-4f60-af76-4b00f98191c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:69:fc', 'vm-uuid': 'b94a0a17-77e9-41cf-9919-37b57b364ff2'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:01 user nova-compute[74898]: INFO os_vif [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:69:fc,bridge_name='br-int',has_traffic_filtering=True,id=704c171d-d5bc-4f60-af76-4b00f98191c6,network=Network(4180a6e3-2590-404c-a60c-3337b57fe61f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap704c171d-d5')
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778206541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1778206541',id=18,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyGmJYYbvr3QyeCIw1kBCEDSS3NCSiXW2VlUSJ3BJlyvfl1x3dvUE6dFKqzhvQizyxSx5x1rl4z0TjriBVD80sj4GqrlXMNMQraj8GWH5vb9kWh+w6HjvRfrn66x/EO9g==',key_name='tempest-keypair-530835063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67b8bb76f54b4f5fa95f603550c269dd',ramdisk_id='',reservation_id='r-fz50cvhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1244088613',owner_user_name='tempest-TaggedBootDevicesTest_v242-1244088613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:04:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bedf3f8df3e946b88a32ce4c78ee358c',uuid=b94a0a17-77e9-41cf-9919-37b57b364ff2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "178a5871-43af-4e36-9665-07cdd3ecf1d7", "address": "fa:16:3e:f6:ff:91", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178a5871-43", "ovs_interfaceid": "178a5871-43af-4e36-9665-07cdd3ecf1d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converting VIF {"id": "178a5871-43af-4e36-9665-07cdd3ecf1d7", "address": "fa:16:3e:f6:ff:91", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178a5871-43", "ovs_interfaceid": "178a5871-43af-4e36-9665-07cdd3ecf1d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ff:91,bridge_name='br-int',has_traffic_filtering=True,id=178a5871-43af-4e36-9665-07cdd3ecf1d7,network=Network(4180a6e3-2590-404c-a60c-3337b57fe61f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap178a5871-43') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG os_vif [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ff:91,bridge_name='br-int',has_traffic_filtering=True,id=178a5871-43af-4e36-9665-07cdd3ecf1d7,network=Network(4180a6e3-2590-404c-a60c-3337b57fe61f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap178a5871-43') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c6b3ca9f-daa1-5c2d-a542-5ac38806e628', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap178a5871-43, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap178a5871-43, col_values=(('qos', UUID('71024dce-786a-472a-b29c-17592f14737b')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap178a5871-43, col_values=(('external_ids', {'iface-id': '178a5871-43af-4e36-9665-07cdd3ecf1d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:ff:91', 'vm-uuid': 'b94a0a17-77e9-41cf-9919-37b57b364ff2'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:02 user nova-compute[74898]: INFO os_vif [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ff:91,bridge_name='br-int',has_traffic_filtering=True,id=178a5871-43af-4e36-9665-07cdd3ecf1d7,network=Network(4180a6e3-2590-404c-a60c-3337b57fe61f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap178a5871-43')
Nov 17 03:05:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778206541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1778206541',id=18,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyGmJYYbvr3QyeCIw1kBCEDSS3NCSiXW2VlUSJ3BJlyvfl1x3dvUE6dFKqzhvQizyxSx5x1rl4z0TjriBVD80sj4GqrlXMNMQraj8GWH5vb9kWh+w6HjvRfrn66x/EO9g==',key_name='tempest-keypair-530835063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67b8bb76f54b4f5fa95f603550c269dd',ramdisk_id='',reservation_id='r-fz50cvhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1244088613',owner_user_name='tempest-TaggedBootDevicesTest_v242-1244088613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:04:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bedf3f8df3e946b88a32ce4c78ee358c',uuid=b94a0a17-77e9-41cf-9919-37b57b364ff2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "857da07e-b7c7-4bb9-805a-8c9a7d30d6bf", "address": "fa:16:3e:e1:48:b9", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap857da07e-b7", "ovs_interfaceid": "857da07e-b7c7-4bb9-805a-8c9a7d30d6bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converting VIF {"id": "857da07e-b7c7-4bb9-805a-8c9a7d30d6bf", "address": "fa:16:3e:e1:48:b9", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap857da07e-b7", "ovs_interfaceid": "857da07e-b7c7-4bb9-805a-8c9a7d30d6bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:48:b9,bridge_name='br-int',has_traffic_filtering=True,id=857da07e-b7c7-4bb9-805a-8c9a7d30d6bf,network=Network(4180a6e3-2590-404c-a60c-3337b57fe61f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap857da07e-b7') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG os_vif [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:48:b9,bridge_name='br-int',has_traffic_filtering=True,id=857da07e-b7c7-4bb9-805a-8c9a7d30d6bf,network=Network(4180a6e3-2590-404c-a60c-3337b57fe61f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap857da07e-b7') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fe118e70-9a13-5b16-9867-0eefef3b4302', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap857da07e-b7, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap857da07e-b7, col_values=(('qos', UUID('2a2859c2-40a1-49ac-8578-63aea852b89f')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap857da07e-b7, col_values=(('external_ids', {'iface-id': '857da07e-b7c7-4bb9-805a-8c9a7d30d6bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:48:b9', 'vm-uuid': 'b94a0a17-77e9-41cf-9919-37b57b364ff2'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:02 user nova-compute[74898]: INFO os_vif [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:48:b9,bridge_name='br-int',has_traffic_filtering=True,id=857da07e-b7c7-4bb9-805a-8c9a7d30d6bf,network=Network(4180a6e3-2590-404c-a60c-3337b57fe61f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap857da07e-b7')
Nov 17 03:05:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778206541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1778206541',id=18,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyGmJYYbvr3QyeCIw1kBCEDSS3NCSiXW2VlUSJ3BJlyvfl1x3dvUE6dFKqzhvQizyxSx5x1rl4z0TjriBVD80sj4GqrlXMNMQraj8GWH5vb9kWh+w6HjvRfrn66x/EO9g==',key_name='tempest-keypair-530835063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67b8bb76f54b4f5fa95f603550c269dd',ramdisk_id='',reservation_id='r-fz50cvhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1244088613',owner_user_name='tempest-TaggedBootDevicesTest_v242-1244088613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:04:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bedf3f8df3e946b88a32ce4c78ee358c',uuid=b94a0a17-77e9-41cf-9919-37b57b364ff2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86a69795-c167-4353-b46e-0137384a0af5", "address": "fa:16:3e:8b:e1:c7", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a69795-c1", "ovs_interfaceid": "86a69795-c167-4353-b46e-0137384a0af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converting VIF {"id": "86a69795-c167-4353-b46e-0137384a0af5", "address": "fa:16:3e:8b:e1:c7", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a69795-c1", "ovs_interfaceid": "86a69795-c167-4353-b46e-0137384a0af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e1:c7,bridge_name='br-int',has_traffic_filtering=True,id=86a69795-c167-4353-b46e-0137384a0af5,network=Network(4180a6e3-2590-404c-a60c-3337b57fe61f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a69795-c1') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG os_vif [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e1:c7,bridge_name='br-int',has_traffic_filtering=True,id=86a69795-c167-4353-b46e-0137384a0af5,network=Network(4180a6e3-2590-404c-a60c-3337b57fe61f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a69795-c1') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '697ac7bc-6553-5667-9a04-c56fdfbd2be5', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86a69795-c1, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86a69795-c1, col_values=(('qos', UUID('7375e734-1715-4a62-bf03-8fd2c89fe80e')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86a69795-c1, col_values=(('external_ids', {'iface-id': '86a69795-c167-4353-b46e-0137384a0af5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:e1:c7', 'vm-uuid': 'b94a0a17-77e9-41cf-9919-37b57b364ff2'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:02 user nova-compute[74898]: INFO os_vif [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e1:c7,bridge_name='br-int',has_traffic_filtering=True,id=86a69795-c167-4353-b46e-0137384a0af5,network=Network(4180a6e3-2590-404c-a60c-3337b57fe61f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a69795-c1')
Nov 17 03:05:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778206541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1778206541',id=18,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyGmJYYbvr3QyeCIw1kBCEDSS3NCSiXW2VlUSJ3BJlyvfl1x3dvUE6dFKqzhvQizyxSx5x1rl4z0TjriBVD80sj4GqrlXMNMQraj8GWH5vb9kWh+w6HjvRfrn66x/EO9g==',key_name='tempest-keypair-530835063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67b8bb76f54b4f5fa95f603550c269dd',ramdisk_id='',reservation_id='r-fz50cvhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1244088613',owner_user_name='tempest-TaggedBootDevicesTest_v242-1244088613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:04:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bedf3f8df3e946b88a32ce4c78ee358c',uuid=b94a0a17-77e9-41cf-9919-37b57b364ff2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "189360e5-7bc0-4711-8069-8939c57a28d7", "address": "fa:16:3e:45:f0:2c", "network": {"id": "0e992b1f-b626-47b5-b861-9b1420f22a3d", "bridge": "br-int", "label": "tempest-device-tagging-net2-855379110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189360e5-7b", "ovs_interfaceid": "189360e5-7bc0-4711-8069-8939c57a28d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converting VIF {"id": "189360e5-7bc0-4711-8069-8939c57a28d7", "address": "fa:16:3e:45:f0:2c", "network": {"id": "0e992b1f-b626-47b5-b861-9b1420f22a3d", "bridge": "br-int", "label": "tempest-device-tagging-net2-855379110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189360e5-7b", "ovs_interfaceid": "189360e5-7bc0-4711-8069-8939c57a28d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:f0:2c,bridge_name='br-int',has_traffic_filtering=True,id=189360e5-7bc0-4711-8069-8939c57a28d7,network=Network(0e992b1f-b626-47b5-b861-9b1420f22a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189360e5-7b') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG os_vif [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:f0:2c,bridge_name='br-int',has_traffic_filtering=True,id=189360e5-7bc0-4711-8069-8939c57a28d7,network=Network(0e992b1f-b626-47b5-b861-9b1420f22a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189360e5-7b') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '591dc855-6821-5ed5-9af8-6378f23b0735', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap189360e5-7b, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap189360e5-7b, col_values=(('qos', UUID('f8b9ded9-58a9-4ade-82da-a40059f89726')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap189360e5-7b, col_values=(('external_ids', {'iface-id': '189360e5-7bc0-4711-8069-8939c57a28d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:f0:2c', 'vm-uuid': 'b94a0a17-77e9-41cf-9919-37b57b364ff2'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:02 user nova-compute[74898]: INFO os_vif [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:f0:2c,bridge_name='br-int',has_traffic_filtering=True,id=189360e5-7bc0-4711-8069-8939c57a28d7,network=Network(0e992b1f-b626-47b5-b861-9b1420f22a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189360e5-7b')
Nov 17 03:05:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778206541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1778206541',id=18,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyGmJYYbvr3QyeCIw1kBCEDSS3NCSiXW2VlUSJ3BJlyvfl1x3dvUE6dFKqzhvQizyxSx5x1rl4z0TjriBVD80sj4GqrlXMNMQraj8GWH5vb9kWh+w6HjvRfrn66x/EO9g==',key_name='tempest-keypair-530835063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67b8bb76f54b4f5fa95f603550c269dd',ramdisk_id='',reservation_id='r-fz50cvhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1244088613',owner_user_name='tempest-TaggedBootDevicesTest_v242-1244088613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:04:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bedf3f8df3e946b88a32ce4c78ee358c',uuid=b94a0a17-77e9-41cf-9919-37b57b364ff2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0559955f-ea89-4f72-93dd-22b0df42e380", "address": "fa:16:3e:cb:58:f5", "network": {"id": "0e992b1f-b626-47b5-b861-9b1420f22a3d", "bridge": "br-int", "label": "tempest-device-tagging-net2-855379110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0559955f-ea", "ovs_interfaceid": "0559955f-ea89-4f72-93dd-22b0df42e380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converting VIF {"id": "0559955f-ea89-4f72-93dd-22b0df42e380", "address": "fa:16:3e:cb:58:f5", "network": {"id": "0e992b1f-b626-47b5-b861-9b1420f22a3d", "bridge": "br-int", "label": "tempest-device-tagging-net2-855379110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0559955f-ea", "ovs_interfaceid": "0559955f-ea89-4f72-93dd-22b0df42e380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:58:f5,bridge_name='br-int',has_traffic_filtering=True,id=0559955f-ea89-4f72-93dd-22b0df42e380,network=Network(0e992b1f-b626-47b5-b861-9b1420f22a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0559955f-ea') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG os_vif [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:58:f5,bridge_name='br-int',has_traffic_filtering=True,id=0559955f-ea89-4f72-93dd-22b0df42e380,network=Network(0e992b1f-b626-47b5-b861-9b1420f22a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0559955f-ea') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '968ab999-9a3d-52e9-a129-6bdc32f34d4f', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0559955f-ea, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0559955f-ea, col_values=(('qos', UUID('ec6cea36-d384-4f47-8fb5-0b5cb22d8d36')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0559955f-ea, col_values=(('external_ids', {'iface-id': '0559955f-ea89-4f72-93dd-22b0df42e380', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:58:f5', 'vm-uuid': 'b94a0a17-77e9-41cf-9919-37b57b364ff2'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:02 user nova-compute[74898]: INFO os_vif [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:58:f5,bridge_name='br-int',has_traffic_filtering=True,id=0559955f-ea89-4f72-93dd-22b0df42e380,network=Network(0e992b1f-b626-47b5-b861-9b1420f22a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0559955f-ea')
Nov 17 03:05:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] No BDM found with device name hda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] No VIF found with MAC fa:16:3e:26:35:f5, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] No VIF found with MAC fa:16:3e:8b:e1:c7, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:05:02 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Using config drive
Nov 17 03:05:02 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Creating config drive at /opt/stack/data/nova/instances/b94a0a17-77e9-41cf-9919-37b57b364ff2/disk.config
Nov 17 03:05:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b94a0a17-77e9-41cf-9919-37b57b364ff2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcd8jr0qm {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b94a0a17-77e9-41cf-9919-37b57b364ff2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcd8jr0qm" returned: 0 in 0.064s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:04 user nova-compute[74898]: DEBUG nova.compute.manager [req-bb732779-b0cf-462c-ae42-17ae590b0e24 req-c32612c7-924c-49c4-a346-7074d176a9bb service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-plugged-58ede42b-dcc4-45f2-8be6-f1fba65e9f4c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-bb732779-b0cf-462c-ae42-17ae590b0e24 req-c32612c7-924c-49c4-a346-7074d176a9bb service nova] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-bb732779-b0cf-462c-ae42-17ae590b0e24 req-c32612c7-924c-49c4-a346-7074d176a9bb service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-bb732779-b0cf-462c-ae42-17ae590b0e24 req-c32612c7-924c-49c4-a346-7074d176a9bb service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:04 user nova-compute[74898]: DEBUG nova.compute.manager [req-bb732779-b0cf-462c-ae42-17ae590b0e24 req-c32612c7-924c-49c4-a346-7074d176a9bb service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] No waiting events found dispatching network-vif-plugged-58ede42b-dcc4-45f2-8be6-f1fba65e9f4c {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:05:04 user nova-compute[74898]: WARNING nova.compute.manager [req-bb732779-b0cf-462c-ae42-17ae590b0e24 req-c32612c7-924c-49c4-a346-7074d176a9bb service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received unexpected event network-vif-plugged-58ede42b-dcc4-45f2-8be6-f1fba65e9f4c for instance with vm_state building and task_state spawning.
Nov 17 03:05:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:04 user nova-compute[74898]: DEBUG nova.compute.manager [req-7f8532aa-264b-49e9-9520-80a4942dcd67 req-120511a9-71a4-4b94-ab1a-d440b2de71d7 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-plugged-704c171d-d5bc-4f60-af76-4b00f98191c6 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7f8532aa-264b-49e9-9520-80a4942dcd67 req-120511a9-71a4-4b94-ab1a-d440b2de71d7 service nova] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7f8532aa-264b-49e9-9520-80a4942dcd67 req-120511a9-71a4-4b94-ab1a-d440b2de71d7 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7f8532aa-264b-49e9-9520-80a4942dcd67 req-120511a9-71a4-4b94-ab1a-d440b2de71d7 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:04 user nova-compute[74898]: DEBUG nova.compute.manager [req-7f8532aa-264b-49e9-9520-80a4942dcd67 req-120511a9-71a4-4b94-ab1a-d440b2de71d7 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] No waiting events found dispatching network-vif-plugged-704c171d-d5bc-4f60-af76-4b00f98191c6 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:05:04 user nova-compute[74898]: WARNING nova.compute.manager [req-7f8532aa-264b-49e9-9520-80a4942dcd67 req-120511a9-71a4-4b94-ab1a-d440b2de71d7 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received unexpected event network-vif-plugged-704c171d-d5bc-4f60-af76-4b00f98191c6 for instance with vm_state building and task_state spawning.
Nov 17 03:05:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:04 user nova-compute[74898]: DEBUG nova.compute.manager [req-6a166d81-d9ea-4b6a-a10f-e09dbe44eba9 req-435cafac-ce7f-41dd-8f7a-27be97a51f31 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-plugged-178a5871-43af-4e36-9665-07cdd3ecf1d7 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-6a166d81-d9ea-4b6a-a10f-e09dbe44eba9 req-435cafac-ce7f-41dd-8f7a-27be97a51f31 service nova] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-6a166d81-d9ea-4b6a-a10f-e09dbe44eba9 req-435cafac-ce7f-41dd-8f7a-27be97a51f31 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-6a166d81-d9ea-4b6a-a10f-e09dbe44eba9 req-435cafac-ce7f-41dd-8f7a-27be97a51f31 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:04 user nova-compute[74898]: DEBUG nova.compute.manager [req-6a166d81-d9ea-4b6a-a10f-e09dbe44eba9 req-435cafac-ce7f-41dd-8f7a-27be97a51f31 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] No waiting events found dispatching network-vif-plugged-178a5871-43af-4e36-9665-07cdd3ecf1d7 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:05:04 user nova-compute[74898]: WARNING nova.compute.manager [req-6a166d81-d9ea-4b6a-a10f-e09dbe44eba9 req-435cafac-ce7f-41dd-8f7a-27be97a51f31 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received unexpected event network-vif-plugged-178a5871-43af-4e36-9665-07cdd3ecf1d7 for instance with vm_state building and task_state spawning.
Nov 17 03:05:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:06 user nova-compute[74898]: DEBUG nova.compute.manager [req-173a1528-c1b8-4886-9e98-d60eabedc145 req-708aa86a-100a-4b94-a439-c6d627131c2d service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-plugged-58ede42b-dcc4-45f2-8be6-f1fba65e9f4c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-173a1528-c1b8-4886-9e98-d60eabedc145 req-708aa86a-100a-4b94-a439-c6d627131c2d service nova] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-173a1528-c1b8-4886-9e98-d60eabedc145 req-708aa86a-100a-4b94-a439-c6d627131c2d service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-173a1528-c1b8-4886-9e98-d60eabedc145 req-708aa86a-100a-4b94-a439-c6d627131c2d service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:06 user nova-compute[74898]: DEBUG nova.compute.manager [req-173a1528-c1b8-4886-9e98-d60eabedc145 req-708aa86a-100a-4b94-a439-c6d627131c2d service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] No waiting events found dispatching network-vif-plugged-58ede42b-dcc4-45f2-8be6-f1fba65e9f4c {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:05:06 user nova-compute[74898]: WARNING nova.compute.manager [req-173a1528-c1b8-4886-9e98-d60eabedc145 req-708aa86a-100a-4b94-a439-c6d627131c2d service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received unexpected event network-vif-plugged-58ede42b-dcc4-45f2-8be6-f1fba65e9f4c for instance with vm_state building and task_state spawning.
Nov 17 03:05:06 user nova-compute[74898]: DEBUG nova.compute.manager [req-173a1528-c1b8-4886-9e98-d60eabedc145 req-708aa86a-100a-4b94-a439-c6d627131c2d service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-plugged-857da07e-b7c7-4bb9-805a-8c9a7d30d6bf {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-173a1528-c1b8-4886-9e98-d60eabedc145 req-708aa86a-100a-4b94-a439-c6d627131c2d service nova] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-173a1528-c1b8-4886-9e98-d60eabedc145 req-708aa86a-100a-4b94-a439-c6d627131c2d service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-173a1528-c1b8-4886-9e98-d60eabedc145 req-708aa86a-100a-4b94-a439-c6d627131c2d service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:06 user nova-compute[74898]: DEBUG nova.compute.manager [req-173a1528-c1b8-4886-9e98-d60eabedc145 req-708aa86a-100a-4b94-a439-c6d627131c2d service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] No waiting events found dispatching network-vif-plugged-857da07e-b7c7-4bb9-805a-8c9a7d30d6bf {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:05:06 user nova-compute[74898]: WARNING nova.compute.manager [req-173a1528-c1b8-4886-9e98-d60eabedc145 req-708aa86a-100a-4b94-a439-c6d627131c2d service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received unexpected event network-vif-plugged-857da07e-b7c7-4bb9-805a-8c9a7d30d6bf for instance with vm_state building and task_state spawning.
Nov 17 03:05:06 user nova-compute[74898]: DEBUG nova.compute.manager [req-173a1528-c1b8-4886-9e98-d60eabedc145 req-708aa86a-100a-4b94-a439-c6d627131c2d service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-plugged-857da07e-b7c7-4bb9-805a-8c9a7d30d6bf {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-173a1528-c1b8-4886-9e98-d60eabedc145 req-708aa86a-100a-4b94-a439-c6d627131c2d service nova] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-173a1528-c1b8-4886-9e98-d60eabedc145 req-708aa86a-100a-4b94-a439-c6d627131c2d service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-173a1528-c1b8-4886-9e98-d60eabedc145 req-708aa86a-100a-4b94-a439-c6d627131c2d service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:06 user nova-compute[74898]: DEBUG nova.compute.manager [req-173a1528-c1b8-4886-9e98-d60eabedc145 req-708aa86a-100a-4b94-a439-c6d627131c2d service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] No waiting events found dispatching network-vif-plugged-857da07e-b7c7-4bb9-805a-8c9a7d30d6bf {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:05:06 user nova-compute[74898]: WARNING nova.compute.manager [req-173a1528-c1b8-4886-9e98-d60eabedc145 req-708aa86a-100a-4b94-a439-c6d627131c2d service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received unexpected event network-vif-plugged-857da07e-b7c7-4bb9-805a-8c9a7d30d6bf for instance with vm_state building and task_state spawning.
Nov 17 03:05:06 user nova-compute[74898]: DEBUG nova.compute.manager [req-173a1528-c1b8-4886-9e98-d60eabedc145 req-708aa86a-100a-4b94-a439-c6d627131c2d service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-plugged-0559955f-ea89-4f72-93dd-22b0df42e380 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-173a1528-c1b8-4886-9e98-d60eabedc145 req-708aa86a-100a-4b94-a439-c6d627131c2d service nova] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-173a1528-c1b8-4886-9e98-d60eabedc145 req-708aa86a-100a-4b94-a439-c6d627131c2d service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-173a1528-c1b8-4886-9e98-d60eabedc145 req-708aa86a-100a-4b94-a439-c6d627131c2d service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:06 user nova-compute[74898]: DEBUG nova.compute.manager [req-173a1528-c1b8-4886-9e98-d60eabedc145 req-708aa86a-100a-4b94-a439-c6d627131c2d service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] No waiting events found dispatching network-vif-plugged-0559955f-ea89-4f72-93dd-22b0df42e380 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:05:06 user nova-compute[74898]: WARNING nova.compute.manager [req-173a1528-c1b8-4886-9e98-d60eabedc145 req-708aa86a-100a-4b94-a439-c6d627131c2d service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received unexpected event network-vif-plugged-0559955f-ea89-4f72-93dd-22b0df42e380 for instance with vm_state building and task_state spawning.
Nov 17 03:05:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG nova.compute.manager [req-fad14294-caa7-4eb6-adbd-b4ac495430c8 req-1840f118-773e-492f-ac7c-30167c208263 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-plugged-704c171d-d5bc-4f60-af76-4b00f98191c6 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fad14294-caa7-4eb6-adbd-b4ac495430c8 req-1840f118-773e-492f-ac7c-30167c208263 service nova] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fad14294-caa7-4eb6-adbd-b4ac495430c8 req-1840f118-773e-492f-ac7c-30167c208263 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fad14294-caa7-4eb6-adbd-b4ac495430c8 req-1840f118-773e-492f-ac7c-30167c208263 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG nova.compute.manager [req-fad14294-caa7-4eb6-adbd-b4ac495430c8 req-1840f118-773e-492f-ac7c-30167c208263 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] No waiting events found dispatching network-vif-plugged-704c171d-d5bc-4f60-af76-4b00f98191c6 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:05:07 user nova-compute[74898]: WARNING nova.compute.manager [req-fad14294-caa7-4eb6-adbd-b4ac495430c8 req-1840f118-773e-492f-ac7c-30167c208263 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received unexpected event network-vif-plugged-704c171d-d5bc-4f60-af76-4b00f98191c6 for instance with vm_state building and task_state spawning.
Nov 17 03:05:07 user nova-compute[74898]: DEBUG nova.compute.manager [req-fad14294-caa7-4eb6-adbd-b4ac495430c8 req-1840f118-773e-492f-ac7c-30167c208263 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-plugged-86a69795-c167-4353-b46e-0137384a0af5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fad14294-caa7-4eb6-adbd-b4ac495430c8 req-1840f118-773e-492f-ac7c-30167c208263 service nova] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fad14294-caa7-4eb6-adbd-b4ac495430c8 req-1840f118-773e-492f-ac7c-30167c208263 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fad14294-caa7-4eb6-adbd-b4ac495430c8 req-1840f118-773e-492f-ac7c-30167c208263 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG nova.compute.manager [req-fad14294-caa7-4eb6-adbd-b4ac495430c8 req-1840f118-773e-492f-ac7c-30167c208263 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] No waiting events found dispatching network-vif-plugged-86a69795-c167-4353-b46e-0137384a0af5 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:05:07 user nova-compute[74898]: WARNING nova.compute.manager [req-fad14294-caa7-4eb6-adbd-b4ac495430c8 req-1840f118-773e-492f-ac7c-30167c208263 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received unexpected event network-vif-plugged-86a69795-c167-4353-b46e-0137384a0af5 for instance with vm_state building and task_state spawning.
Nov 17 03:05:07 user nova-compute[74898]: DEBUG nova.compute.manager [req-fad14294-caa7-4eb6-adbd-b4ac495430c8 req-1840f118-773e-492f-ac7c-30167c208263 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-plugged-86a69795-c167-4353-b46e-0137384a0af5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fad14294-caa7-4eb6-adbd-b4ac495430c8 req-1840f118-773e-492f-ac7c-30167c208263 service nova] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fad14294-caa7-4eb6-adbd-b4ac495430c8 req-1840f118-773e-492f-ac7c-30167c208263 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fad14294-caa7-4eb6-adbd-b4ac495430c8 req-1840f118-773e-492f-ac7c-30167c208263 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG nova.compute.manager [req-fad14294-caa7-4eb6-adbd-b4ac495430c8 req-1840f118-773e-492f-ac7c-30167c208263 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] No waiting events found dispatching network-vif-plugged-86a69795-c167-4353-b46e-0137384a0af5 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:05:07 user nova-compute[74898]: WARNING nova.compute.manager [req-fad14294-caa7-4eb6-adbd-b4ac495430c8 req-1840f118-773e-492f-ac7c-30167c208263 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received unexpected event network-vif-plugged-86a69795-c167-4353-b46e-0137384a0af5 for instance with vm_state building and task_state spawning.
Nov 17 03:05:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG nova.compute.manager [req-e6b51d11-1d51-42a5-9c11-52688ca050e9 req-360b0d1d-9328-4d8f-8871-d122ac3a9679 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-plugged-178a5871-43af-4e36-9665-07cdd3ecf1d7 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e6b51d11-1d51-42a5-9c11-52688ca050e9 req-360b0d1d-9328-4d8f-8871-d122ac3a9679 service nova] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e6b51d11-1d51-42a5-9c11-52688ca050e9 req-360b0d1d-9328-4d8f-8871-d122ac3a9679 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e6b51d11-1d51-42a5-9c11-52688ca050e9 req-360b0d1d-9328-4d8f-8871-d122ac3a9679 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG nova.compute.manager [req-e6b51d11-1d51-42a5-9c11-52688ca050e9 req-360b0d1d-9328-4d8f-8871-d122ac3a9679 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] No waiting events found dispatching network-vif-plugged-178a5871-43af-4e36-9665-07cdd3ecf1d7 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:05:07 user nova-compute[74898]: WARNING nova.compute.manager [req-e6b51d11-1d51-42a5-9c11-52688ca050e9 req-360b0d1d-9328-4d8f-8871-d122ac3a9679 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received unexpected event network-vif-plugged-178a5871-43af-4e36-9665-07cdd3ecf1d7 for instance with vm_state building and task_state spawning.
Nov 17 03:05:07 user nova-compute[74898]: DEBUG nova.compute.manager [req-e6b51d11-1d51-42a5-9c11-52688ca050e9 req-360b0d1d-9328-4d8f-8871-d122ac3a9679 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-plugged-189360e5-7bc0-4711-8069-8939c57a28d7 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e6b51d11-1d51-42a5-9c11-52688ca050e9 req-360b0d1d-9328-4d8f-8871-d122ac3a9679 service nova] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e6b51d11-1d51-42a5-9c11-52688ca050e9 req-360b0d1d-9328-4d8f-8871-d122ac3a9679 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e6b51d11-1d51-42a5-9c11-52688ca050e9 req-360b0d1d-9328-4d8f-8871-d122ac3a9679 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG nova.compute.manager [req-e6b51d11-1d51-42a5-9c11-52688ca050e9 req-360b0d1d-9328-4d8f-8871-d122ac3a9679 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] No waiting events found dispatching network-vif-plugged-189360e5-7bc0-4711-8069-8939c57a28d7 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:05:07 user nova-compute[74898]: WARNING nova.compute.manager [req-e6b51d11-1d51-42a5-9c11-52688ca050e9 req-360b0d1d-9328-4d8f-8871-d122ac3a9679 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received unexpected event network-vif-plugged-189360e5-7bc0-4711-8069-8939c57a28d7 for instance with vm_state building and task_state spawning.
Nov 17 03:05:07 user nova-compute[74898]: DEBUG nova.compute.manager [req-e6b51d11-1d51-42a5-9c11-52688ca050e9 req-360b0d1d-9328-4d8f-8871-d122ac3a9679 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-plugged-189360e5-7bc0-4711-8069-8939c57a28d7 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e6b51d11-1d51-42a5-9c11-52688ca050e9 req-360b0d1d-9328-4d8f-8871-d122ac3a9679 service nova] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e6b51d11-1d51-42a5-9c11-52688ca050e9 req-360b0d1d-9328-4d8f-8871-d122ac3a9679 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e6b51d11-1d51-42a5-9c11-52688ca050e9 req-360b0d1d-9328-4d8f-8871-d122ac3a9679 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG nova.compute.manager [req-e6b51d11-1d51-42a5-9c11-52688ca050e9 req-360b0d1d-9328-4d8f-8871-d122ac3a9679 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] No waiting events found dispatching network-vif-plugged-189360e5-7bc0-4711-8069-8939c57a28d7 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:05:07 user nova-compute[74898]: WARNING nova.compute.manager [req-e6b51d11-1d51-42a5-9c11-52688ca050e9 req-360b0d1d-9328-4d8f-8871-d122ac3a9679 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received unexpected event network-vif-plugged-189360e5-7bc0-4711-8069-8939c57a28d7 for instance with vm_state building and task_state spawning.
Nov 17 03:05:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:08 user nova-compute[74898]: DEBUG nova.compute.manager [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:05:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:05:08 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Instance spawned successfully.
Nov 17 03:05:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:05:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:05:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:05:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:05:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:05:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:05:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:05:08 user nova-compute[74898]: DEBUG nova.compute.manager [req-765e8f42-8571-41f5-883b-b04cde985df8 req-c5900d9b-f20f-451b-bc1b-8dafb147fee2 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-plugged-0559955f-ea89-4f72-93dd-22b0df42e380 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-765e8f42-8571-41f5-883b-b04cde985df8 req-c5900d9b-f20f-451b-bc1b-8dafb147fee2 service nova] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-765e8f42-8571-41f5-883b-b04cde985df8 req-c5900d9b-f20f-451b-bc1b-8dafb147fee2 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-765e8f42-8571-41f5-883b-b04cde985df8 req-c5900d9b-f20f-451b-bc1b-8dafb147fee2 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:08 user nova-compute[74898]: DEBUG nova.compute.manager [req-765e8f42-8571-41f5-883b-b04cde985df8 req-c5900d9b-f20f-451b-bc1b-8dafb147fee2 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] No waiting events found dispatching network-vif-plugged-0559955f-ea89-4f72-93dd-22b0df42e380 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:05:08 user nova-compute[74898]: WARNING nova.compute.manager [req-765e8f42-8571-41f5-883b-b04cde985df8 req-c5900d9b-f20f-451b-bc1b-8dafb147fee2 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received unexpected event network-vif-plugged-0559955f-ea89-4f72-93dd-22b0df42e380 for instance with vm_state building and task_state spawning.
Nov 17 03:05:08 user nova-compute[74898]: INFO nova.compute.manager [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Took 10.98 seconds to spawn the instance on the hypervisor.
Nov 17 03:05:08 user nova-compute[74898]: DEBUG nova.compute.manager [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:05:08 user nova-compute[74898]: INFO nova.compute.manager [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Took 29.99 seconds to build instance.
Nov 17 03:05:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3f2d8b74-839e-46b3-9401-18553ed86a17 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.083s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:09 user nova-compute[74898]: DEBUG nova.network.neutron [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Port 7f2d1282-0400-4c1e-890d-46a51040a8b5 binding to destination host user is already ACTIVE {{(pid=74898) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 17 03:05:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquiring lock "refresh_cache-11704034-7afe-475c-ae43-1324b40f0d92" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:05:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquired lock "refresh_cache-11704034-7afe-475c-ae43-1324b40f0d92" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:05:09 user nova-compute[74898]: DEBUG nova.network.neutron [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:05:09 user nova-compute[74898]: DEBUG nova.network.neutron [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Updating instance_info_cache with network_info: [{"id": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "address": "fa:16:3e:98:61:d2", "network": {"id": "ff76f13f-ae63-4dd0-a219-894c6ae65c00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1502020482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b79304b161b748c4b105640273979318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d1282-04", "ovs_interfaceid": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Releasing lock "refresh_cache-11704034-7afe-475c-ae43-1324b40f0d92" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Creating tmpfile /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/tmpzw2j6d2b to verify with other compute node that the instance is on the same shared storage. {{(pid=74898) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG nova.compute.manager [req-2a64eb54-ba20-4e64-9263-fe4c3c2acded req-caff7999-8e08-4f58-af96-dbe94d9c8288 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received event network-vif-unplugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-2a64eb54-ba20-4e64-9263-fe4c3c2acded req-caff7999-8e08-4f58-af96-dbe94d9c8288 service nova] Acquiring lock "11704034-7afe-475c-ae43-1324b40f0d92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-2a64eb54-ba20-4e64-9263-fe4c3c2acded req-caff7999-8e08-4f58-af96-dbe94d9c8288 service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-2a64eb54-ba20-4e64-9263-fe4c3c2acded req-caff7999-8e08-4f58-af96-dbe94d9c8288 service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG nova.compute.manager [req-2a64eb54-ba20-4e64-9263-fe4c3c2acded req-caff7999-8e08-4f58-af96-dbe94d9c8288 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] No waiting events found dispatching network-vif-unplugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:05:10 user nova-compute[74898]: WARNING nova.compute.manager [req-2a64eb54-ba20-4e64-9263-fe4c3c2acded req-caff7999-8e08-4f58-af96-dbe94d9c8288 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received unexpected event network-vif-unplugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 for instance with vm_state resized and task_state resize_reverting.
Nov 17 03:05:10 user nova-compute[74898]: DEBUG nova.compute.manager [req-2a64eb54-ba20-4e64-9263-fe4c3c2acded req-caff7999-8e08-4f58-af96-dbe94d9c8288 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received event network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-2a64eb54-ba20-4e64-9263-fe4c3c2acded req-caff7999-8e08-4f58-af96-dbe94d9c8288 service nova] Acquiring lock "11704034-7afe-475c-ae43-1324b40f0d92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-2a64eb54-ba20-4e64-9263-fe4c3c2acded req-caff7999-8e08-4f58-af96-dbe94d9c8288 service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-2a64eb54-ba20-4e64-9263-fe4c3c2acded req-caff7999-8e08-4f58-af96-dbe94d9c8288 service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG nova.compute.manager [req-2a64eb54-ba20-4e64-9263-fe4c3c2acded req-caff7999-8e08-4f58-af96-dbe94d9c8288 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] No waiting events found dispatching network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:05:10 user nova-compute[74898]: WARNING nova.compute.manager [req-2a64eb54-ba20-4e64-9263-fe4c3c2acded req-caff7999-8e08-4f58-af96-dbe94d9c8288 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received unexpected event network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 for instance with vm_state resized and task_state resize_reverting.
Nov 17 03:05:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:10 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Instance destroyed successfully.
Nov 17 03:05:10 user nova-compute[74898]: DEBUG nova.objects.instance [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lazy-loading 'resources' on Instance uuid 11704034-7afe-475c-ae43-1324b40f0d92 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2234992',display_name='tempest-ServerActionsTestOtherB-server-2234992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2234992',id=4,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDa4qtus/f7IjtzuxUsFF91hKDL1YzX3TcJUCEJl5/APKTelpFkHRN746k1MAjDCvCv80GeN8KM6dto88zEniSlfqFbxPMUk2N38IhkUm1HO5g3tqYF+QbpzM60KAg8lAA==',key_name='tempest-keypair-562322790',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:03:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b79304b161b748c4b105640273979318',ramdisk_id='',reservation_id='r-p8pu7pmp',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1831504115',owner_user_name='tempest-ServerActionsTestOtherB-1831504115-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:03:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92e234cf0f444581b2fa827b116959aa',uuid=11704034-7afe-475c-ae43-1324b40f0d92,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "address": "fa:16:3e:98:61:d2", "network": {"id": "ff76f13f-ae63-4dd0-a219-894c6ae65c00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1502020482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b79304b161b748c4b105640273979318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d1282-04", "ovs_interfaceid": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Converting VIF {"id": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "address": "fa:16:3e:98:61:d2", "network": {"id": "ff76f13f-ae63-4dd0-a219-894c6ae65c00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1502020482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b79304b161b748c4b105640273979318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d1282-04", "ovs_interfaceid": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:61:d2,bridge_name='br-int',has_traffic_filtering=True,id=7f2d1282-0400-4c1e-890d-46a51040a8b5,network=Network(ff76f13f-ae63-4dd0-a219-894c6ae65c00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d1282-04') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG os_vif [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:61:d2,bridge_name='br-int',has_traffic_filtering=True,id=7f2d1282-0400-4c1e-890d-46a51040a8b5,network=Network(ff76f13f-ae63-4dd0-a219-894c6ae65c00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d1282-04') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f2d1282-04, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b44ace72-e4d1-431e-adb6-ccd8c73d44a2) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:10 user nova-compute[74898]: INFO os_vif [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:61:d2,bridge_name='br-int',has_traffic_filtering=True,id=7f2d1282-0400-4c1e-890d-46a51040a8b5,network=Network(ff76f13f-ae63-4dd0-a219-894c6ae65c00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d1282-04')
Nov 17 03:05:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpmzNxqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:05:10 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:05:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[74805dc1-73bf-4025-bc9a-5bf1592eccf2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:05:10 user nova-compute[74898]: No targets found.
Nov 17 03:05:10 user nova-compute[74898]: iSNS:
Nov 17 03:05:10 user nova-compute[74898]: No targets found.
Nov 17 03:05:10 user nova-compute[74898]: STATIC:
Nov 17 03:05:10 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981
Nov 17 03:05:10 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:05:10 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:05:10 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45
Nov 17 03:05:10 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:05:10 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:05:10 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248
Nov 17 03:05:10 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:05:10 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:05:10 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484
Nov 17 03:05:10 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:05:10 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:05:10 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0
Nov 17 03:05:10 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:05:10 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:05:10 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4
Nov 17 03:05:10 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:05:10 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:05:10 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8
Nov 17 03:05:10 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:05:10 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:05:10 user nova-compute[74898]: FIRMWARE:
Nov 17 03:05:10 user nova-compute[74898]: No targets found.
Nov 17 03:05:10 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:05:10 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:05:10 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f96f5ce-2dd2-49e5-bbf1-c6f6320ebce2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2450892b-9c1e-4d82-b8f0-8d25a6dacfab]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:05:10 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:05:10 user nova-compute[74898]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:05:10 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:05:10 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:05:10 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:05:10 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:05:10 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:05:10 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:05:10 user nova-compute[74898]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:05:10 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:05:10 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:05:10 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:05:10 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:05:10 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf873d240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45'): ({'sdd'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Removing single pathed devices sdd {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d25427-2d68-43ba-bfb8-450715bee6c0]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[23599ca6-1281-442d-9667-e2ecfb648e54]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Flushing IO for device /dev/sdd {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:05:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:11 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc827127-a32c-404e-bdf3-c609bea9534a]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:11 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:05:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:11 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde5e4ec-7afe-4287-8d76-2fa60324d91a]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:11 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:05:11 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] SCSI volumes sdd have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:05:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:05:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:11 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54e28c4-792e-45ad-a290-16b2acc37cc6]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:11 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0978ebdc-5b5a-4806-97ac-f6f99ef0e3f9]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45, portal: 172.16.0.220,3260]
Nov 17 03:05:11 user nova-compute[74898]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45, portal: 172.16.0.220,3260] successful.
Nov 17 03:05:11 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:11 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[349b91fa-23ad-4b93-aaaa-94fd3337d59b]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:05:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] <== disconnect_volume: return (336ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:05:11 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:05:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:12 user nova-compute[74898]: DEBUG nova.objects.instance [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lazy-loading 'migration_context' on Instance uuid 11704034-7afe-475c-ae43-1324b40f0d92 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:05:12 user nova-compute[74898]: DEBUG nova.objects.base [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Object Instance<11704034-7afe-475c-ae43-1324b40f0d92> lazy-loaded attributes: resources,migration_context {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:05:12 user nova-compute[74898]: INFO nova.compute.manager [None req-5de6e488-a2a0-406a-9c7d-e789a3a971a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Unrescuing
Nov 17 03:05:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-5de6e488-a2a0-406a-9c7d-e789a3a971a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Acquiring lock "refresh_cache-015ff42a-4d69-4f60-b86c-c6bd68d23c99" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:05:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-5de6e488-a2a0-406a-9c7d-e789a3a971a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Acquired lock "refresh_cache-015ff42a-4d69-4f60-b86c-c6bd68d23c99" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:05:12 user nova-compute[74898]: DEBUG nova.network.neutron [None req-5de6e488-a2a0-406a-9c7d-e789a3a971a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:05:12 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:05:12 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:05:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.472s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:12 user nova-compute[74898]: DEBUG nova.network.neutron [None req-5de6e488-a2a0-406a-9c7d-e789a3a971a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Updating instance_info_cache with network_info: [{"id": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "address": "fa:16:3e:88:21:6c", "network": {"id": "bf964a06-b5fd-41c4-9dfe-5d485019bbdd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-848964430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74014d7708574848bee4da7056ab1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d80c52a-1f", "ovs_interfaceid": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:05:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-5de6e488-a2a0-406a-9c7d-e789a3a971a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Releasing lock "refresh_cache-015ff42a-4d69-4f60-b86c-c6bd68d23c99" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:05:12 user nova-compute[74898]: DEBUG nova.objects.instance [None req-5de6e488-a2a0-406a-9c7d-e789a3a971a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lazy-loading 'flavor' on Instance uuid 015ff42a-4d69-4f60-b86c-c6bd68d23c99 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:05:12 user nova-compute[74898]: INFO nova.compute.manager [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Swapping old allocation on dict_keys(['b743bdc9-a8bb-467c-98c8-06f1954f87df']) held by migration e64df685-1998-4c22-aa5c-6dae1f6f2fe9 for instance
Nov 17 03:05:12 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Overwriting current allocation {'allocations': {'b743bdc9-a8bb-467c-98c8-06f1954f87df': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 22}}, 'project_id': 'b79304b161b748c4b105640273979318', 'user_id': '92e234cf0f444581b2fa827b116959aa', 'consumer_generation': 1} on consumer 11704034-7afe-475c-ae43-1324b40f0d92 {{(pid=74898) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquiring lock "refresh_cache-11704034-7afe-475c-ae43-1324b40f0d92" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquired lock "refresh_cache-11704034-7afe-475c-ae43-1324b40f0d92" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG nova.network.neutron [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG nova.compute.manager [req-99ec3567-38f1-44a0-a0c5-686f8cbbf5f8 req-1e6eb918-5a0c-461e-8eea-dfcdf8e486ac service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Received event network-vif-unplugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-99ec3567-38f1-44a0-a0c5-686f8cbbf5f8 req-1e6eb918-5a0c-461e-8eea-dfcdf8e486ac service nova] Acquiring lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-99ec3567-38f1-44a0-a0c5-686f8cbbf5f8 req-1e6eb918-5a0c-461e-8eea-dfcdf8e486ac service nova] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-99ec3567-38f1-44a0-a0c5-686f8cbbf5f8 req-1e6eb918-5a0c-461e-8eea-dfcdf8e486ac service nova] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG nova.compute.manager [req-99ec3567-38f1-44a0-a0c5-686f8cbbf5f8 req-1e6eb918-5a0c-461e-8eea-dfcdf8e486ac service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] No waiting events found dispatching network-vif-unplugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:05:13 user nova-compute[74898]: WARNING nova.compute.manager [req-99ec3567-38f1-44a0-a0c5-686f8cbbf5f8 req-1e6eb918-5a0c-461e-8eea-dfcdf8e486ac service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Received unexpected event network-vif-unplugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f for instance with vm_state rescued and task_state unrescuing.
Nov 17 03:05:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:13 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Instance destroyed successfully.
Nov 17 03:05:13 user nova-compute[74898]: DEBUG nova.compute.manager [req-566ae808-443e-4946-baf4-f0f0518ce102 req-f80de4f1-da4a-4ba4-99b6-c8f70fb39a8e service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Received event network-changed-9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG nova.compute.manager [req-566ae808-443e-4946-baf4-f0f0518ce102 req-f80de4f1-da4a-4ba4-99b6-c8f70fb39a8e service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Refreshing instance network info cache due to event network-changed-9d80c52a-1fc2-43ca-bed1-126c6b8e204f. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-566ae808-443e-4946-baf4-f0f0518ce102 req-f80de4f1-da4a-4ba4-99b6-c8f70fb39a8e service nova] Acquiring lock "refresh_cache-015ff42a-4d69-4f60-b86c-c6bd68d23c99" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-566ae808-443e-4946-baf4-f0f0518ce102 req-f80de4f1-da4a-4ba4-99b6-c8f70fb39a8e service nova] Acquired lock "refresh_cache-015ff42a-4d69-4f60-b86c-c6bd68d23c99" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG nova.network.neutron [req-566ae808-443e-4946-baf4-f0f0518ce102 req-f80de4f1-da4a-4ba4-99b6-c8f70fb39a8e service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Refreshing network info cache for port 9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG nova.network.neutron [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Updating instance_info_cache with network_info: [{"id": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "address": "fa:16:3e:98:61:d2", "network": {"id": "ff76f13f-ae63-4dd0-a219-894c6ae65c00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1502020482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b79304b161b748c4b105640273979318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d1282-04", "ovs_interfaceid": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Releasing lock "refresh_cache-11704034-7afe-475c-ae43-1324b40f0d92" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG os_brick.utils [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60fa3b2-4185-4169-b25f-bf0f3f9b352f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5193c83-63d0-4493-8775-1e7020ea2c4c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d48e697-e296-46f4-a4df-5ec19420a921]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca6bede-86c6-406f-9756-7a17803074a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:05:14 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:05:14 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:14 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:05:14 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:05:14 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58d60f8-d5b7-4ef2-b977-fd076c92b558]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:14 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:05:14 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:05:14 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:05:14 user nova-compute[74898]: DEBUG os_brick.utils [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:05:14 user nova-compute[74898]: DEBUG nova.network.neutron [req-566ae808-443e-4946-baf4-f0f0518ce102 req-f80de4f1-da4a-4ba4-99b6-c8f70fb39a8e service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Updated VIF entry in instance network info cache for port 9d80c52a-1fc2-43ca-bed1-126c6b8e204f. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:05:14 user nova-compute[74898]: DEBUG nova.network.neutron [req-566ae808-443e-4946-baf4-f0f0518ce102 req-f80de4f1-da4a-4ba4-99b6-c8f70fb39a8e service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Updating instance_info_cache with network_info: [{"id": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "address": "fa:16:3e:88:21:6c", "network": {"id": "bf964a06-b5fd-41c4-9dfe-5d485019bbdd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-848964430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74014d7708574848bee4da7056ab1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d80c52a-1f", "ovs_interfaceid": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:05:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-566ae808-443e-4946-baf4-f0f0518ce102 req-f80de4f1-da4a-4ba4-99b6-c8f70fb39a8e service nova] Releasing lock "refresh_cache-015ff42a-4d69-4f60-b86c-c6bd68d23c99" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:05:14 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:05:14 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:05:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:15 user nova-compute[74898]: DEBUG nova.compute.manager [req-a8b6a930-c19b-44f2-b87d-b2c27af3ea10 req-a22ff1d7-e6c1-44dc-854f-caaafd681c8e service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Received event network-vif-plugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a8b6a930-c19b-44f2-b87d-b2c27af3ea10 req-a22ff1d7-e6c1-44dc-854f-caaafd681c8e service nova] Acquiring lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a8b6a930-c19b-44f2-b87d-b2c27af3ea10 req-a22ff1d7-e6c1-44dc-854f-caaafd681c8e service nova] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a8b6a930-c19b-44f2-b87d-b2c27af3ea10 req-a22ff1d7-e6c1-44dc-854f-caaafd681c8e service nova] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:15 user nova-compute[74898]: DEBUG nova.compute.manager [req-a8b6a930-c19b-44f2-b87d-b2c27af3ea10 req-a22ff1d7-e6c1-44dc-854f-caaafd681c8e service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] No waiting events found dispatching network-vif-plugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:05:15 user nova-compute[74898]: WARNING nova.compute.manager [req-a8b6a930-c19b-44f2-b87d-b2c27af3ea10 req-a22ff1d7-e6c1-44dc-854f-caaafd681c8e service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Received unexpected event network-vif-plugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f for instance with vm_state rescued and task_state unrescuing.
Nov 17 03:05:15 user nova-compute[74898]: DEBUG nova.compute.manager [req-a8b6a930-c19b-44f2-b87d-b2c27af3ea10 req-a22ff1d7-e6c1-44dc-854f-caaafd681c8e service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Received event network-vif-plugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a8b6a930-c19b-44f2-b87d-b2c27af3ea10 req-a22ff1d7-e6c1-44dc-854f-caaafd681c8e service nova] Acquiring lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a8b6a930-c19b-44f2-b87d-b2c27af3ea10 req-a22ff1d7-e6c1-44dc-854f-caaafd681c8e service nova] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a8b6a930-c19b-44f2-b87d-b2c27af3ea10 req-a22ff1d7-e6c1-44dc-854f-caaafd681c8e service nova] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:15 user nova-compute[74898]: DEBUG nova.compute.manager [req-a8b6a930-c19b-44f2-b87d-b2c27af3ea10 req-a22ff1d7-e6c1-44dc-854f-caaafd681c8e service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] No waiting events found dispatching network-vif-plugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:05:15 user nova-compute[74898]: WARNING nova.compute.manager [req-a8b6a930-c19b-44f2-b87d-b2c27af3ea10 req-a22ff1d7-e6c1-44dc-854f-caaafd681c8e service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Received unexpected event network-vif-plugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f for instance with vm_state rescued and task_state unrescuing.
Nov 17 03:05:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:15 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:05:15 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:05:15 user nova-compute[74898]: DEBUG nova.compute.manager [req-59258a6b-a82f-47b9-a668-34b9c464365e req-7c3023ce-1be3-48cb-a624-e9e992c2997e service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Received event network-changed-9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:15 user nova-compute[74898]: DEBUG nova.compute.manager [req-59258a6b-a82f-47b9-a668-34b9c464365e req-7c3023ce-1be3-48cb-a624-e9e992c2997e service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Refreshing instance network info cache due to event network-changed-9d80c52a-1fc2-43ca-bed1-126c6b8e204f. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:05:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-59258a6b-a82f-47b9-a668-34b9c464365e req-7c3023ce-1be3-48cb-a624-e9e992c2997e service nova] Acquiring lock "refresh_cache-015ff42a-4d69-4f60-b86c-c6bd68d23c99" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:05:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-59258a6b-a82f-47b9-a668-34b9c464365e req-7c3023ce-1be3-48cb-a624-e9e992c2997e service nova] Acquired lock "refresh_cache-015ff42a-4d69-4f60-b86c-c6bd68d23c99" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:05:15 user nova-compute[74898]: DEBUG nova.network.neutron [req-59258a6b-a82f-47b9-a668-34b9c464365e req-7c3023ce-1be3-48cb-a624-e9e992c2997e service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Refreshing network info cache for port 9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:05:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:16 user nova-compute[74898]: DEBUG nova.network.neutron [req-59258a6b-a82f-47b9-a668-34b9c464365e req-7c3023ce-1be3-48cb-a624-e9e992c2997e service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Updated VIF entry in instance network info cache for port 9d80c52a-1fc2-43ca-bed1-126c6b8e204f. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:05:16 user nova-compute[74898]: DEBUG nova.network.neutron [req-59258a6b-a82f-47b9-a668-34b9c464365e req-7c3023ce-1be3-48cb-a624-e9e992c2997e service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Updating instance_info_cache with network_info: [{"id": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "address": "fa:16:3e:88:21:6c", "network": {"id": "bf964a06-b5fd-41c4-9dfe-5d485019bbdd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-848964430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74014d7708574848bee4da7056ab1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d80c52a-1f", "ovs_interfaceid": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:05:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-59258a6b-a82f-47b9-a668-34b9c464365e req-7c3023ce-1be3-48cb-a624-e9e992c2997e service nova] Releasing lock "refresh_cache-015ff42a-4d69-4f60-b86c-c6bd68d23c99" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:05:16 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:05:16 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:05:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:05:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:05:16 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:05:17 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Updating instance_info_cache with network_info: [{"id": "ba899c72-f082-46fe-9a32-b548a4d653e2", "address": "fa:16:3e:95:22:a1", "network": {"id": "7ed585ab-8901-4ced-a881-2dd15371baa7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-738644687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d29dfc5e055942b4af680a17e5b1de13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba899c72-f0", "ovs_interfaceid": "ba899c72-f082-46fe-9a32-b548a4d653e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:05:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:05:17 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:05:17 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:05:17 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:05:17 user nova-compute[74898]: DEBUG nova.compute.manager [req-7c95daa6-2f87-43ea-a288-1cc9ed7fa120 req-76f7cf1e-ed44-4138-ac4b-6c86b04c2cba service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Received event network-vif-plugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7c95daa6-2f87-43ea-a288-1cc9ed7fa120 req-76f7cf1e-ed44-4138-ac4b-6c86b04c2cba service nova] Acquiring lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7c95daa6-2f87-43ea-a288-1cc9ed7fa120 req-76f7cf1e-ed44-4138-ac4b-6c86b04c2cba service nova] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7c95daa6-2f87-43ea-a288-1cc9ed7fa120 req-76f7cf1e-ed44-4138-ac4b-6c86b04c2cba service nova] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:17 user nova-compute[74898]: DEBUG nova.compute.manager [req-7c95daa6-2f87-43ea-a288-1cc9ed7fa120 req-76f7cf1e-ed44-4138-ac4b-6c86b04c2cba service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] No waiting events found dispatching network-vif-plugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:05:17 user nova-compute[74898]: WARNING nova.compute.manager [req-7c95daa6-2f87-43ea-a288-1cc9ed7fa120 req-76f7cf1e-ed44-4138-ac4b-6c86b04c2cba service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Received unexpected event network-vif-plugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f for instance with vm_state rescued and task_state unrescuing.
Nov 17 03:05:17 user nova-compute[74898]: DEBUG nova.compute.manager [None req-5de6e488-a2a0-406a-9c7d-e789a3a971a7 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:05:17 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:05:17 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:05:17 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:05:17 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Cleaning up deleted instances {{(pid=74898) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 17 03:05:17 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] There are 0 instances to clean {{(pid=74898) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 17 03:05:19 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:05:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:19 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:05:19 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Starting finish_revert_migration {{(pid=74898) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Start _get_guest_xml network_info=[{"id": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "address": "fa:16:3e:98:61:d2", "network": {"id": "ff76f13f-ae63-4dd0-a219-894c6ae65c00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1502020482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b79304b161b748c4b105640273979318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d1282-04", "ovs_interfaceid": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpmzNxqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '11704034-7afe-475c-ae43-1324b40f0d92', 'attached_at': '2023-11-17T03:05:20.000000', 'detached_at': '', 'volume_id': '2efad82a-fd47-4649-8ce0-ba22f7a22f45', 'serial': '2efad82a-fd47-4649-8ce0-ba22f7a22f45'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'f2a74eca-9bdd-4356-a351-9585b889932d', 'volume_type': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:05:20 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:05:20 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:05:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG nova.objects.instance [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lazy-loading 'vcpu_model' on Instance uuid 11704034-7afe-475c-ae43-1324b40f0d92 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpmzNxqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:05:20 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:05:20 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:05:20 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:05:20 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:05:20 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[88173f4f-120b-44a6-8ef9-e4691d5a2a69]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:05:20 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[791e1202-4bb3-4b14-b365-152db4506d62]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45] added
Nov 17 03:05:20 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e14fa7-ba36-4e57-b586-5def608de18f]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[20455b6e-31d3-44d2-9e7f-688b8b64b303]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HpmzNxqO {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HpmzNxqO" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83c6a73-8b2f-4b05-82b5-826b09feab20]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HpmzNxqO'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad37a8c7-7335-4c14-b474-6a8d44f68d0a]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8a1f2a-5437-4f35-b8f4-ba495f7d1bd2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:05:20 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:05:20 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:05:20 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:05:20 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:05:20 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:05:20 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:05:20 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:05:20 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:05:20 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:05:20 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:05:20 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:05:20 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[86698325-ac1c-48dd-8429-880ed6756eae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45, portal: 172.16.0.220,3260]
Nov 17 03:05:20 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45, portal: 172.16.0.220,3260] successful.
Nov 17 03:05:20 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[541b16e3-3b33-49f8-8868-127b1b0deda3]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffd674a-b567-4e03-b5f3-a993784a951a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:05:20 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:05:20 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:05:20 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:05:20 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:05:20 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:05:20 user nova-compute[74898]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:05:20 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:05:20 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:05:20 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:05:20 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:05:20 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:05:20 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:05:20 user nova-compute[74898]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:05:20 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05dc3cd-30e7-41de-a31b-2a10a2aa70ab]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: None {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:21 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d1ee03a5-13fb-47e7-8712-ea31aed36643 is timed out.
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk --force-share --output=json" returned: 0 in 0.325s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:21 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Successfully detached device vdb from instance d1ee03a5-13fb-47e7-8712-ea31aed36643 from the live domain config.
Nov 17 03:05:21 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NCAhvgdo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:05:21 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:05:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpmzNxqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.418s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '26136373566326237', 'path': '/dev/sdd'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136373566326237', 'path': '/dev/sdd'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.165s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bac4dcd-5d4c-4c5d-9b02-1c88f8241676]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:05:21 user nova-compute[74898]: No targets found.
Nov 17 03:05:21 user nova-compute[74898]: iSNS:
Nov 17 03:05:21 user nova-compute[74898]: No targets found.
Nov 17 03:05:21 user nova-compute[74898]: STATIC:
Nov 17 03:05:21 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981
Nov 17 03:05:21 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:05:21 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:05:21 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45
Nov 17 03:05:21 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:05:21 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:05:21 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248
Nov 17 03:05:21 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:05:21 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:05:21 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484
Nov 17 03:05:21 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:05:21 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:05:21 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0
Nov 17 03:05:21 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:05:21 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:05:21 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4
Nov 17 03:05:21 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:05:21 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:05:21 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8
Nov 17 03:05:21 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:05:21 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:05:21 user nova-compute[74898]: FIRMWARE:
Nov 17 03:05:21 user nova-compute[74898]: No targets found.
Nov 17 03:05:21 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:05:21 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:05:21 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f824dd95-6644-4ae0-b5ff-18c7818a53b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2234992',display_name='tempest-ServerActionsTestOtherB-server-2234992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2234992',id=4,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDa4qtus/f7IjtzuxUsFF91hKDL1YzX3TcJUCEJl5/APKTelpFkHRN746k1MAjDCvCv80GeN8KM6dto88zEniSlfqFbxPMUk2N38IhkUm1HO5g3tqYF+QbpzM60KAg8lAA==',key_name='tempest-keypair-562322790',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:03:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b79304b161b748c4b105640273979318',ramdisk_id='',reservation_id='r-p8pu7pmp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1831504115',owner_user_name='tempest-ServerActionsTestOtherB-1831504115-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:05:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92e234cf0f444581b2fa827b116959aa',uuid=11704034-7afe-475c-ae43-1324b40f0d92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "address": "fa:16:3e:98:61:d2", "network": {"id": "ff76f13f-ae63-4dd0-a219-894c6ae65c00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1502020482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b79304b161b748c4b105640273979318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d1282-04", "ovs_interfaceid": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Converting VIF {"id": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "address": "fa:16:3e:98:61:d2", "network": {"id": "ff76f13f-ae63-4dd0-a219-894c6ae65c00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1502020482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b79304b161b748c4b105640273979318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d1282-04", "ovs_interfaceid": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:61:d2,bridge_name='br-int',has_traffic_filtering=True,id=7f2d1282-0400-4c1e-890d-46a51040a8b5,network=Network(ff76f13f-ae63-4dd0-a219-894c6ae65c00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d1282-04') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:05:21 user nova-compute[74898]:   <uuid>11704034-7afe-475c-ae43-1324b40f0d92</uuid>
Nov 17 03:05:21 user nova-compute[74898]:   <name>instance-00000004</name>
Nov 17 03:05:21 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:05:21 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:05:21 user nova-compute[74898]:   <metadata>
Nov 17 03:05:21 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:05:21 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:05:21 user nova-compute[74898]:       <nova:name>tempest-ServerActionsTestOtherB-server-2234992</nova:name>
Nov 17 03:05:21 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:05:20</nova:creationTime>
Nov 17 03:05:21 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:05:21 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:05:21 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:05:21 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:05:21 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:05:21 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:05:21 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:05:21 user nova-compute[74898]:       <nova:owner>
Nov 17 03:05:21 user nova-compute[74898]:         <nova:user uuid="92e234cf0f444581b2fa827b116959aa">tempest-ServerActionsTestOtherB-1831504115-project-member</nova:user>
Nov 17 03:05:21 user nova-compute[74898]:         <nova:project uuid="b79304b161b748c4b105640273979318">tempest-ServerActionsTestOtherB-1831504115</nova:project>
Nov 17 03:05:21 user nova-compute[74898]:       </nova:owner>
Nov 17 03:05:21 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:05:21 user nova-compute[74898]:       <nova:ports>
Nov 17 03:05:21 user nova-compute[74898]:         <nova:port uuid="7f2d1282-0400-4c1e-890d-46a51040a8b5">
Nov 17 03:05:21 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 17 03:05:21 user nova-compute[74898]:         </nova:port>
Nov 17 03:05:21 user nova-compute[74898]:       </nova:ports>
Nov 17 03:05:21 user nova-compute[74898]:     </nova:instance>
Nov 17 03:05:21 user nova-compute[74898]:   </metadata>
Nov 17 03:05:21 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:05:21 user nova-compute[74898]:     <system>
Nov 17 03:05:21 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:05:21 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:05:21 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:05:21 user nova-compute[74898]:       <entry name="serial">11704034-7afe-475c-ae43-1324b40f0d92</entry>
Nov 17 03:05:21 user nova-compute[74898]:       <entry name="uuid">11704034-7afe-475c-ae43-1324b40f0d92</entry>
Nov 17 03:05:21 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:05:21 user nova-compute[74898]:     </system>
Nov 17 03:05:21 user nova-compute[74898]:   </sysinfo>
Nov 17 03:05:21 user nova-compute[74898]:   <os>
Nov 17 03:05:21 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:05:21 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:05:21 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:05:21 user nova-compute[74898]:   </os>
Nov 17 03:05:21 user nova-compute[74898]:   <features>
Nov 17 03:05:21 user nova-compute[74898]:     <acpi/>
Nov 17 03:05:21 user nova-compute[74898]:     <apic/>
Nov 17 03:05:21 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:05:21 user nova-compute[74898]:   </features>
Nov 17 03:05:21 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:05:21 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:05:21 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:05:21 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:05:21 user nova-compute[74898]:   </clock>
Nov 17 03:05:21 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:05:21 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:05:21 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:05:21 user nova-compute[74898]:   </cpu>
Nov 17 03:05:21 user nova-compute[74898]:   <devices>
Nov 17 03:05:21 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:05:21 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:05:21 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk"/>
Nov 17 03:05:21 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:05:21 user nova-compute[74898]:     </disk>
Nov 17 03:05:21 user nova-compute[74898]:     <disk type="block" device="disk">
Nov 17 03:05:21 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:05:21 user nova-compute[74898]:       <source dev="/dev/sdd"/>
Nov 17 03:05:21 user nova-compute[74898]:       <target dev="vdb" bus="virtio"/>
Nov 17 03:05:21 user nova-compute[74898]:       <serial>2efad82a-fd47-4649-8ce0-ba22f7a22f45</serial>
Nov 17 03:05:21 user nova-compute[74898]:     </disk>
Nov 17 03:05:21 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:05:21 user nova-compute[74898]:       <mac address="fa:16:3e:98:61:d2"/>
Nov 17 03:05:21 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:05:21 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:05:21 user nova-compute[74898]:       <target dev="tap7f2d1282-04"/>
Nov 17 03:05:21 user nova-compute[74898]:     </interface>
Nov 17 03:05:21 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:05:21 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/console.log" append="off"/>
Nov 17 03:05:21 user nova-compute[74898]:     </serial>
Nov 17 03:05:21 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:05:21 user nova-compute[74898]:     <video>
Nov 17 03:05:21 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:05:21 user nova-compute[74898]:     </video>
Nov 17 03:05:21 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:05:21 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:05:21 user nova-compute[74898]:     </rng>
Nov 17 03:05:21 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:05:21 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:05:21 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:05:21 user nova-compute[74898]:     </memballoon>
Nov 17 03:05:21 user nova-compute[74898]:   </devices>
Nov 17 03:05:21 user nova-compute[74898]: </domain>
Nov 17 03:05:21 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2234992',display_name='tempest-ServerActionsTestOtherB-server-2234992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2234992',id=4,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDa4qtus/f7IjtzuxUsFF91hKDL1YzX3TcJUCEJl5/APKTelpFkHRN746k1MAjDCvCv80GeN8KM6dto88zEniSlfqFbxPMUk2N38IhkUm1HO5g3tqYF+QbpzM60KAg8lAA==',key_name='tempest-keypair-562322790',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:03:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b79304b161b748c4b105640273979318',ramdisk_id='',reservation_id='r-p8pu7pmp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1831504115',owner_user_name='tempest-ServerActionsTestOtherB-1831504115-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:05:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92e234cf0f444581b2fa827b116959aa',uuid=11704034-7afe-475c-ae43-1324b40f0d92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "address": "fa:16:3e:98:61:d2", "network": {"id": "ff76f13f-ae63-4dd0-a219-894c6ae65c00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1502020482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b79304b161b748c4b105640273979318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d1282-04", "ovs_interfaceid": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Converting VIF {"id": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "address": "fa:16:3e:98:61:d2", "network": {"id": "ff76f13f-ae63-4dd0-a219-894c6ae65c00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1502020482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b79304b161b748c4b105640273979318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d1282-04", "ovs_interfaceid": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:61:d2,bridge_name='br-int',has_traffic_filtering=True,id=7f2d1282-0400-4c1e-890d-46a51040a8b5,network=Network(ff76f13f-ae63-4dd0-a219-894c6ae65c00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d1282-04') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG os_vif [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:61:d2,bridge_name='br-int',has_traffic_filtering=True,id=7f2d1282-0400-4c1e-890d-46a51040a8b5,network=Network(ff76f13f-ae63-4dd0-a219-894c6ae65c00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d1282-04') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '457151b7-1d1f-509b-b2a3-45e9b9ae8a65', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7defec-8d5f-41a8-8ab5-deb4d859e089]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:05:21 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:05:21 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:05:21 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:05:21 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:05:21 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:05:21 user nova-compute[74898]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:05:21 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 (non-flash)
Nov 17 03:05:21 user nova-compute[74898]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:05:21 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:05:21 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:05:21 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:05:21 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:05:21 user nova-compute[74898]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:05:21 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf86c0790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8'): ({'sde'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Removing single pathed devices sde {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f2d1282-04, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f2d1282-04, col_values=(('qos', UUID('48332543-633f-451b-9b3f-2b1911bea4a6')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f2d1282-04, col_values=(('external_ids', {'iface-id': '7f2d1282-0400-4c1e-890d-46a51040a8b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:61:d2', 'vm-uuid': '11704034-7afe-475c-ae43-1324b40f0d92'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cc00a8-c296-4b07-a6d3-2e2c815320f1]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:21 user nova-compute[74898]: INFO os_vif [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:61:d2,bridge_name='br-int',has_traffic_filtering=True,id=7f2d1282-0400-4c1e-890d-46a51040a8b5,network=Network(ff76f13f-ae63-4dd0-a219-894c6ae65c00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d1282-04')
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[79485f99-b3a1-4a16-a9dc-6880a66d1952]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Flushing IO for device /dev/sde {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[373ffdb1-67e5-4ea4-b093-2800b13ee970]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd15160d-015e-424a-b928-a93077b34067]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] SCSI volumes sde have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dffa945-7372-4623-a829-08fcb9bc702a]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.098s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5886f509-80a8-47fa-bc91-13d36363e655]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8, portal: 172.16.0.220,3260]
Nov 17 03:05:21 user nova-compute[74898]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8, portal: 172.16.0.220,3260] successful.
Nov 17 03:05:21 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:441761f8-0044-43bc-8437-f31147d6c4f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4dd3dc-b04c-4e55-b49f-0036732ba609]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.460s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] <== disconnect_volume: return (626ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:05:21 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:05:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json" returned: 0 in 0.249s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:22 user nova-compute[74898]: DEBUG nova.objects.instance [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lazy-loading 'flavor' on Instance uuid d1ee03a5-13fb-47e7-8712-ea31aed36643 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:05:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e1d295f-4bcf-41a1-8b38-e70739f7c0e5 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "d1ee03a5-13fb-47e7-8712-ea31aed36643" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.367s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:23 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:05:23 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:05:23 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:05:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:23 user nova-compute[74898]: DEBUG nova.compute.manager [req-dbf453ec-87cd-4601-9393-ef8a7a41bafc req-c8006601-b1a6-4277-8db4-4683e301111e service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received event network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-dbf453ec-87cd-4601-9393-ef8a7a41bafc req-c8006601-b1a6-4277-8db4-4683e301111e service nova] Acquiring lock "11704034-7afe-475c-ae43-1324b40f0d92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-dbf453ec-87cd-4601-9393-ef8a7a41bafc req-c8006601-b1a6-4277-8db4-4683e301111e service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-dbf453ec-87cd-4601-9393-ef8a7a41bafc req-c8006601-b1a6-4277-8db4-4683e301111e service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:23 user nova-compute[74898]: DEBUG nova.compute.manager [req-dbf453ec-87cd-4601-9393-ef8a7a41bafc req-c8006601-b1a6-4277-8db4-4683e301111e service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] No waiting events found dispatching network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:05:23 user nova-compute[74898]: WARNING nova.compute.manager [req-dbf453ec-87cd-4601-9393-ef8a7a41bafc req-c8006601-b1a6-4277-8db4-4683e301111e service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received unexpected event network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 for instance with vm_state resized and task_state resize_reverting.
Nov 17 03:05:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:23 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:05:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474a469d-9ebe-4e91-9ec4-3f610bdd4d27/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474a469d-9ebe-4e91-9ec4-3f610bdd4d27/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474a469d-9ebe-4e91-9ec4-3f610bdd4d27/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474a469d-9ebe-4e91-9ec4-3f610bdd4d27/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG nova.compute.manager [req-17ab40c3-3dfd-44c6-a5e6-a8586eee23e1 req-fb97429b-945e-4a90-b6dd-66a7556a0327 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received event network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-17ab40c3-3dfd-44c6-a5e6-a8586eee23e1 req-fb97429b-945e-4a90-b6dd-66a7556a0327 service nova] Acquiring lock "11704034-7afe-475c-ae43-1324b40f0d92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-17ab40c3-3dfd-44c6-a5e6-a8586eee23e1 req-fb97429b-945e-4a90-b6dd-66a7556a0327 service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-17ab40c3-3dfd-44c6-a5e6-a8586eee23e1 req-fb97429b-945e-4a90-b6dd-66a7556a0327 service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG nova.compute.manager [req-17ab40c3-3dfd-44c6-a5e6-a8586eee23e1 req-fb97429b-945e-4a90-b6dd-66a7556a0327 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] No waiting events found dispatching network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:05:26 user nova-compute[74898]: WARNING nova.compute.manager [req-17ab40c3-3dfd-44c6-a5e6-a8586eee23e1 req-fb97429b-945e-4a90-b6dd-66a7556a0327 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received unexpected event network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 for instance with vm_state resized and task_state resize_reverting.
Nov 17 03:05:26 user nova-compute[74898]: DEBUG nova.compute.manager [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:05:26 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Instance running successfully.
Nov 17 03:05:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] finish_revert_migration finished successfully. {{(pid=74898) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 17 03:05:26 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:05:26 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:05:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=7284MB free_disk=25.39315414428711GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:26 user nova-compute[74898]: INFO nova.compute.manager [None req-de44b0a8-6f97-42d4-9411-c98b909b843a tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Updating instance to original state: 'active'
Nov 17 03:05:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance e733574a-56ba-4e24-babd-855bcb5bda61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 015ff42a-4d69-4f60-b86c-c6bd68d23c99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance d1ee03a5-13fb-47e7-8712-ea31aed36643 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 36e687c0-9481-4126-b365-f7f9707e2338 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 11704034-7afe-475c-ae43-1324b40f0d92 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 474a469d-9ebe-4e91-9ec4-3f610bdd4d27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 42994e39-187a-4fb6-a293-24a4eb57177b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance dbaabab0-92f0-480d-8f81-0db980c8f333 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance b94a0a17-77e9-41cf-9919-37b57b364ff2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Refreshing inventories for resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Updating ProviderTree inventory for provider b743bdc9-a8bb-467c-98c8-06f1954f87df from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Updating inventory in ProviderTree for provider b743bdc9-a8bb-467c-98c8-06f1954f87df with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Refreshing aggregate associations for resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df, aggregates: None {{(pid=74898) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Refreshing trait associations for resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=74898) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.882s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:05:26 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Cleaning up deleted instances with incomplete migration  {{(pid=74898) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 17 03:05:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4ed6d0aa-d57d-444a-b9c2-ed89c733ef45 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Acquiring lock "9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4ed6d0aa-d57d-444a-b9c2-ed89c733ef45 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4ed6d0aa-d57d-444a-b9c2-ed89c733ef45 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Acquiring lock "9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4ed6d0aa-d57d-444a-b9c2-ed89c733ef45 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4ed6d0aa-d57d-444a-b9c2-ed89c733ef45 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:27 user nova-compute[74898]: INFO nova.compute.manager [None req-4ed6d0aa-d57d-444a-b9c2-ed89c733ef45 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Terminating instance
Nov 17 03:05:27 user nova-compute[74898]: DEBUG nova.compute.manager [None req-4ed6d0aa-d57d-444a-b9c2-ed89c733ef45 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:05:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:27 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:05:27 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:05:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:28 user nova-compute[74898]: DEBUG nova.compute.manager [req-c93d83ee-0872-4f1b-8709-36990b50dbb5 req-594b61d4-c220-4371-ba9c-4b447e2aba39 service nova] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Received event network-vif-unplugged-ba899c72-f082-46fe-9a32-b548a4d653e2 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c93d83ee-0872-4f1b-8709-36990b50dbb5 req-594b61d4-c220-4371-ba9c-4b447e2aba39 service nova] Acquiring lock "9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c93d83ee-0872-4f1b-8709-36990b50dbb5 req-594b61d4-c220-4371-ba9c-4b447e2aba39 service nova] Lock "9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c93d83ee-0872-4f1b-8709-36990b50dbb5 req-594b61d4-c220-4371-ba9c-4b447e2aba39 service nova] Lock "9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:28 user nova-compute[74898]: DEBUG nova.compute.manager [req-c93d83ee-0872-4f1b-8709-36990b50dbb5 req-594b61d4-c220-4371-ba9c-4b447e2aba39 service nova] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] No waiting events found dispatching network-vif-unplugged-ba899c72-f082-46fe-9a32-b548a4d653e2 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:05:28 user nova-compute[74898]: DEBUG nova.compute.manager [req-c93d83ee-0872-4f1b-8709-36990b50dbb5 req-594b61d4-c220-4371-ba9c-4b447e2aba39 service nova] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Received event network-vif-unplugged-ba899c72-f082-46fe-9a32-b548a4d653e2 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:05:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:28 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Instance destroyed successfully.
Nov 17 03:05:28 user nova-compute[74898]: DEBUG nova.objects.instance [None req-4ed6d0aa-d57d-444a-b9c2-ed89c733ef45 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lazy-loading 'resources' on Instance uuid 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:05:28 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-4ed6d0aa-d57d-444a-b9c2-ed89c733ef45 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:59:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-726055417',display_name='tempest-VolumesAdminNegativeTest-server-726055417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-726055417',id=6,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC30BrfPqQJDfgorM4ZQwReNDojCk1D3CWtwBgzqiFO5igPwDfPE9xhJE1EdMhEjyqP3+A5AjzF+qtbW94MQ9WK/XN91KuFz/V8SFGJQqwdTqlIiD72gHluqQ7pz+yWrvA==',key_name='tempest-keypair-1435574687',keypairs=<?>,launch_index=0,launched_at=2023-11-17T02:59:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d29dfc5e055942b4af680a17e5b1de13',ramdisk_id='',reservation_id='r-x8ga30py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1538245231',owner_user_name='tempest-VolumesAdminNegativeTest-1538245231-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T02:59:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a8202cbeb204cd38b3f8daa90578dbf',uuid=9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba899c72-f082-46fe-9a32-b548a4d653e2", "address": "fa:16:3e:95:22:a1", "network": {"id": "7ed585ab-8901-4ced-a881-2dd15371baa7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-738644687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d29dfc5e055942b4af680a17e5b1de13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba899c72-f0", "ovs_interfaceid": "ba899c72-f082-46fe-9a32-b548a4d653e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:05:28 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-4ed6d0aa-d57d-444a-b9c2-ed89c733ef45 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Converting VIF {"id": "ba899c72-f082-46fe-9a32-b548a4d653e2", "address": "fa:16:3e:95:22:a1", "network": {"id": "7ed585ab-8901-4ced-a881-2dd15371baa7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-738644687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d29dfc5e055942b4af680a17e5b1de13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba899c72-f0", "ovs_interfaceid": "ba899c72-f082-46fe-9a32-b548a4d653e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:05:28 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-4ed6d0aa-d57d-444a-b9c2-ed89c733ef45 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:22:a1,bridge_name='br-int',has_traffic_filtering=True,id=ba899c72-f082-46fe-9a32-b548a4d653e2,network=Network(7ed585ab-8901-4ced-a881-2dd15371baa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba899c72-f0') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:05:28 user nova-compute[74898]: DEBUG os_vif [None req-4ed6d0aa-d57d-444a-b9c2-ed89c733ef45 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:22:a1,bridge_name='br-int',has_traffic_filtering=True,id=ba899c72-f082-46fe-9a32-b548a4d653e2,network=Network(7ed585ab-8901-4ced-a881-2dd15371baa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba899c72-f0') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:05:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba899c72-f0, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:05:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e5cd3af-f354-483c-9423-149736520b4f) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:05:28 user nova-compute[74898]: INFO os_vif [None req-4ed6d0aa-d57d-444a-b9c2-ed89c733ef45 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:22:a1,bridge_name='br-int',has_traffic_filtering=True,id=ba899c72-f082-46fe-9a32-b548a4d653e2,network=Network(7ed585ab-8901-4ced-a881-2dd15371baa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba899c72-f0')
Nov 17 03:05:28 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-4ed6d0aa-d57d-444a-b9c2-ed89c733ef45 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Deleting instance files /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d_del
Nov 17 03:05:28 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-4ed6d0aa-d57d-444a-b9c2-ed89c733ef45 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Deletion of /opt/stack/data/nova/instances/9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d_del complete
Nov 17 03:05:28 user nova-compute[74898]: INFO nova.compute.manager [None req-4ed6d0aa-d57d-444a-b9c2-ed89c733ef45 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 17 03:05:28 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-4ed6d0aa-d57d-444a-b9c2-ed89c733ef45 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:05:28 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:05:28 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:05:29 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:05:29 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Took 0.75 seconds to deallocate network for instance.
Nov 17 03:05:29 user nova-compute[74898]: DEBUG nova.compute.manager [req-c32484b2-0242-4534-92f3-946c2fbc424e req-f260a0ac-0456-412e-9b49-341ab5bfdbfb service nova] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Received event network-vif-deleted-ba899c72-f082-46fe-9a32-b548a4d653e2 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:29 user nova-compute[74898]: INFO nova.compute.manager [req-c32484b2-0242-4534-92f3-946c2fbc424e req-f260a0ac-0456-412e-9b49-341ab5bfdbfb service nova] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Neutron deleted interface ba899c72-f082-46fe-9a32-b548a4d653e2; detaching it from the instance and deleting it from the info cache
Nov 17 03:05:29 user nova-compute[74898]: DEBUG nova.network.neutron [req-c32484b2-0242-4534-92f3-946c2fbc424e req-f260a0ac-0456-412e-9b49-341ab5bfdbfb service nova] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:05:29 user nova-compute[74898]: DEBUG nova.compute.manager [req-c32484b2-0242-4534-92f3-946c2fbc424e req-f260a0ac-0456-412e-9b49-341ab5bfdbfb service nova] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Detach interface failed, port_id=ba899c72-f082-46fe-9a32-b548a4d653e2, reason: Instance 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d could not be found. {{(pid=74898) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 03:05:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4ed6d0aa-d57d-444a-b9c2-ed89c733ef45 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4ed6d0aa-d57d-444a-b9c2-ed89c733ef45 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:29 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-4ed6d0aa-d57d-444a-b9c2-ed89c733ef45 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:05:30 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-4ed6d0aa-d57d-444a-b9c2-ed89c733ef45 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:05:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4ed6d0aa-d57d-444a-b9c2-ed89c733ef45 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.505s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:30 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-4ed6d0aa-d57d-444a-b9c2-ed89c733ef45 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Deleted allocations for instance 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d
Nov 17 03:05:30 user nova-compute[74898]: DEBUG nova.compute.manager [req-e2dde079-595c-4b34-a766-fdb45a3b7fa7 req-0a60af9c-b080-4264-891e-e707faa2e087 service nova] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Received event network-vif-plugged-ba899c72-f082-46fe-9a32-b548a4d653e2 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e2dde079-595c-4b34-a766-fdb45a3b7fa7 req-0a60af9c-b080-4264-891e-e707faa2e087 service nova] Acquiring lock "9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e2dde079-595c-4b34-a766-fdb45a3b7fa7 req-0a60af9c-b080-4264-891e-e707faa2e087 service nova] Lock "9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e2dde079-595c-4b34-a766-fdb45a3b7fa7 req-0a60af9c-b080-4264-891e-e707faa2e087 service nova] Lock "9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:30 user nova-compute[74898]: DEBUG nova.compute.manager [req-e2dde079-595c-4b34-a766-fdb45a3b7fa7 req-0a60af9c-b080-4264-891e-e707faa2e087 service nova] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] No waiting events found dispatching network-vif-plugged-ba899c72-f082-46fe-9a32-b548a4d653e2 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:05:30 user nova-compute[74898]: WARNING nova.compute.manager [req-e2dde079-595c-4b34-a766-fdb45a3b7fa7 req-0a60af9c-b080-4264-891e-e707faa2e087 service nova] [instance: 9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d] Received unexpected event network-vif-plugged-ba899c72-f082-46fe-9a32-b548a4d653e2 for instance with vm_state deleted and task_state None.
Nov 17 03:05:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4ed6d0aa-d57d-444a-b9c2-ed89c733ef45 tempest-VolumesAdminNegativeTest-1538245231 tempest-VolumesAdminNegativeTest-1538245231-project-member] Lock "9d67b806-a7b9-4cb6-b6f3-1483fc30fd7d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.488s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-66d163b0-95bf-4b78-ad7e-dafb21d44881 req-56f755a1-56ed-4370-8f29-c12ed002c223 service nova] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Received event network-changed-8b4bafcd-1db9-460a-bb53-3e92498fa50c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-66d163b0-95bf-4b78-ad7e-dafb21d44881 req-56f755a1-56ed-4370-8f29-c12ed002c223 service nova] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Refreshing instance network info cache due to event network-changed-8b4bafcd-1db9-460a-bb53-3e92498fa50c. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:05:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-66d163b0-95bf-4b78-ad7e-dafb21d44881 req-56f755a1-56ed-4370-8f29-c12ed002c223 service nova] Acquiring lock "refresh_cache-474a469d-9ebe-4e91-9ec4-3f610bdd4d27" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:05:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-66d163b0-95bf-4b78-ad7e-dafb21d44881 req-56f755a1-56ed-4370-8f29-c12ed002c223 service nova] Acquired lock "refresh_cache-474a469d-9ebe-4e91-9ec4-3f610bdd4d27" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:05:34 user nova-compute[74898]: DEBUG nova.network.neutron [req-66d163b0-95bf-4b78-ad7e-dafb21d44881 req-56f755a1-56ed-4370-8f29-c12ed002c223 service nova] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Refreshing network info cache for port 8b4bafcd-1db9-460a-bb53-3e92498fa50c {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:05:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Acquiring lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:34 user nova-compute[74898]: DEBUG nova.objects.instance [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lazy-loading 'flavor' on Instance uuid 474a469d-9ebe-4e91-9ec4-3f610bdd4d27 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:05:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:35 user nova-compute[74898]: DEBUG nova.network.neutron [req-66d163b0-95bf-4b78-ad7e-dafb21d44881 req-56f755a1-56ed-4370-8f29-c12ed002c223 service nova] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Updated VIF entry in instance network info cache for port 8b4bafcd-1db9-460a-bb53-3e92498fa50c. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:05:35 user nova-compute[74898]: DEBUG nova.network.neutron [req-66d163b0-95bf-4b78-ad7e-dafb21d44881 req-56f755a1-56ed-4370-8f29-c12ed002c223 service nova] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Updating instance_info_cache with network_info: [{"id": "8b4bafcd-1db9-460a-bb53-3e92498fa50c", "address": "fa:16:3e:28:47:a5", "network": {"id": "253a5a85-21b7-42d7-8893-2a97d76e7849", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1666014168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f0d4a6654645f49a5f57d48cc52d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4bafcd-1d", "ovs_interfaceid": "8b4bafcd-1db9-460a-bb53-3e92498fa50c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:05:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-66d163b0-95bf-4b78-ad7e-dafb21d44881 req-56f755a1-56ed-4370-8f29-c12ed002c223 service nova] Releasing lock "refresh_cache-474a469d-9ebe-4e91-9ec4-3f610bdd4d27" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:05:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Acquiring lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:35 user nova-compute[74898]: INFO nova.compute.manager [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Attaching volume a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 to /dev/vdb
Nov 17 03:05:35 user nova-compute[74898]: DEBUG os_brick.utils [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:05:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[036f7501-52dc-46b1-b547-065d727f965f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad7312d-48da-40b6-9a37-f54584d2f3da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09a698d-c048-496e-bb52-11b6c31487b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef521583-4739-4195-809c-038c6d1d2415]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:05:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:05:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:05:35 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:05:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[440b5e3d-4222-4e90-8cc2-7b0edb548084]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:05:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:05:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:05:35 user nova-compute[74898]: DEBUG os_brick.utils [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:05:35 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Updating existing volume attachment record: 3db9c3d4-ffc9-4983-9287-e16078974440 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:05:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:38 user nova-compute[74898]: DEBUG nova.compute.manager [req-8b20ca54-aabc-4caf-9795-64534be2e903 req-61e42cb7-09a7-4eb1-9521-ebb6bac4f2b9 service nova] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Received event network-changed-92a5885a-8cb1-43f8-906a-97d7fa08eb62 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:38 user nova-compute[74898]: DEBUG nova.compute.manager [req-8b20ca54-aabc-4caf-9795-64534be2e903 req-61e42cb7-09a7-4eb1-9521-ebb6bac4f2b9 service nova] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Refreshing instance network info cache due to event network-changed-92a5885a-8cb1-43f8-906a-97d7fa08eb62. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:05:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8b20ca54-aabc-4caf-9795-64534be2e903 req-61e42cb7-09a7-4eb1-9521-ebb6bac4f2b9 service nova] Acquiring lock "refresh_cache-42994e39-187a-4fb6-a293-24a4eb57177b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:05:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8b20ca54-aabc-4caf-9795-64534be2e903 req-61e42cb7-09a7-4eb1-9521-ebb6bac4f2b9 service nova] Acquired lock "refresh_cache-42994e39-187a-4fb6-a293-24a4eb57177b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:05:38 user nova-compute[74898]: DEBUG nova.network.neutron [req-8b20ca54-aabc-4caf-9795-64534be2e903 req-61e42cb7-09a7-4eb1-9521-ebb6bac4f2b9 service nova] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Refreshing network info cache for port 92a5885a-8cb1-43f8-906a-97d7fa08eb62 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:05:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:39 user nova-compute[74898]: DEBUG nova.network.neutron [req-8b20ca54-aabc-4caf-9795-64534be2e903 req-61e42cb7-09a7-4eb1-9521-ebb6bac4f2b9 service nova] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Updated VIF entry in instance network info cache for port 92a5885a-8cb1-43f8-906a-97d7fa08eb62. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:05:39 user nova-compute[74898]: DEBUG nova.network.neutron [req-8b20ca54-aabc-4caf-9795-64534be2e903 req-61e42cb7-09a7-4eb1-9521-ebb6bac4f2b9 service nova] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Updating instance_info_cache with network_info: [{"id": "92a5885a-8cb1-43f8-906a-97d7fa08eb62", "address": "fa:16:3e:ab:28:fe", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a5885a-8c", "ovs_interfaceid": "92a5885a-8cb1-43f8-906a-97d7fa08eb62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:05:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8b20ca54-aabc-4caf-9795-64534be2e903 req-61e42cb7-09a7-4eb1-9521-ebb6bac4f2b9 service nova] Releasing lock "refresh_cache-42994e39-187a-4fb6-a293-24a4eb57177b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:05:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'frPOnDuL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:05:41 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:05:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:05:41 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:05:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:05:41 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3643cd-8ded-4aab-8a83-33cabced7fe9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:05:41 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[911db1e5-5176-4d42-82b1-d87a2517340d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146] added
Nov 17 03:05:41 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb95a5f4-846b-4640-a38a-f9eff30ddfa9]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a734fa-fec7-46e5-a1da-831e29eb6457]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v frPOnDuL {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v frPOnDuL" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[40954829-c4c0-4d1d-b443-b09a0a991b7d]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'frPOnDuL'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9a1818-bcd5-443e-a960-94c916a9b03b]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b50a0a-6ef7-4038-b06d-2e46a03c281f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:05:41 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:05:41 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:05:41 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:05:41 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:05:41 user nova-compute[74898]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:05:41 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:05:41 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:05:41 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:05:41 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:05:41 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:05:41 user nova-compute[74898]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:05:41 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[704a11ca-b021-4a9d-b9b9-51796b880805]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146, portal: 172.16.0.220,3260]
Nov 17 03:05:41 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146, portal: 172.16.0.220,3260] successful.
Nov 17 03:05:41 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52da3e7-c692-4c59-92f3-934254b1a102]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c2bbdc-63a8-4c2a-84d0-55ed1421d87c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:05:41 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:05:41 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:05:41 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:05:41 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:05:41 user nova-compute[74898]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:05:41 user nova-compute[74898]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)
Nov 17 03:05:41 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:05:41 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:05:41 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:05:41 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:05:41 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:05:41 user nova-compute[74898]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:05:41 user nova-compute[74898]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)
Nov 17 03:05:41 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f685be5b-37b5-46f0-9e2f-4615492fddd3]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:05:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'frPOnDuL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:05:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:05:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '26334613635313062', 'path': '/dev/sde'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:05:42 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334613635313062', 'path': '/dev/sde'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:05:42 user nova-compute[74898]: DEBUG nova.objects.instance [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lazy-loading 'flavor' on Instance uuid 474a469d-9ebe-4e91-9ec4-3f610bdd4d27 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:05:42 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 03:05:42 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:05:42 user nova-compute[74898]:   <source dev="/dev/sde"/>
Nov 17 03:05:42 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:05:42 user nova-compute[74898]:   <serial>a3c6e9a5-ff67-437f-8a8a-90dcfee9a146</serial>
Nov 17 03:05:42 user nova-compute[74898]: </disk>
Nov 17 03:05:42 user nova-compute[74898]:  {{(pid=74898) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 03:05:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:05:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:05:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] No VIF found with MAC fa:16:3e:28:47:a5, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:05:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f16f8604-b170-48e1-b8a9-7728921c2ab0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.099s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Acquiring lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:44 user nova-compute[74898]: DEBUG os_brick.utils [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:05:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:44 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[615561ca-0431-477f-ad86-e27bd6063ed7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:44 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8daf8b-3d89-49f3-b9ff-0771bdaf1616]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:44 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6002bfc9-5bab-4557-9e9c-7b5427d27352]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:44 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16252f2-4685-4f76-a972-d22afccb2d26]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:05:44 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:05:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:05:44 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:05:44 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0b952e-411b-44ec-a615-6855a019d972]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:44 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:05:44 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:05:44 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:05:44 user nova-compute[74898]: DEBUG os_brick.utils [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:05:44 user nova-compute[74898]: INFO nova.compute.manager [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Swapping volume a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 for bf480009-b502-4496-8302-ef4efc9ef406
Nov 17 03:05:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Acquiring lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:45 user nova-compute[74898]: INFO nova.compute.manager [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Detaching volume f27c7dcc-c45f-4ad7-819d-d89a8a89bae0
Nov 17 03:05:45 user nova-compute[74898]: INFO nova.virt.block_device [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Attempting to driver detach volume f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 from mountpoint /dev/vdb
Nov 17 03:05:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Attempting to detach device vdb from instance 015ff42a-4d69-4f60-b86c-c6bd68d23c99 from the persistent domain config. {{(pid=74898) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 03:05:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:05:45 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:05:45 user nova-compute[74898]:   <source dev="/dev/sdf"/>
Nov 17 03:05:45 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:05:45 user nova-compute[74898]:   <serial>f27c7dcc-c45f-4ad7-819d-d89a8a89bae0</serial>
Nov 17 03:05:45 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:05:45 user nova-compute[74898]: </disk>
Nov 17 03:05:45 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:05:45 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Successfully detached device vdb from instance 015ff42a-4d69-4f60-b86c-c6bd68d23c99 from the persistent domain config.
Nov 17 03:05:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 015ff42a-4d69-4f60-b86c-c6bd68d23c99 from the live domain config. {{(pid=74898) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 03:05:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:05:45 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:05:45 user nova-compute[74898]:   <source dev="/dev/sdf"/>
Nov 17 03:05:45 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:05:45 user nova-compute[74898]:   <serial>f27c7dcc-c45f-4ad7-819d-d89a8a89bae0</serial>
Nov 17 03:05:45 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:05:45 user nova-compute[74898]: </disk>
Nov 17 03:05:45 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:05:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 015ff42a-4d69-4f60-b86c-c6bd68d23c99 {{(pid=74898) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 03:05:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG nova.compute.manager [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tphxAlIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '474a469d-9ebe-4e91-9ec4-3f610bdd4d27', 'attached_at': '', 'detached_at': '', 'volume_id': 'bf480009-b502-4496-8302-ef4efc9ef406', 'serial': 'bf480009-b502-4496-8302-ef4efc9ef406'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'frPOnDuL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '474a469d-9ebe-4e91-9ec4-3f610bdd4d27', 'attached_at': '', 'detached_at': '', 'volume_id': 'a3c6e9a5-ff67-437f-8a8a-90dcfee9a146', 'serial'} {{(pid=74898) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tphxAlIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:05:50 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:05:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:05:50 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:05:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:05:50 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[844b49b0-4d62-4ffe-b84d-7d16c828929a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:05:50 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8ad223-ea17-42cc-a6a6-5c137a54f17b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406] added
Nov 17 03:05:50 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a798a340-572b-4a9b-9abd-6975f72e1f4a]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4530800-6f9f-4fe2-83a5-b744544223ff]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tphxAlIU {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tphxAlIU" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[42832006-d755-429a-a0e0-6832b8eceea8]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tphxAlIU'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e7e15f-366f-47da-8aeb-c2a37151d483]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[172b7cb4-1a5f-4ef6-b98b-2b7b38962930]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:05:50 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:05:50 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:05:50 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:05:50 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:05:50 user nova-compute[74898]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:05:50 user nova-compute[74898]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)
Nov 17 03:05:50 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:05:50 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:05:50 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:05:50 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:05:50 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:05:50 user nova-compute[74898]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:05:50 user nova-compute[74898]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)
Nov 17 03:05:50 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad181586-36b6-4b06-950f-08f89740091f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406, portal: 172.16.0.220,3260]
Nov 17 03:05:50 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406, portal: 172.16.0.220,3260] successful.
Nov 17 03:05:50 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e086c81-928d-4ab5-8402-6a724a0b3331]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b58218e-113e-4f1f-8d47-eb76efc68a8f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:05:50 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:05:50 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:05:50 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:05:50 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:05:50 user nova-compute[74898]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:05:50 user nova-compute[74898]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)
Nov 17 03:05:50 user nova-compute[74898]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 (non-flash)
Nov 17 03:05:50 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:05:50 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:05:50 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:05:50 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:05:50 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:05:50 user nova-compute[74898]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:05:50 user nova-compute[74898]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)
Nov 17 03:05:50 user nova-compute[74898]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 (non-flash)
Nov 17 03:05:50 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] HCTL ('40', '-', '-', 0) found on session 25 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[de47b2ce-94df-43d3-8b20-4394fecd6953]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Searching for a device in session 25 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tphxAlIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:05:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:05:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23830376166636539', 'path': '/dev/sdi'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:05:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830376166636539', 'path': '/dev/sdi'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:05:51 user nova-compute[74898]: DEBUG nova.objects.instance [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Lazy-loading 'flavor' on Instance uuid 474a469d-9ebe-4e91-9ec4-3f610bdd4d27 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:05:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74898) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 03:05:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] COPY block job progress, current cursor: 167772160 final cursor: 1073741824 {{(pid=74898) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 03:05:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] COPY block job progress, current cursor: 289406976 final cursor: 1073741824 {{(pid=74898) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 03:05:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] COPY block job progress, current cursor: 469762048 final cursor: 1073741824 {{(pid=74898) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 03:05:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:54 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] COPY block job progress, current cursor: 636485632 final cursor: 1073741824 {{(pid=74898) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 03:05:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c02452d0-92e5-41ed-ba9b-7b3ad3f7519d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "d1ee03a5-13fb-47e7-8712-ea31aed36643" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c02452d0-92e5-41ed-ba9b-7b3ad3f7519d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "d1ee03a5-13fb-47e7-8712-ea31aed36643" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c02452d0-92e5-41ed-ba9b-7b3ad3f7519d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "d1ee03a5-13fb-47e7-8712-ea31aed36643-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c02452d0-92e5-41ed-ba9b-7b3ad3f7519d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "d1ee03a5-13fb-47e7-8712-ea31aed36643-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c02452d0-92e5-41ed-ba9b-7b3ad3f7519d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "d1ee03a5-13fb-47e7-8712-ea31aed36643-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:54 user nova-compute[74898]: INFO nova.compute.manager [None req-c02452d0-92e5-41ed-ba9b-7b3ad3f7519d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Terminating instance
Nov 17 03:05:54 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c02452d0-92e5-41ed-ba9b-7b3ad3f7519d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:05:54 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] COPY block job progress, current cursor: 740294656 final cursor: 1073741824 {{(pid=74898) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 03:05:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:54 user nova-compute[74898]: DEBUG nova.compute.manager [req-519d5c9f-d606-452c-8417-26b7e2f34258 req-ef0ddce8-fd2d-4d9c-8266-11d4fc99c382 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Received event network-vif-unplugged-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-519d5c9f-d606-452c-8417-26b7e2f34258 req-ef0ddce8-fd2d-4d9c-8266-11d4fc99c382 service nova] Acquiring lock "d1ee03a5-13fb-47e7-8712-ea31aed36643-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-519d5c9f-d606-452c-8417-26b7e2f34258 req-ef0ddce8-fd2d-4d9c-8266-11d4fc99c382 service nova] Lock "d1ee03a5-13fb-47e7-8712-ea31aed36643-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-519d5c9f-d606-452c-8417-26b7e2f34258 req-ef0ddce8-fd2d-4d9c-8266-11d4fc99c382 service nova] Lock "d1ee03a5-13fb-47e7-8712-ea31aed36643-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:54 user nova-compute[74898]: DEBUG nova.compute.manager [req-519d5c9f-d606-452c-8417-26b7e2f34258 req-ef0ddce8-fd2d-4d9c-8266-11d4fc99c382 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] No waiting events found dispatching network-vif-unplugged-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:05:54 user nova-compute[74898]: DEBUG nova.compute.manager [req-519d5c9f-d606-452c-8417-26b7e2f34258 req-ef0ddce8-fd2d-4d9c-8266-11d4fc99c382 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Received event network-vif-unplugged-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:05:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] COPY block job progress, current cursor: 869269504 final cursor: 1073741824 {{(pid=74898) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 03:05:55 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Instance destroyed successfully.
Nov 17 03:05:55 user nova-compute[74898]: DEBUG nova.objects.instance [None req-c02452d0-92e5-41ed-ba9b-7b3ad3f7519d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lazy-loading 'resources' on Instance uuid d1ee03a5-13fb-47e7-8712-ea31aed36643 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:05:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-c02452d0-92e5-41ed-ba9b-7b3ad3f7519d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-518555806',display_name='tempest-TestMinimumBasicScenario-server-518555806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-518555806',id=12,image_ref='69542cfe-cdd4-48dc-9b63-061653d7cdc6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1EY5rCz2E3x/wAgxCKYUaqooziw3CyJR0nPDRdz0y4i4+yhrfN56ldStLgGItlqOV644u8QPrJzURL6gJ6sRaVxPODdWNcHba75nAX5V0fmckz29P2gUNRuvvbham3/Q==',key_name='tempest-TestMinimumBasicScenario-1952571884',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:01:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3251ef4d69740409c9beec4f368bf72',ramdisk_id='',reservation_id='r-d70154jv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='69542cfe-cdd4-48dc-9b63-061653d7cdc6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1625508354',owner_user_name='tempest-TestMinimumBasicScenario-1625508354-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:03:15Z,user_data=None,user_id='8507fa418393437cbba167b470aa7dc1',uuid=d1ee03a5-13fb-47e7-8712-ea31aed36643,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "address": "fa:16:3e:46:e0:47", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cfbdbfd-83", "ovs_interfaceid": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:05:55 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-c02452d0-92e5-41ed-ba9b-7b3ad3f7519d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Converting VIF {"id": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "address": "fa:16:3e:46:e0:47", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cfbdbfd-83", "ovs_interfaceid": "4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:05:55 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-c02452d0-92e5-41ed-ba9b-7b3ad3f7519d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:e0:47,bridge_name='br-int',has_traffic_filtering=True,id=4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd,network=Network(7b139a66-9d14-40e3-b129-0febdd13b264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cfbdbfd-83') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:05:55 user nova-compute[74898]: DEBUG os_vif [None req-c02452d0-92e5-41ed-ba9b-7b3ad3f7519d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:e0:47,bridge_name='br-int',has_traffic_filtering=True,id=4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd,network=Network(7b139a66-9d14-40e3-b129-0febdd13b264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cfbdbfd-83') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:05:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4cfbdbfd-83, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4023d2c5-1e7e-4ef7-9aef-e133f34d8584) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:05:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:55 user nova-compute[74898]: INFO os_vif [None req-c02452d0-92e5-41ed-ba9b-7b3ad3f7519d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:e0:47,bridge_name='br-int',has_traffic_filtering=True,id=4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd,network=Network(7b139a66-9d14-40e3-b129-0febdd13b264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cfbdbfd-83')
Nov 17 03:05:55 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-c02452d0-92e5-41ed-ba9b-7b3ad3f7519d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Deleting instance files /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643_del
Nov 17 03:05:55 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-c02452d0-92e5-41ed-ba9b-7b3ad3f7519d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Deletion of /opt/stack/data/nova/instances/d1ee03a5-13fb-47e7-8712-ea31aed36643_del complete
Nov 17 03:05:55 user nova-compute[74898]: INFO nova.compute.manager [None req-c02452d0-92e5-41ed-ba9b-7b3ad3f7519d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 17 03:05:55 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-c02452d0-92e5-41ed-ba9b-7b3ad3f7519d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:05:55 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:05:55 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:05:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] COPY block job progress, current cursor: 1053818880 final cursor: 1073741824 {{(pid=74898) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 03:05:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:55 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:05:55 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Took 0.48 seconds to deallocate network for instance.
Nov 17 03:05:55 user nova-compute[74898]: DEBUG nova.compute.manager [req-f53fcaf1-4e91-491c-b845-a57f11998845 req-b09c2546-b47c-4ef5-8ec4-49a56fba523a service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Received event network-vif-deleted-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:55 user nova-compute[74898]: INFO nova.compute.manager [req-f53fcaf1-4e91-491c-b845-a57f11998845 req-b09c2546-b47c-4ef5-8ec4-49a56fba523a service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Neutron deleted interface 4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd; detaching it from the instance and deleting it from the info cache
Nov 17 03:05:55 user nova-compute[74898]: DEBUG nova.network.neutron [req-f53fcaf1-4e91-491c-b845-a57f11998845 req-b09c2546-b47c-4ef5-8ec4-49a56fba523a service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:05:55 user nova-compute[74898]: DEBUG nova.compute.manager [req-f53fcaf1-4e91-491c-b845-a57f11998845 req-b09c2546-b47c-4ef5-8ec4-49a56fba523a service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Detach interface failed, port_id=4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd, reason: Instance d1ee03a5-13fb-47e7-8712-ea31aed36643 could not be found. {{(pid=74898) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c02452d0-92e5-41ed-ba9b-7b3ad3f7519d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c02452d0-92e5-41ed-ba9b-7b3ad3f7519d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74898) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'frPOnDuL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:05:56 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:05:56 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eac646b-78d5-4ee0-827e-b0f34a79d31a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c01e07d-a2d1-4a32-a709-f89afe05f42c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:05:56 user nova-compute[74898]: No targets found.
Nov 17 03:05:56 user nova-compute[74898]: iSNS:
Nov 17 03:05:56 user nova-compute[74898]: No targets found.
Nov 17 03:05:56 user nova-compute[74898]: STATIC:
Nov 17 03:05:56 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981
Nov 17 03:05:56 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:05:56 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:05:56 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45
Nov 17 03:05:56 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:05:56 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:05:56 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248
Nov 17 03:05:56 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:05:56 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:05:56 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484
Nov 17 03:05:56 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:05:56 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:05:56 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406
Nov 17 03:05:56 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:05:56 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:05:56 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0
Nov 17 03:05:56 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:05:56 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:05:56 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146
Nov 17 03:05:56 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:05:56 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:05:56 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4
Nov 17 03:05:56 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:05:56 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:05:56 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:2c01e07d-a2d1-4a32-a709-f89afe05f42c
Nov 17 03:05:56 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:05:56 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:05:56 user nova-compute[74898]: FIRMWARE:
Nov 17 03:05:56 user nova-compute[74898]: No targets found.
Nov 17 03:05:56 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:05:56 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:05:56 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff04fe5e-65cf-4acf-86d5-37c9e79e87d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c01e07d-a2d1-4a32-a709-f89afe05f42c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-c02452d0-92e5-41ed-ba9b-7b3ad3f7519d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab657a70-b4df-4b08-97bb-915da8ee905a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c01e07d-a2d1-4a32-a709-f89afe05f42c (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:05:56 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:05:56 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:05:56 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:05:56 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:05:56 user nova-compute[74898]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:05:56 user nova-compute[74898]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)
Nov 17 03:05:56 user nova-compute[74898]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 (non-flash)
Nov 17 03:05:56 user nova-compute[74898]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c01e07d-a2d1-4a32-a709-f89afe05f42c (non-flash)
Nov 17 03:05:56 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:05:56 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:05:56 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:05:56 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:05:56 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:05:56 user nova-compute[74898]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:05:56 user nova-compute[74898]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)
Nov 17 03:05:56 user nova-compute[74898]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 (non-flash)
Nov 17 03:05:56 user nova-compute[74898]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c01e07d-a2d1-4a32-a709-f89afe05f42c (non-flash)
Nov 17 03:05:56 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9c20ccbbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146'): ({'sde'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Removing single pathed devices sde {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-c02452d0-92e5-41ed-ba9b-7b3ad3f7519d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[34285b3d-76da-4146-a244-48502e4a2e24]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c02452d0-92e5-41ed-ba9b-7b3ad3f7519d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26fb9d9-4e4b-463f-8649-e6af2d126cf3]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Flushing IO for device /dev/sde {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[add2c080-6fab-469f-9132-02e557ffd486]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:56 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-c02452d0-92e5-41ed-ba9b-7b3ad3f7519d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Deleted allocations for instance d1ee03a5-13fb-47e7-8712-ea31aed36643
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b1baa2-079b-4330-a1ca-406f303bdc9a]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] SCSI volumes sde have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e03c68-5d22-482f-8054-74d93f41793a]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c02452d0-92e5-41ed-ba9b-7b3ad3f7519d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "d1ee03a5-13fb-47e7-8712-ea31aed36643" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.024s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc32c04-32a9-484d-b29a-653049f575a2]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146, portal: 172.16.0.220,3260]
Nov 17 03:05:56 user nova-compute[74898]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146, portal: 172.16.0.220,3260] successful.
Nov 17 03:05:56 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6532c526-38c2-49e3-829c-bbcd5703c422]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] <== disconnect_volume: return (360ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG nova.compute.manager [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tphxAlIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '474a469d-9ebe-4e91-9ec4-3f610bdd4d27', 'attached_at': '', 'detached_at': '', 'volume_id': 'bf480009-b502-4496-8302-ef4efc9ef406', 'serial'} {{(pid=74898) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG nova.compute.manager [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] swap_volume: removing Cinder connection for volume a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 {{(pid=74898) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG nova.compute.manager [req-eb9e06b9-d2b0-4949-ad65-d7ae9d831b02 req-12d28155-fbb6-424b-b9e6-74a754d4d3f0 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Received event network-vif-plugged-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-eb9e06b9-d2b0-4949-ad65-d7ae9d831b02 req-12d28155-fbb6-424b-b9e6-74a754d4d3f0 service nova] Acquiring lock "d1ee03a5-13fb-47e7-8712-ea31aed36643-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-eb9e06b9-d2b0-4949-ad65-d7ae9d831b02 req-12d28155-fbb6-424b-b9e6-74a754d4d3f0 service nova] Lock "d1ee03a5-13fb-47e7-8712-ea31aed36643-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-eb9e06b9-d2b0-4949-ad65-d7ae9d831b02 req-12d28155-fbb6-424b-b9e6-74a754d4d3f0 service nova] Lock "d1ee03a5-13fb-47e7-8712-ea31aed36643-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:56 user nova-compute[74898]: DEBUG nova.compute.manager [req-eb9e06b9-d2b0-4949-ad65-d7ae9d831b02 req-12d28155-fbb6-424b-b9e6-74a754d4d3f0 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] No waiting events found dispatching network-vif-plugged-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:05:56 user nova-compute[74898]: WARNING nova.compute.manager [req-eb9e06b9-d2b0-4949-ad65-d7ae9d831b02 req-12d28155-fbb6-424b-b9e6-74a754d4d3f0 service nova] [instance: d1ee03a5-13fb-47e7-8712-ea31aed36643] Received unexpected event network-vif-plugged-4cfbdbfd-8319-4ba4-99b1-5a43ef5a5bfd for instance with vm_state deleted and task_state None.
Nov 17 03:05:57 user nova-compute[74898]: DEBUG nova.compute.manager [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] swap_volume: Updating volume a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "tphxAlIU", "auth_password": "QuPUMwR8yfGbiF", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "bf480009-b502-4496-8302-ef4efc9ef406"}, "status": "reserved", "instance": "474a469d-9ebe-4e91-9ec4-3f610bdd4d27", "attached_at": "", "detached_at": "", "volume_id": "bf480009-b502-4496-8302-ef4efc9ef406", "serial": "bf480009-b502-4496-8302-ef4efc9ef406"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'bf480009-b502-4496-8302-ef4efc9ef406', 'no_device': None, 'attachment_id': 'da3ef5fa-95eb-4b85-af86-2eb098505a6b'} {{(pid=74898) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 17 03:05:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d6d9702b-fd23-42ca-be95-b5290d9fe6ea tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 13.124s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:57 user nova-compute[74898]: INFO nova.compute.manager [None req-e5ca05ac-5beb-4faa-becf-69f26e220cd7 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Unrescuing
Nov 17 03:05:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e5ca05ac-5beb-4faa-becf-69f26e220cd7 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "refresh_cache-5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:05:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e5ca05ac-5beb-4faa-becf-69f26e220cd7 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquired lock "refresh_cache-5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:05:57 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e5ca05ac-5beb-4faa-becf-69f26e220cd7 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e5ca05ac-5beb-4faa-becf-69f26e220cd7 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Updating instance_info_cache with network_info: [{"id": "78bdfbfa-3578-4ef5-b499-decd609cba62", "address": "fa:16:3e:b1:55:61", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78bdfbfa-35", "ovs_interfaceid": "78bdfbfa-3578-4ef5-b499-decd609cba62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e5ca05ac-5beb-4faa-becf-69f26e220cd7 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Releasing lock "refresh_cache-5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG nova.objects.instance [None req-e5ca05ac-5beb-4faa-becf-69f26e220cd7 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lazy-loading 'flavor' on Instance uuid 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG nova.compute.manager [req-4ebd4b25-0f75-44bc-a127-c3f80e4fda2d req-65a10397-b488-4ae6-89d5-ceef03663988 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Received event network-changed-8e38fd27-07cd-40c1-bef7-67d150932e57 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG nova.compute.manager [req-4ebd4b25-0f75-44bc-a127-c3f80e4fda2d req-65a10397-b488-4ae6-89d5-ceef03663988 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Refreshing instance network info cache due to event network-changed-8e38fd27-07cd-40c1-bef7-67d150932e57. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4ebd4b25-0f75-44bc-a127-c3f80e4fda2d req-65a10397-b488-4ae6-89d5-ceef03663988 service nova] Acquiring lock "refresh_cache-dbaabab0-92f0-480d-8f81-0db980c8f333" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4ebd4b25-0f75-44bc-a127-c3f80e4fda2d req-65a10397-b488-4ae6-89d5-ceef03663988 service nova] Acquired lock "refresh_cache-dbaabab0-92f0-480d-8f81-0db980c8f333" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG nova.network.neutron [req-4ebd4b25-0f75-44bc-a127-c3f80e4fda2d req-65a10397-b488-4ae6-89d5-ceef03663988 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Refreshing network info cache for port 8e38fd27-07cd-40c1-bef7-67d150932e57 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Acquiring lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG nova.compute.manager [req-4be91739-be7f-45eb-ae74-fa06e30f4ed5 req-0fcb9551-b65e-41cc-9e81-6c2158d19ded service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received event network-vif-unplugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4be91739-be7f-45eb-ae74-fa06e30f4ed5 req-0fcb9551-b65e-41cc-9e81-6c2158d19ded service nova] Acquiring lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4be91739-be7f-45eb-ae74-fa06e30f4ed5 req-0fcb9551-b65e-41cc-9e81-6c2158d19ded service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4be91739-be7f-45eb-ae74-fa06e30f4ed5 req-0fcb9551-b65e-41cc-9e81-6c2158d19ded service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG nova.compute.manager [req-4be91739-be7f-45eb-ae74-fa06e30f4ed5 req-0fcb9551-b65e-41cc-9e81-6c2158d19ded service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] No waiting events found dispatching network-vif-unplugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:05:58 user nova-compute[74898]: WARNING nova.compute.manager [req-4be91739-be7f-45eb-ae74-fa06e30f4ed5 req-0fcb9551-b65e-41cc-9e81-6c2158d19ded service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received unexpected event network-vif-unplugged-78bdfbfa-3578-4ef5-b499-decd609cba62 for instance with vm_state rescued and task_state unrescuing.
Nov 17 03:05:58 user nova-compute[74898]: DEBUG nova.compute.manager [req-4be91739-be7f-45eb-ae74-fa06e30f4ed5 req-0fcb9551-b65e-41cc-9e81-6c2158d19ded service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received event network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4be91739-be7f-45eb-ae74-fa06e30f4ed5 req-0fcb9551-b65e-41cc-9e81-6c2158d19ded service nova] Acquiring lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4be91739-be7f-45eb-ae74-fa06e30f4ed5 req-0fcb9551-b65e-41cc-9e81-6c2158d19ded service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4be91739-be7f-45eb-ae74-fa06e30f4ed5 req-0fcb9551-b65e-41cc-9e81-6c2158d19ded service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG nova.compute.manager [req-4be91739-be7f-45eb-ae74-fa06e30f4ed5 req-0fcb9551-b65e-41cc-9e81-6c2158d19ded service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] No waiting events found dispatching network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:05:58 user nova-compute[74898]: WARNING nova.compute.manager [req-4be91739-be7f-45eb-ae74-fa06e30f4ed5 req-0fcb9551-b65e-41cc-9e81-6c2158d19ded service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received unexpected event network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 for instance with vm_state rescued and task_state unrescuing.
Nov 17 03:05:58 user nova-compute[74898]: DEBUG os_brick.utils [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8577717c-ebcd-411c-b2d7-7ff2f71f1552]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2123b27a-7844-43a6-9aa2-6ee3d060302d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15815c4-aa51-4227-af8e-31543b6f1f06]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7db00f-0fa5-42d6-a3f7-17f7c46c6784]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:59 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:05:59 user nova-compute[74898]: DEBUG nova.network.neutron [req-4ebd4b25-0f75-44bc-a127-c3f80e4fda2d req-65a10397-b488-4ae6-89d5-ceef03663988 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Updated VIF entry in instance network info cache for port 8e38fd27-07cd-40c1-bef7-67d150932e57. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:05:59 user nova-compute[74898]: DEBUG nova.network.neutron [req-4ebd4b25-0f75-44bc-a127-c3f80e4fda2d req-65a10397-b488-4ae6-89d5-ceef03663988 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Updating instance_info_cache with network_info: [{"id": "8e38fd27-07cd-40c1-bef7-67d150932e57", "address": "fa:16:3e:8b:5d:76", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e38fd27-07", "ovs_interfaceid": "8e38fd27-07cd-40c1-bef7-67d150932e57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:05:59 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:05:59 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:05:59 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:05:59 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:05:59 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[375c9f98-9dd4-450e-89af-1773dbe70090]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:05:59 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:05:59 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:05:59 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:05:59 user nova-compute[74898]: DEBUG os_brick.utils [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:05:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4ebd4b25-0f75-44bc-a127-c3f80e4fda2d req-65a10397-b488-4ae6-89d5-ceef03663988 service nova] Releasing lock "refresh_cache-dbaabab0-92f0-480d-8f81-0db980c8f333" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:05:59 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Instance destroyed successfully.
Nov 17 03:05:59 user nova-compute[74898]: INFO nova.compute.manager [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Swapping volume bf480009-b502-4496-8302-ef4efc9ef406 for a3c6e9a5-ff67-437f-8a8a-90dcfee9a146
Nov 17 03:06:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._sync_power_states {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Triggering sync for uuid 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb {{(pid=74898) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Triggering sync for uuid e733574a-56ba-4e24-babd-855bcb5bda61 {{(pid=74898) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Triggering sync for uuid 11704034-7afe-475c-ae43-1324b40f0d92 {{(pid=74898) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Triggering sync for uuid 015ff42a-4d69-4f60-b86c-c6bd68d23c99 {{(pid=74898) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Triggering sync for uuid 36e687c0-9481-4126-b365-f7f9707e2338 {{(pid=74898) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Triggering sync for uuid 474a469d-9ebe-4e91-9ec4-3f610bdd4d27 {{(pid=74898) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Triggering sync for uuid 42994e39-187a-4fb6-a293-24a4eb57177b {{(pid=74898) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Triggering sync for uuid dbaabab0-92f0-480d-8f81-0db980c8f333 {{(pid=74898) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Triggering sync for uuid b94a0a17-77e9-41cf-9919-37b57b364ff2 {{(pid=74898) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:00 user nova-compute[74898]: INFO nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] During sync_power_state the instance has a pending task (unrescuing). Skip.
Nov 17 03:06:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "e733574a-56ba-4e24-babd-855bcb5bda61" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "e733574a-56ba-4e24-babd-855bcb5bda61" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "11704034-7afe-475c-ae43-1324b40f0d92" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "11704034-7afe-475c-ae43-1324b40f0d92" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "36e687c0-9481-4126-b365-f7f9707e2338" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "36e687c0-9481-4126-b365-f7f9707e2338" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "42994e39-187a-4fb6-a293-24a4eb57177b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "42994e39-187a-4fb6-a293-24a4eb57177b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "dbaabab0-92f0-480d-8f81-0db980c8f333" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "dbaabab0-92f0-480d-8f81-0db980c8f333" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG nova.compute.manager [req-72c482f4-03ad-4382-9714-bdd6b2961ccf req-e58e199e-33fb-4e6e-8fee-6db3a935ef23 service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received event network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-72c482f4-03ad-4382-9714-bdd6b2961ccf req-e58e199e-33fb-4e6e-8fee-6db3a935ef23 service nova] Acquiring lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-72c482f4-03ad-4382-9714-bdd6b2961ccf req-e58e199e-33fb-4e6e-8fee-6db3a935ef23 service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-72c482f4-03ad-4382-9714-bdd6b2961ccf req-e58e199e-33fb-4e6e-8fee-6db3a935ef23 service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG nova.compute.manager [req-72c482f4-03ad-4382-9714-bdd6b2961ccf req-e58e199e-33fb-4e6e-8fee-6db3a935ef23 service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] No waiting events found dispatching network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:06:00 user nova-compute[74898]: WARNING nova.compute.manager [req-72c482f4-03ad-4382-9714-bdd6b2961ccf req-e58e199e-33fb-4e6e-8fee-6db3a935ef23 service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received unexpected event network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 for instance with vm_state rescued and task_state unrescuing.
Nov 17 03:06:00 user nova-compute[74898]: DEBUG nova.compute.manager [req-72c482f4-03ad-4382-9714-bdd6b2961ccf req-e58e199e-33fb-4e6e-8fee-6db3a935ef23 service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received event network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-72c482f4-03ad-4382-9714-bdd6b2961ccf req-e58e199e-33fb-4e6e-8fee-6db3a935ef23 service nova] Acquiring lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-72c482f4-03ad-4382-9714-bdd6b2961ccf req-e58e199e-33fb-4e6e-8fee-6db3a935ef23 service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-72c482f4-03ad-4382-9714-bdd6b2961ccf req-e58e199e-33fb-4e6e-8fee-6db3a935ef23 service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG nova.compute.manager [req-72c482f4-03ad-4382-9714-bdd6b2961ccf req-e58e199e-33fb-4e6e-8fee-6db3a935ef23 service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] No waiting events found dispatching network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:06:00 user nova-compute[74898]: WARNING nova.compute.manager [req-72c482f4-03ad-4382-9714-bdd6b2961ccf req-e58e199e-33fb-4e6e-8fee-6db3a935ef23 service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received unexpected event network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 for instance with vm_state rescued and task_state unrescuing.
Nov 17 03:06:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "e733574a-56ba-4e24-babd-855bcb5bda61" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "36e687c0-9481-4126-b365-f7f9707e2338" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "11704034-7afe-475c-ae43-1324b40f0d92" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "42994e39-187a-4fb6-a293-24a4eb57177b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "dbaabab0-92f0-480d-8f81-0db980c8f333" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:02 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e5ca05ac-5beb-4faa-becf-69f26e220cd7 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:06:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "dbaabab0-92f0-480d-8f81-0db980c8f333" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "dbaabab0-92f0-480d-8f81-0db980c8f333" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:02 user nova-compute[74898]: INFO nova.compute.manager [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Shelving
Nov 17 03:06:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:03 user nova-compute[74898]: DEBUG nova.compute.manager [req-7ae7e50c-2bd2-4ac5-8e2c-48fa2cfa18dc req-9b6953ec-6393-4d4f-b965-292ec3dd9d21 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Received event network-vif-unplugged-8e38fd27-07cd-40c1-bef7-67d150932e57 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7ae7e50c-2bd2-4ac5-8e2c-48fa2cfa18dc req-9b6953ec-6393-4d4f-b965-292ec3dd9d21 service nova] Acquiring lock "dbaabab0-92f0-480d-8f81-0db980c8f333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7ae7e50c-2bd2-4ac5-8e2c-48fa2cfa18dc req-9b6953ec-6393-4d4f-b965-292ec3dd9d21 service nova] Lock "dbaabab0-92f0-480d-8f81-0db980c8f333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7ae7e50c-2bd2-4ac5-8e2c-48fa2cfa18dc req-9b6953ec-6393-4d4f-b965-292ec3dd9d21 service nova] Lock "dbaabab0-92f0-480d-8f81-0db980c8f333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:03 user nova-compute[74898]: DEBUG nova.compute.manager [req-7ae7e50c-2bd2-4ac5-8e2c-48fa2cfa18dc req-9b6953ec-6393-4d4f-b965-292ec3dd9d21 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] No waiting events found dispatching network-vif-unplugged-8e38fd27-07cd-40c1-bef7-67d150932e57 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:06:03 user nova-compute[74898]: WARNING nova.compute.manager [req-7ae7e50c-2bd2-4ac5-8e2c-48fa2cfa18dc req-9b6953ec-6393-4d4f-b965-292ec3dd9d21 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Received unexpected event network-vif-unplugged-8e38fd27-07cd-40c1-bef7-67d150932e57 for instance with vm_state active and task_state shelving.
Nov 17 03:06:03 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Instance destroyed successfully.
Nov 17 03:06:03 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Beginning cold snapshot process
Nov 17 03:06:04 user nova-compute[74898]: DEBUG nova.privsep.utils [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74898) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 03:06:04 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk /opt/stack/data/nova/instances/snapshots/tmp4y74_6u6/0494f1e5c16d45818433019fd32681a7 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk /opt/stack/data/nova/instances/snapshots/tmp4y74_6u6/0494f1e5c16d45818433019fd32681a7" returned: 0 in 1.023s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:05 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Snapshot extracted, beginning image upload
Nov 17 03:06:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG nova.compute.manager [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'frPOnDuL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '474a469d-9ebe-4e91-9ec4-3f610bdd4d27', 'attached_at': '', 'detached_at': '', 'volume_id': 'a3c6e9a5-ff67-437f-8a8a-90dcfee9a146', 'serial': 'a3c6e9a5-ff67-437f-8a8a-90dcfee9a146'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tphxAlIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': 'bf480009-b502-4496-8302-ef4efc9ef406'}, 'status': 'reserved', 'instance': '474a469d-9ebe-4e91-9ec4-3f610bdd4d27', 'attached_at': '', 'detached_at': '', 'volume_id': 'bf480009-b502-4496-8302-ef4efc9ef406', 'serial'} {{(pid=74898) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'frPOnDuL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:06:05 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:06:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:06:05 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:06:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:06:05 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[377bcb31-2218-4474-8c13-8e09ace02baa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:06:05 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG nova.compute.manager [req-fb0d618b-f020-4f76-bf0b-61a826dcc716 req-47a902c8-75b4-43ab-9848-3fe4b7543542 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Received event network-vif-plugged-8e38fd27-07cd-40c1-bef7-67d150932e57 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fb0d618b-f020-4f76-bf0b-61a826dcc716 req-47a902c8-75b4-43ab-9848-3fe4b7543542 service nova] Acquiring lock "dbaabab0-92f0-480d-8f81-0db980c8f333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fb0d618b-f020-4f76-bf0b-61a826dcc716 req-47a902c8-75b4-43ab-9848-3fe4b7543542 service nova] Lock "dbaabab0-92f0-480d-8f81-0db980c8f333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fb0d618b-f020-4f76-bf0b-61a826dcc716 req-47a902c8-75b4-43ab-9848-3fe4b7543542 service nova] Lock "dbaabab0-92f0-480d-8f81-0db980c8f333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG nova.compute.manager [req-fb0d618b-f020-4f76-bf0b-61a826dcc716 req-47a902c8-75b4-43ab-9848-3fe4b7543542 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] No waiting events found dispatching network-vif-plugged-8e38fd27-07cd-40c1-bef7-67d150932e57 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:06:05 user nova-compute[74898]: WARNING nova.compute.manager [req-fb0d618b-f020-4f76-bf0b-61a826dcc716 req-47a902c8-75b4-43ab-9848-3fe4b7543542 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Received unexpected event network-vif-plugged-8e38fd27-07cd-40c1-bef7-67d150932e57 for instance with vm_state active and task_state shelving_image_uploading.
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d13661-7753-417d-8af6-070cbf60057e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146] added
Nov 17 03:06:05 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1d5ee4-d849-4cf3-b210-f2595a749c72]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b41a08-44ef-40c7-b09d-196b73c75d74]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v frPOnDuL {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v frPOnDuL" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9be13a7-594b-4cd3-8fd4-c907a6fb69f6]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'frPOnDuL'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaaf848e-ad5c-44e8-a054-74f33b7843ee]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9804d300-1ca4-42a5-a02c-f8ec1dd1cb7e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:06:05 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:06:05 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:06:05 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:06:05 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:06:05 user nova-compute[74898]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:06:05 user nova-compute[74898]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 (non-flash)
Nov 17 03:06:05 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:06:05 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:06:05 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:06:05 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:06:05 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:06:05 user nova-compute[74898]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:06:05 user nova-compute[74898]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 (non-flash)
Nov 17 03:06:05 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef3e48b-88f2-4f05-b5fa-3436ce528d90]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146, portal: 172.16.0.220,3260]
Nov 17 03:06:05 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146, portal: 172.16.0.220,3260] successful.
Nov 17 03:06:05 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05d656a-4b32-425d-b9f9-32fa047e9102]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a215e969-1970-46a3-9068-90f1ca5d01e9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:06:05 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:06:05 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:06:05 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:06:05 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:06:05 user nova-compute[74898]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:06:05 user nova-compute[74898]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 (non-flash)
Nov 17 03:06:05 user nova-compute[74898]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)
Nov 17 03:06:05 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:06:05 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:06:05 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:06:05 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:06:05 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:06:05 user nova-compute[74898]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:06:05 user nova-compute[74898]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 (non-flash)
Nov 17 03:06:05 user nova-compute[74898]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)
Nov 17 03:06:05 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[157032bb-edee-4fe5-a205-33289f60b2ad]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'frPOnDuL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:06:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:06 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 015ff42a-4d69-4f60-b86c-c6bd68d23c99 is timed out.
Nov 17 03:06:06 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Successfully detached device vdb from instance 015ff42a-4d69-4f60-b86c-c6bd68d23c99 from the live domain config.
Nov 17 03:06:06 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjUusBlA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:06:06 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:06:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26334613635313062', 'path': '/dev/sde'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334613635313062', 'path': '/dev/sde'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.282s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG nova.objects.instance [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Lazy-loading 'flavor' on Instance uuid 474a469d-9ebe-4e91-9ec4-3f610bdd4d27 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d7be25-be8e-4e47-b132-5996f6e6f411]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:06:06 user nova-compute[74898]: No targets found.
Nov 17 03:06:06 user nova-compute[74898]: iSNS:
Nov 17 03:06:06 user nova-compute[74898]: No targets found.
Nov 17 03:06:06 user nova-compute[74898]: STATIC:
Nov 17 03:06:06 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981
Nov 17 03:06:06 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:06 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:06 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45
Nov 17 03:06:06 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:06 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:06 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248
Nov 17 03:06:06 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:06 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:06 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484
Nov 17 03:06:06 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:06 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:06 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406
Nov 17 03:06:06 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:06 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:06 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0
Nov 17 03:06:06 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:06 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:06 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146
Nov 17 03:06:06 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:06 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:06 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4
Nov 17 03:06:06 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:06 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:06 user nova-compute[74898]: FIRMWARE:
Nov 17 03:06:06 user nova-compute[74898]: No targets found.
Nov 17 03:06:06 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:06:06 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:06:06 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee85bd36-d455-4143-b6f1-0fd0182327fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[78854d80-22d0-462c-8e1a-886d9d98fd4f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:06:06 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:06:06 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:06:06 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:06:06 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:06:06 user nova-compute[74898]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:06:06 user nova-compute[74898]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 (non-flash)
Nov 17 03:06:06 user nova-compute[74898]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)
Nov 17 03:06:06 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 (non-flash)
Nov 17 03:06:06 user nova-compute[74898]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:06:06 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:06:06 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:06:06 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:06:06 user nova-compute[74898]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:06:06 user nova-compute[74898]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 (non-flash)
Nov 17 03:06:06 user nova-compute[74898]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)
Nov 17 03:06:06 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9c185e8790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0'): ({'sdf'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Removing single pathed devices sdf {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[764b6c41-cae6-46e8-926c-c7bb09b0a3c7]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe97c61c-46cf-4022-b2e1-5198b6af8569]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Flushing IO for device /dev/sdf {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f6b6e0-47c3-40b4-b88b-272e4ddefbe1]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4acd3d-bc0e-4541-9958-524ff4fcddfd]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] SCSI volumes sdf have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[75109f91-5185-4326-bc23-8f1dfdb958d0]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:06:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:07 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e829ff6b-7ad8-4b02-941b-e0deb6177495]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0, portal: 172.16.0.220,3260]
Nov 17 03:06:07 user nova-compute[74898]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0, portal: 172.16.0.220,3260] successful.
Nov 17 03:06:07 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:06:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f27c7dcc-c45f-4ad7-819d-d89a8a89bae0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:07 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[54041b14-c910-42b8-8651-8e907c92271c]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:06:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:06:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] <== disconnect_volume: return (642ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:06:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:06:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] COPY block job progress, current cursor: 4194304 final cursor: 1073741824 {{(pid=74898) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 03:06:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] COPY block job progress, current cursor: 84934656 final cursor: 1073741824 {{(pid=74898) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 03:06:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Acquiring lock "36e687c0-9481-4126-b365-f7f9707e2338" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "36e687c0-9481-4126-b365-f7f9707e2338" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Acquiring lock "36e687c0-9481-4126-b365-f7f9707e2338-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "36e687c0-9481-4126-b365-f7f9707e2338-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "36e687c0-9481-4126-b365-f7f9707e2338-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:07 user nova-compute[74898]: INFO nova.compute.manager [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Terminating instance
Nov 17 03:06:07 user nova-compute[74898]: DEBUG nova.compute.manager [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] COPY block job progress, current cursor: 192937984 final cursor: 1073741824 {{(pid=74898) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:08 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Snapshot image upload complete
Nov 17 03:06:08 user nova-compute[74898]: DEBUG nova.compute.manager [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG nova.objects.instance [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lazy-loading 'flavor' on Instance uuid 015ff42a-4d69-4f60-b86c-c6bd68d23c99 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG nova.compute.manager [req-7c034fc4-34a3-4ff4-a1b2-0a717ddda6da req-cde10566-ffd9-49a5-80f6-287fbebd9e0c service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Received event network-vif-unplugged-5415aaa1-723f-4f35-971c-509caa04575d {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7c034fc4-34a3-4ff4-a1b2-0a717ddda6da req-cde10566-ffd9-49a5-80f6-287fbebd9e0c service nova] Acquiring lock "36e687c0-9481-4126-b365-f7f9707e2338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7c034fc4-34a3-4ff4-a1b2-0a717ddda6da req-cde10566-ffd9-49a5-80f6-287fbebd9e0c service nova] Lock "36e687c0-9481-4126-b365-f7f9707e2338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7c034fc4-34a3-4ff4-a1b2-0a717ddda6da req-cde10566-ffd9-49a5-80f6-287fbebd9e0c service nova] Lock "36e687c0-9481-4126-b365-f7f9707e2338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG nova.compute.manager [req-7c034fc4-34a3-4ff4-a1b2-0a717ddda6da req-cde10566-ffd9-49a5-80f6-287fbebd9e0c service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] No waiting events found dispatching network-vif-unplugged-5415aaa1-723f-4f35-971c-509caa04575d {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG nova.compute.manager [req-7c034fc4-34a3-4ff4-a1b2-0a717ddda6da req-cde10566-ffd9-49a5-80f6-287fbebd9e0c service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Received event network-vif-unplugged-5415aaa1-723f-4f35-971c-509caa04575d for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3c828e1c-1dec-408c-bd22-48aa300f2c70 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.773s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.678s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:08 user nova-compute[74898]: INFO nova.compute.manager [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Shelve offloading
Nov 17 03:06:08 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Instance destroyed successfully.
Nov 17 03:06:08 user nova-compute[74898]: DEBUG nova.compute.manager [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "refresh_cache-dbaabab0-92f0-480d-8f81-0db980c8f333" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquired lock "refresh_cache-dbaabab0-92f0-480d-8f81-0db980c8f333" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG nova.network.neutron [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] COPY block job progress, current cursor: 264241152 final cursor: 1073741824 {{(pid=74898) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 03:06:08 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Instance destroyed successfully.
Nov 17 03:06:08 user nova-compute[74898]: DEBUG nova.objects.instance [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lazy-loading 'resources' on Instance uuid 36e687c0-9481-4126-b365-f7f9707e2338 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-17T03:02:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1864987777',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1142928320',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFxXq1bg8SNfYclLKbHjQo8K7gYin+VKFCZjgxMqEfzsP02ZdMm/i+ADtVzCoWZvNZrQLncAAgkXtb7MJSmkiivDIZZxRPOsrvSXR9fx5NB8X7uJk83pxZNQE+yr12IYQ==',key_name='tempest-keypair-2063298515',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:04:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1ed77effbea441eb58507f436033c3c',ramdisk_id='',reservation_id='r-ez9l9sip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1334889751',owner_user_name='tempest-ServerActionsV293TestJSON-1334889751-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:04:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbc18ee9aea24d6db4a9a71f4cf2d723',uuid=36e687c0-9481-4126-b365-f7f9707e2338,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5415aaa1-723f-4f35-971c-509caa04575d", "address": "fa:16:3e:6f:9f:8e", "network": {"id": "4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-545743352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ed77effbea441eb58507f436033c3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5415aaa1-72", "ovs_interfaceid": "5415aaa1-723f-4f35-971c-509caa04575d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Converting VIF {"id": "5415aaa1-723f-4f35-971c-509caa04575d", "address": "fa:16:3e:6f:9f:8e", "network": {"id": "4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-545743352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ed77effbea441eb58507f436033c3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5415aaa1-72", "ovs_interfaceid": "5415aaa1-723f-4f35-971c-509caa04575d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:9f:8e,bridge_name='br-int',has_traffic_filtering=True,id=5415aaa1-723f-4f35-971c-509caa04575d,network=Network(4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5415aaa1-72') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG os_vif [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:9f:8e,bridge_name='br-int',has_traffic_filtering=True,id=5415aaa1-723f-4f35-971c-509caa04575d,network=Network(4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5415aaa1-72') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5415aaa1-72, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d953c4c8-f57f-4b12-920e-c31df5ac4107) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:08 user nova-compute[74898]: INFO os_vif [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:9f:8e,bridge_name='br-int',has_traffic_filtering=True,id=5415aaa1-723f-4f35-971c-509caa04575d,network=Network(4cd6ef20-5d2f-49fc-ad0b-2e772e04f3ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5415aaa1-72')
Nov 17 03:06:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFdrlUym', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:06:08 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:06:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01ace65-e4f1-4953-bbc7-f50bb18b9a2c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:06:08 user nova-compute[74898]: No targets found.
Nov 17 03:06:08 user nova-compute[74898]: iSNS:
Nov 17 03:06:08 user nova-compute[74898]: No targets found.
Nov 17 03:06:08 user nova-compute[74898]: STATIC:
Nov 17 03:06:08 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981
Nov 17 03:06:08 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:08 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:08 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45
Nov 17 03:06:08 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:08 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:08 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248
Nov 17 03:06:08 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:08 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:08 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484
Nov 17 03:06:08 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:08 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:08 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406
Nov 17 03:06:08 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:08 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:08 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146
Nov 17 03:06:08 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:08 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:08 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4
Nov 17 03:06:08 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:08 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:08 user nova-compute[74898]: FIRMWARE:
Nov 17 03:06:08 user nova-compute[74898]: No targets found.
Nov 17 03:06:08 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:06:08 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:06:08 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[03835a8f-1ef6-4759-a7bd-5d93773ae7b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffc4e41-d56b-4377-86c5-0bf4bbe436b9]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:06:08 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:06:08 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:06:08 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:06:08 user nova-compute[74898]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:06:08 user nova-compute[74898]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 (non-flash)
Nov 17 03:06:08 user nova-compute[74898]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)
Nov 17 03:06:08 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 (non-flash)
Nov 17 03:06:08 user nova-compute[74898]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:06:08 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:06:08 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:06:08 user nova-compute[74898]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:06:08 user nova-compute[74898]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 (non-flash)
Nov 17 03:06:08 user nova-compute[74898]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)
Nov 17 03:06:08 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf8698dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4'): ({'sdb'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Removing single pathed devices sdb {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:06:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb42b6de-705d-4139-b7e4-a5f7fd1df6e5]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[357ef36d-e1bf-4c6d-8e5a-eb52a221de88]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Flushing IO for device /dev/sdb {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a70449-5f2b-47d5-9879-e57a9539e74e]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.062s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[518796ea-371a-4572-b1c8-19a924c3009a]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.041s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[da94e8ac-d59e-4032-b8ee-3921022c8d27]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ce7306-0264-4f99-89f8-67b826859b65]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4, portal: 172.16.0.220,3260]
Nov 17 03:06:09 user nova-compute[74898]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4, portal: 172.16.0.220,3260] successful.
Nov 17 03:06:09 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] COPY block job progress, current cursor: 409993216 final cursor: 1073741824 {{(pid=74898) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG nova.network.neutron [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Updating instance_info_cache with network_info: [{"id": "8e38fd27-07cd-40c1-bef7-67d150932e57", "address": "fa:16:3e:8b:5d:76", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e38fd27-07", "ovs_interfaceid": "8e38fd27-07cd-40c1-bef7-67d150932e57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:637a8d80-8ef7-46f9-806c-cb8fdf7699c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[39269d58-8fe6-4aae-87a6-eb0321e90485]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.440s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] <== disconnect_volume: return (442ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:06:09 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Deleting instance files /opt/stack/data/nova/instances/36e687c0-9481-4126-b365-f7f9707e2338_del
Nov 17 03:06:09 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Deletion of /opt/stack/data/nova/instances/36e687c0-9481-4126-b365-f7f9707e2338_del complete
Nov 17 03:06:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Releasing lock "refresh_cache-dbaabab0-92f0-480d-8f81-0db980c8f333" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:06:09 user nova-compute[74898]: INFO nova.compute.manager [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Took 1.54 seconds to destroy the instance on the hypervisor.
Nov 17 03:06:09 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:06:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] COPY block job progress, current cursor: 521142272 final cursor: 1073741824 {{(pid=74898) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 03:06:10 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Instance destroyed successfully.
Nov 17 03:06:10 user nova-compute[74898]: DEBUG nova.objects.instance [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lazy-loading 'resources' on Instance uuid dbaabab0-92f0-480d-8f81-0db980c8f333 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-702287873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-702287873',id=17,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEl2EjQvjTqov68hcm1AeEL6uEvsYKfdioCWHBY36ZV+F59uTU3I4mzgJuvGNcYThtmuN40EjuxjcwIBe1nJp1ArnA81m6C50PEcotvfJhejuAEZ67UJtWnOWyPgfw3LKw==',key_name='tempest-keypair-742675604',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:04:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3de7d05d475c49f0805f5aab5853a0b2',ramdisk_id='',reservation_id='r-1c58hjg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-940982522',owner_user_name='tempest-AttachVolumeShelveTestJSON-940982522-project-member',shelved_at='2023-11-17T03:06:08.330245',shelved_host='user',shelved_image_id='618ece13-88de-461f-87c1-cbcc69b161a6'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:06:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='926d8bd27eb24824a71cb9f1969f9c45',uuid=dbaabab0-92f0-480d-8f81-0db980c8f333,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "8e38fd27-07cd-40c1-bef7-67d150932e57", "address": "fa:16:3e:8b:5d:76", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e38fd27-07", "ovs_interfaceid": "8e38fd27-07cd-40c1-bef7-67d150932e57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Converting VIF {"id": "8e38fd27-07cd-40c1-bef7-67d150932e57", "address": "fa:16:3e:8b:5d:76", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e38fd27-07", "ovs_interfaceid": "8e38fd27-07cd-40c1-bef7-67d150932e57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:5d:76,bridge_name='br-int',has_traffic_filtering=True,id=8e38fd27-07cd-40c1-bef7-67d150932e57,network=Network(c92bc72d-7b33-49a8-96e5-ca2ed117fa48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e38fd27-07') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG os_vif [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:5d:76,bridge_name='br-int',has_traffic_filtering=True,id=8e38fd27-07cd-40c1-bef7-67d150932e57,network=Network(c92bc72d-7b33-49a8-96e5-ca2ed117fa48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e38fd27-07') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e38fd27-07, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed0ff2d6-231d-4991-904d-26fce71bdb5b) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:06:10 user nova-compute[74898]: INFO os_vif [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:5d:76,bridge_name='br-int',has_traffic_filtering=True,id=8e38fd27-07cd-40c1-bef7-67d150932e57,network=Network(c92bc72d-7b33-49a8-96e5-ca2ed117fa48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e38fd27-07')
Nov 17 03:06:10 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Deleting instance files /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333_del
Nov 17 03:06:10 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Deletion of /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333_del complete
Nov 17 03:06:10 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Deleted allocations for instance dbaabab0-92f0-480d-8f81-0db980c8f333
Nov 17 03:06:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] COPY block job progress, current cursor: 612368384 final cursor: 1073741824 {{(pid=74898) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG nova.objects.instance [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lazy-loading 'numa_topology' on Instance uuid dbaabab0-92f0-480d-8f81-0db980c8f333 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG nova.objects.base [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Object Instance<dbaabab0-92f0-480d-8f81-0db980c8f333> lazy-loaded attributes: resources,numa_topology {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG nova.compute.manager [req-79bf324d-29a1-4faa-b6d0-d44db9b135f6 req-ede729e5-c91f-4e22-babf-bf7d18e74a59 service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Received event network-vif-deleted-5415aaa1-723f-4f35-971c-509caa04575d {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:10 user nova-compute[74898]: INFO nova.compute.manager [req-79bf324d-29a1-4faa-b6d0-d44db9b135f6 req-ede729e5-c91f-4e22-babf-bf7d18e74a59 service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Neutron deleted interface 5415aaa1-723f-4f35-971c-509caa04575d; detaching it from the instance and deleting it from the info cache
Nov 17 03:06:10 user nova-compute[74898]: DEBUG nova.network.neutron [req-79bf324d-29a1-4faa-b6d0-d44db9b135f6 req-ede729e5-c91f-4e22-babf-bf7d18e74a59 service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:06:10 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Took 1.01 seconds to deallocate network for instance.
Nov 17 03:06:10 user nova-compute[74898]: DEBUG nova.compute.manager [req-79bf324d-29a1-4faa-b6d0-d44db9b135f6 req-ede729e5-c91f-4e22-babf-bf7d18e74a59 service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Detach interface failed, port_id=5415aaa1-723f-4f35-971c-509caa04575d, reason: Instance 36e687c0-9481-4126-b365-f7f9707e2338 could not be found. {{(pid=74898) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] COPY block job progress, current cursor: 783286272 final cursor: 1073741824 {{(pid=74898) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.501s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG nova.compute.manager [req-bc9c6d41-34be-442f-bd63-44ed69fca6be req-a2b53b3b-a7ee-4956-81b9-ba99cec86824 service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Received event network-vif-plugged-5415aaa1-723f-4f35-971c-509caa04575d {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-bc9c6d41-34be-442f-bd63-44ed69fca6be req-a2b53b3b-a7ee-4956-81b9-ba99cec86824 service nova] Acquiring lock "36e687c0-9481-4126-b365-f7f9707e2338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-bc9c6d41-34be-442f-bd63-44ed69fca6be req-a2b53b3b-a7ee-4956-81b9-ba99cec86824 service nova] Lock "36e687c0-9481-4126-b365-f7f9707e2338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-bc9c6d41-34be-442f-bd63-44ed69fca6be req-a2b53b3b-a7ee-4956-81b9-ba99cec86824 service nova] Lock "36e687c0-9481-4126-b365-f7f9707e2338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG nova.compute.manager [req-bc9c6d41-34be-442f-bd63-44ed69fca6be req-a2b53b3b-a7ee-4956-81b9-ba99cec86824 service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] No waiting events found dispatching network-vif-plugged-5415aaa1-723f-4f35-971c-509caa04575d {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:06:10 user nova-compute[74898]: WARNING nova.compute.manager [req-bc9c6d41-34be-442f-bd63-44ed69fca6be req-a2b53b3b-a7ee-4956-81b9-ba99cec86824 service nova] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Received unexpected event network-vif-plugged-5415aaa1-723f-4f35-971c-509caa04575d for instance with vm_state active and task_state deleting.
Nov 17 03:06:10 user nova-compute[74898]: DEBUG nova.compute.manager [req-bc9c6d41-34be-442f-bd63-44ed69fca6be req-a2b53b3b-a7ee-4956-81b9-ba99cec86824 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Received event network-changed-8e38fd27-07cd-40c1-bef7-67d150932e57 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG nova.compute.manager [req-bc9c6d41-34be-442f-bd63-44ed69fca6be req-a2b53b3b-a7ee-4956-81b9-ba99cec86824 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Refreshing instance network info cache due to event network-changed-8e38fd27-07cd-40c1-bef7-67d150932e57. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-bc9c6d41-34be-442f-bd63-44ed69fca6be req-a2b53b3b-a7ee-4956-81b9-ba99cec86824 service nova] Acquiring lock "refresh_cache-dbaabab0-92f0-480d-8f81-0db980c8f333" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-bc9c6d41-34be-442f-bd63-44ed69fca6be req-a2b53b3b-a7ee-4956-81b9-ba99cec86824 service nova] Acquired lock "refresh_cache-dbaabab0-92f0-480d-8f81-0db980c8f333" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG nova.network.neutron [req-bc9c6d41-34be-442f-bd63-44ed69fca6be req-a2b53b3b-a7ee-4956-81b9-ba99cec86824 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Refreshing network info cache for port 8e38fd27-07cd-40c1-bef7-67d150932e57 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:06:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-247c027c-a707-4bce-b526-16ba14bbc101 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "dbaabab0-92f0-480d-8f81-0db980c8f333" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.030s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:11 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] COPY block job progress, current cursor: 858783744 final cursor: 1073741824 {{(pid=74898) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 03:06:11 user nova-compute[74898]: INFO nova.compute.manager [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Took 1.12 seconds to detach 1 volumes for instance.
Nov 17 03:06:11 user nova-compute[74898]: DEBUG nova.compute.manager [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] [instance: 36e687c0-9481-4126-b365-f7f9707e2338] Deleting volume: 637a8d80-8ef7-46f9-806c-cb8fdf7699c4 {{(pid=74898) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 17 03:06:11 user nova-compute[74898]: DEBUG nova.network.neutron [req-bc9c6d41-34be-442f-bd63-44ed69fca6be req-a2b53b3b-a7ee-4956-81b9-ba99cec86824 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Updated VIF entry in instance network info cache for port 8e38fd27-07cd-40c1-bef7-67d150932e57. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:06:11 user nova-compute[74898]: DEBUG nova.network.neutron [req-bc9c6d41-34be-442f-bd63-44ed69fca6be req-a2b53b3b-a7ee-4956-81b9-ba99cec86824 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Updating instance_info_cache with network_info: [{"id": "8e38fd27-07cd-40c1-bef7-67d150932e57", "address": "fa:16:3e:8b:5d:76", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8e38fd27-07", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:06:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-bc9c6d41-34be-442f-bd63-44ed69fca6be req-a2b53b3b-a7ee-4956-81b9-ba99cec86824 service nova] Releasing lock "refresh_cache-dbaabab0-92f0-480d-8f81-0db980c8f333" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:06:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:11 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] COPY block job progress, current cursor: 991952896 final cursor: 1073741824 {{(pid=74898) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:12 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Deleted allocations for instance 36e687c0-9481-4126-b365-f7f9707e2338
Nov 17 03:06:12 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74898) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2214cb95-3f96-4a64-8890-d31861adab84 tempest-ServerActionsV293TestJSON-1334889751 tempest-ServerActionsV293TestJSON-1334889751-project-member] Lock "36e687c0-9481-4126-b365-f7f9707e2338" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.474s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tphxAlIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': 'bf480009-b502-4496-8302-ef4efc9ef406'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:06:12 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:06:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[767603ea-e4bc-4eae-81d9-10a22d05b615]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:06:12 user nova-compute[74898]: No targets found.
Nov 17 03:06:12 user nova-compute[74898]: iSNS:
Nov 17 03:06:12 user nova-compute[74898]: No targets found.
Nov 17 03:06:12 user nova-compute[74898]: STATIC:
Nov 17 03:06:12 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981
Nov 17 03:06:12 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:12 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:12 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45
Nov 17 03:06:12 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:12 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:12 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248
Nov 17 03:06:12 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:12 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:12 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484
Nov 17 03:06:12 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:12 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:12 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406
Nov 17 03:06:12 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:12 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:12 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146
Nov 17 03:06:12 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:12 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:12 user nova-compute[74898]: FIRMWARE:
Nov 17 03:06:12 user nova-compute[74898]: No targets found.
Nov 17 03:06:12 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:06:12 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:06:12 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a1a7b2-cd36-4daa-8bca-3c86994b0c38]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0086b999-6bf6-4c97-9649-afd59d02b5bb]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:06:12 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:06:12 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:06:12 user nova-compute[74898]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:06:12 user nova-compute[74898]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 (non-flash)
Nov 17 03:06:12 user nova-compute[74898]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)
Nov 17 03:06:12 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:06:12 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:06:12 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:06:12 user nova-compute[74898]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:06:12 user nova-compute[74898]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 (non-flash)
Nov 17 03:06:12 user nova-compute[74898]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)
Nov 17 03:06:12 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf869f010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406'): ({'sdi'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Removing single pathed devices sdi {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dcc2cc-64b7-4ae8-8e76-0f407d14d909]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6641f981-c6e8-4644-91a2-ac0b2eecd204]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Flushing IO for device /dev/sdi {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e170337-9ab5-4ac3-89e0-990f1b771da2]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.033s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c667bbaf-19ef-4949-a4d8-9c7b129060a9]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] SCSI volumes sdi have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8522b5-3234-4d8d-bf9b-c38030569d19]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e913bc9f-521e-4eb4-a96f-274eb4a367ec]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406, portal: 172.16.0.220,3260]
Nov 17 03:06:12 user nova-compute[74898]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406, portal: 172.16.0.220,3260] successful.
Nov 17 03:06:12 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf480009-b502-4496-8302-ef4efc9ef406 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a0adc6-a6a5-47aa-a39a-c826c1dfc2c3]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] <== disconnect_volume: return (303ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG nova.compute.manager [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'frPOnDuL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '474a469d-9ebe-4e91-9ec4-3f610bdd4d27', 'attached_at': '', 'detached_at': '', 'volume_id': 'a3c6e9a5-ff67-437f-8a8a-90dcfee9a146', 'serial'} {{(pid=74898) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 17 03:06:12 user nova-compute[74898]: DEBUG nova.compute.manager [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] swap_volume: removing Cinder connection for volume bf480009-b502-4496-8302-ef4efc9ef406 {{(pid=74898) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 17 03:06:14 user nova-compute[74898]: DEBUG nova.compute.manager [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] swap_volume: Updating volume bf480009-b502-4496-8302-ef4efc9ef406 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "frPOnDuL", "auth_password": "pNK5XlqtDjP9vn", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "a3c6e9a5-ff67-437f-8a8a-90dcfee9a146"}, "status": "reserved", "instance": "474a469d-9ebe-4e91-9ec4-3f610bdd4d27", "attached_at": "", "detached_at": "", "volume_id": "a3c6e9a5-ff67-437f-8a8a-90dcfee9a146", "serial": "a3c6e9a5-ff67-437f-8a8a-90dcfee9a146"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'a3c6e9a5-ff67-437f-8a8a-90dcfee9a146', 'no_device': None, 'attachment_id': 'bcb0c45d-9df5-4b46-bd69-f2d749fd2149'} {{(pid=74898) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 17 03:06:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-7ba5344e-b952-46e0-81b4-a2bd79334312 tempest-TestVolumeSwap-410555408 tempest-TestVolumeSwap-410555408-project-admin] Lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.646s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 13.626s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:14 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:06:14 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:06:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Acquiring lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:15 user nova-compute[74898]: INFO nova.compute.manager [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Detaching volume a3c6e9a5-ff67-437f-8a8a-90dcfee9a146
Nov 17 03:06:15 user nova-compute[74898]: INFO nova.virt.block_device [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Attempting to driver detach volume a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 from mountpoint /dev/vdb
Nov 17 03:06:15 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Attempting to detach device vdb from instance 474a469d-9ebe-4e91-9ec4-3f610bdd4d27 from the persistent domain config. {{(pid=74898) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 03:06:15 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:06:15 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:06:15 user nova-compute[74898]:   <source dev="/dev/sde"/>
Nov 17 03:06:15 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:06:15 user nova-compute[74898]:   <serial>a3c6e9a5-ff67-437f-8a8a-90dcfee9a146</serial>
Nov 17 03:06:15 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:06:15 user nova-compute[74898]: </disk>
Nov 17 03:06:15 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:06:15 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Successfully detached device vdb from instance 474a469d-9ebe-4e91-9ec4-3f610bdd4d27 from the persistent domain config.
Nov 17 03:06:15 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 474a469d-9ebe-4e91-9ec4-3f610bdd4d27 from the live domain config. {{(pid=74898) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 03:06:15 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:06:15 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:06:15 user nova-compute[74898]:   <source dev="/dev/sde"/>
Nov 17 03:06:15 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:06:15 user nova-compute[74898]:   <serial>a3c6e9a5-ff67-437f-8a8a-90dcfee9a146</serial>
Nov 17 03:06:15 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:06:15 user nova-compute[74898]: </disk>
Nov 17 03:06:15 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:06:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:15 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:06:16 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 474a469d-9ebe-4e91-9ec4-3f610bdd4d27 {{(pid=74898) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 03:06:16 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:06:16 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:06:16 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Didn't find any instances for network info cache update. {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 17 03:06:16 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:06:17 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:06:18 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:06:18 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:06:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:20 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:06:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:20 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:06:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:06:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:06:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:06:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:06:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474a469d-9ebe-4e91-9ec4-3f610bdd4d27/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474a469d-9ebe-4e91-9ec4-3f610bdd4d27/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474a469d-9ebe-4e91-9ec4-3f610bdd4d27/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/474a469d-9ebe-4e91-9ec4-3f610bdd4d27/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:24 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:06:24 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:06:24 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=7690MB free_disk=25.426956176757812GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:06:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:24 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:06:24 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance e733574a-56ba-4e24-babd-855bcb5bda61 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:06:24 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 015ff42a-4d69-4f60-b86c-c6bd68d23c99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:06:24 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 11704034-7afe-475c-ae43-1324b40f0d92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:06:24 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 474a469d-9ebe-4e91-9ec4-3f610bdd4d27 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:06:24 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 42994e39-187a-4fb6-a293-24a4eb57177b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:06:24 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance b94a0a17-77e9-41cf-9919-37b57b364ff2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:06:24 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:06:24 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:06:24 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:06:24 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:06:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:24 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:06:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.382s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:25 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:06:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:29 user nova-compute[74898]: DEBUG nova.compute.manager [req-1d6f3424-0999-49ff-9fb9-adb3698c19bc req-343e5963-0013-4faf-b744-317092a49389 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-changed-58ede42b-dcc4-45f2-8be6-f1fba65e9f4c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:29 user nova-compute[74898]: DEBUG nova.compute.manager [req-1d6f3424-0999-49ff-9fb9-adb3698c19bc req-343e5963-0013-4faf-b744-317092a49389 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Refreshing instance network info cache due to event network-changed-58ede42b-dcc4-45f2-8be6-f1fba65e9f4c. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:06:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1d6f3424-0999-49ff-9fb9-adb3698c19bc req-343e5963-0013-4faf-b744-317092a49389 service nova] Acquiring lock "refresh_cache-b94a0a17-77e9-41cf-9919-37b57b364ff2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:06:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1d6f3424-0999-49ff-9fb9-adb3698c19bc req-343e5963-0013-4faf-b744-317092a49389 service nova] Acquired lock "refresh_cache-b94a0a17-77e9-41cf-9919-37b57b364ff2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:06:29 user nova-compute[74898]: DEBUG nova.network.neutron [req-1d6f3424-0999-49ff-9fb9-adb3698c19bc req-343e5963-0013-4faf-b744-317092a49389 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Refreshing network info cache for port 58ede42b-dcc4-45f2-8be6-f1fba65e9f4c {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:06:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:30 user nova-compute[74898]: DEBUG nova.network.neutron [req-1d6f3424-0999-49ff-9fb9-adb3698c19bc req-343e5963-0013-4faf-b744-317092a49389 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Updated VIF entry in instance network info cache for port 58ede42b-dcc4-45f2-8be6-f1fba65e9f4c. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:06:30 user nova-compute[74898]: DEBUG nova.network.neutron [req-1d6f3424-0999-49ff-9fb9-adb3698c19bc req-343e5963-0013-4faf-b744-317092a49389 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Updating instance_info_cache with network_info: [{"id": "58ede42b-dcc4-45f2-8be6-f1fba65e9f4c", "address": "fa:16:3e:26:35:f5", "network": {"id": "2e9858af-0eb1-4e7c-bd29-7238d7eb070e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1878259197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ede42b-dc", "ovs_interfaceid": "58ede42b-dcc4-45f2-8be6-f1fba65e9f4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "704c171d-d5bc-4f60-af76-4b00f98191c6", "address": "fa:16:3e:d8:69:fc", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704c171d-d5", "ovs_interfaceid": "704c171d-d5bc-4f60-af76-4b00f98191c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "178a5871-43af-4e36-9665-07cdd3ecf1d7", "address": "fa:16:3e:f6:ff:91", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178a5871-43", "ovs_interfaceid": "178a5871-43af-4e36-9665-07cdd3ecf1d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "857da07e-b7c7-4bb9-805a-8c9a7d30d6bf", "address": "fa:16:3e:e1:48:b9", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap857da07e-b7", "ovs_interfaceid": "857da07e-b7c7-4bb9-805a-8c9a7d30d6bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86a69795-c167-4353-b46e-0137384a0af5", "address": "fa:16:3e:8b:e1:c7", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a69795-c1", "ovs_interfaceid": "86a69795-c167-4353-b46e-0137384a0af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "189360e5-7bc0-4711-8069-8939c57a28d7", "address": "fa:16:3e:45:f0:2c", "network": {"id": "0e992b1f-b626-47b5-b861-9b1420f22a3d", "bridge": "br-int", "label": "tempest-device-tagging-net2-855379110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189360e5-7b", "ovs_interfaceid": "189360e5-7bc0-4711-8069-8939c57a28d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0559955f-ea89-4f72-93dd-22b0df42e380", "address": "fa:16:3e:cb:58:f5", "network": {"id": "0e992b1f-b626-47b5-b861-9b1420f22a3d", "bridge": "br-int", "label": "tempest-device-tagging-net2-855379110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0559955f-ea", "ovs_interfaceid": "0559955f-ea89-4f72-93dd-22b0df42e380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:06:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1d6f3424-0999-49ff-9fb9-adb3698c19bc req-343e5963-0013-4faf-b744-317092a49389 service nova] Releasing lock "refresh_cache-b94a0a17-77e9-41cf-9919-37b57b364ff2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:06:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:32 user nova-compute[74898]: INFO nova.compute.manager [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Terminating instance
Nov 17 03:06:32 user nova-compute[74898]: DEBUG nova.compute.manager [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG nova.compute.manager [req-50e7e246-6011-4e33-aea8-d84d48511c87 req-c0278a44-befb-44c3-b4ad-254d458a0278 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-unplugged-58ede42b-dcc4-45f2-8be6-f1fba65e9f4c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-50e7e246-6011-4e33-aea8-d84d48511c87 req-c0278a44-befb-44c3-b4ad-254d458a0278 service nova] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-50e7e246-6011-4e33-aea8-d84d48511c87 req-c0278a44-befb-44c3-b4ad-254d458a0278 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-50e7e246-6011-4e33-aea8-d84d48511c87 req-c0278a44-befb-44c3-b4ad-254d458a0278 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG nova.compute.manager [req-50e7e246-6011-4e33-aea8-d84d48511c87 req-c0278a44-befb-44c3-b4ad-254d458a0278 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] No waiting events found dispatching network-vif-unplugged-58ede42b-dcc4-45f2-8be6-f1fba65e9f4c {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG nova.compute.manager [req-50e7e246-6011-4e33-aea8-d84d48511c87 req-c0278a44-befb-44c3-b4ad-254d458a0278 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-unplugged-58ede42b-dcc4-45f2-8be6-f1fba65e9f4c for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG nova.compute.manager [req-6fd4fbb6-38b1-43fe-9c6a-d4e5d2fd174f req-4ad1014a-6f03-41d5-9ded-54dc4349ebc9 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-unplugged-704c171d-d5bc-4f60-af76-4b00f98191c6 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-6fd4fbb6-38b1-43fe-9c6a-d4e5d2fd174f req-4ad1014a-6f03-41d5-9ded-54dc4349ebc9 service nova] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-6fd4fbb6-38b1-43fe-9c6a-d4e5d2fd174f req-4ad1014a-6f03-41d5-9ded-54dc4349ebc9 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-6fd4fbb6-38b1-43fe-9c6a-d4e5d2fd174f req-4ad1014a-6f03-41d5-9ded-54dc4349ebc9 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG nova.compute.manager [req-6fd4fbb6-38b1-43fe-9c6a-d4e5d2fd174f req-4ad1014a-6f03-41d5-9ded-54dc4349ebc9 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] No waiting events found dispatching network-vif-unplugged-704c171d-d5bc-4f60-af76-4b00f98191c6 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG nova.compute.manager [req-6fd4fbb6-38b1-43fe-9c6a-d4e5d2fd174f req-4ad1014a-6f03-41d5-9ded-54dc4349ebc9 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-unplugged-704c171d-d5bc-4f60-af76-4b00f98191c6 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG nova.compute.manager [req-9fb6eae4-0aa2-4050-8821-9bcd11d0c539 req-04cd34fc-d436-4cb2-b755-0fd7bc61756d service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-unplugged-178a5871-43af-4e36-9665-07cdd3ecf1d7 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9fb6eae4-0aa2-4050-8821-9bcd11d0c539 req-04cd34fc-d436-4cb2-b755-0fd7bc61756d service nova] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9fb6eae4-0aa2-4050-8821-9bcd11d0c539 req-04cd34fc-d436-4cb2-b755-0fd7bc61756d service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9fb6eae4-0aa2-4050-8821-9bcd11d0c539 req-04cd34fc-d436-4cb2-b755-0fd7bc61756d service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG nova.compute.manager [req-9fb6eae4-0aa2-4050-8821-9bcd11d0c539 req-04cd34fc-d436-4cb2-b755-0fd7bc61756d service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] No waiting events found dispatching network-vif-unplugged-178a5871-43af-4e36-9665-07cdd3ecf1d7 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG nova.compute.manager [req-9fb6eae4-0aa2-4050-8821-9bcd11d0c539 req-04cd34fc-d436-4cb2-b755-0fd7bc61756d service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-unplugged-178a5871-43af-4e36-9665-07cdd3ecf1d7 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Instance destroyed successfully.
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.objects.instance [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lazy-loading 'resources' on Instance uuid b94a0a17-77e9-41cf-9919-37b57b364ff2 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778206541',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1778206541',id=18,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyGmJYYbvr3QyeCIw1kBCEDSS3NCSiXW2VlUSJ3BJlyvfl1x3dvUE6dFKqzhvQizyxSx5x1rl4z0TjriBVD80sj4GqrlXMNMQraj8GWH5vb9kWh+w6HjvRfrn66x/EO9g==',key_name='tempest-keypair-530835063',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:05:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67b8bb76f54b4f5fa95f603550c269dd',ramdisk_id='',reservation_id='r-fz50cvhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1244088613',owner_user_name='tempest-TaggedBootDevicesTest_v242-1244088613-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:05:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bedf3f8df3e946b88a32ce4c78ee358c',uuid=b94a0a17-77e9-41cf-9919-37b57b364ff2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58ede42b-dcc4-45f2-8be6-f1fba65e9f4c", "address": "fa:16:3e:26:35:f5", "network": {"id": "2e9858af-0eb1-4e7c-bd29-7238d7eb070e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1878259197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ede42b-dc", "ovs_interfaceid": "58ede42b-dcc4-45f2-8be6-f1fba65e9f4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converting VIF {"id": "58ede42b-dcc4-45f2-8be6-f1fba65e9f4c", "address": "fa:16:3e:26:35:f5", "network": {"id": "2e9858af-0eb1-4e7c-bd29-7238d7eb070e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1878259197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ede42b-dc", "ovs_interfaceid": "58ede42b-dcc4-45f2-8be6-f1fba65e9f4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:35:f5,bridge_name='br-int',has_traffic_filtering=True,id=58ede42b-dcc4-45f2-8be6-f1fba65e9f4c,network=Network(2e9858af-0eb1-4e7c-bd29-7238d7eb070e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ede42b-dc') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG os_vif [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:35:f5,bridge_name='br-int',has_traffic_filtering=True,id=58ede42b-dcc4-45f2-8be6-f1fba65e9f4c,network=Network(2e9858af-0eb1-4e7c-bd29-7238d7eb070e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ede42b-dc') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58ede42b-dc, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a998ac6-a158-4d9b-8c9f-e52aa8b53532) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: INFO os_vif [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:35:f5,bridge_name='br-int',has_traffic_filtering=True,id=58ede42b-dcc4-45f2-8be6-f1fba65e9f4c,network=Network(2e9858af-0eb1-4e7c-bd29-7238d7eb070e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58ede42b-dc')
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778206541',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1778206541',id=18,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyGmJYYbvr3QyeCIw1kBCEDSS3NCSiXW2VlUSJ3BJlyvfl1x3dvUE6dFKqzhvQizyxSx5x1rl4z0TjriBVD80sj4GqrlXMNMQraj8GWH5vb9kWh+w6HjvRfrn66x/EO9g==',key_name='tempest-keypair-530835063',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:05:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67b8bb76f54b4f5fa95f603550c269dd',ramdisk_id='',reservation_id='r-fz50cvhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1244088613',owner_user_name='tempest-TaggedBootDevicesTest_v242-1244088613-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:05:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bedf3f8df3e946b88a32ce4c78ee358c',uuid=b94a0a17-77e9-41cf-9919-37b57b364ff2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "704c171d-d5bc-4f60-af76-4b00f98191c6", "address": "fa:16:3e:d8:69:fc", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704c171d-d5", "ovs_interfaceid": "704c171d-d5bc-4f60-af76-4b00f98191c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converting VIF {"id": "704c171d-d5bc-4f60-af76-4b00f98191c6", "address": "fa:16:3e:d8:69:fc", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704c171d-d5", "ovs_interfaceid": "704c171d-d5bc-4f60-af76-4b00f98191c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:69:fc,bridge_name='br-int',has_traffic_filtering=True,id=704c171d-d5bc-4f60-af76-4b00f98191c6,network=Network(4180a6e3-2590-404c-a60c-3337b57fe61f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap704c171d-d5') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG os_vif [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:69:fc,bridge_name='br-int',has_traffic_filtering=True,id=704c171d-d5bc-4f60-af76-4b00f98191c6,network=Network(4180a6e3-2590-404c-a60c-3337b57fe61f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap704c171d-d5') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap704c171d-d5, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d71e0e6-1b20-46ba-851c-8b8998f3fc83) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: INFO os_vif [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:69:fc,bridge_name='br-int',has_traffic_filtering=True,id=704c171d-d5bc-4f60-af76-4b00f98191c6,network=Network(4180a6e3-2590-404c-a60c-3337b57fe61f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap704c171d-d5')
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778206541',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1778206541',id=18,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyGmJYYbvr3QyeCIw1kBCEDSS3NCSiXW2VlUSJ3BJlyvfl1x3dvUE6dFKqzhvQizyxSx5x1rl4z0TjriBVD80sj4GqrlXMNMQraj8GWH5vb9kWh+w6HjvRfrn66x/EO9g==',key_name='tempest-keypair-530835063',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:05:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67b8bb76f54b4f5fa95f603550c269dd',ramdisk_id='',reservation_id='r-fz50cvhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1244088613',owner_user_name='tempest-TaggedBootDevicesTest_v242-1244088613-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:05:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bedf3f8df3e946b88a32ce4c78ee358c',uuid=b94a0a17-77e9-41cf-9919-37b57b364ff2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "178a5871-43af-4e36-9665-07cdd3ecf1d7", "address": "fa:16:3e:f6:ff:91", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178a5871-43", "ovs_interfaceid": "178a5871-43af-4e36-9665-07cdd3ecf1d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converting VIF {"id": "178a5871-43af-4e36-9665-07cdd3ecf1d7", "address": "fa:16:3e:f6:ff:91", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178a5871-43", "ovs_interfaceid": "178a5871-43af-4e36-9665-07cdd3ecf1d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ff:91,bridge_name='br-int',has_traffic_filtering=True,id=178a5871-43af-4e36-9665-07cdd3ecf1d7,network=Network(4180a6e3-2590-404c-a60c-3337b57fe61f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap178a5871-43') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG os_vif [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ff:91,bridge_name='br-int',has_traffic_filtering=True,id=178a5871-43af-4e36-9665-07cdd3ecf1d7,network=Network(4180a6e3-2590-404c-a60c-3337b57fe61f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap178a5871-43') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap178a5871-43, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=71024dce-786a-472a-b29c-17592f14737b) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: INFO os_vif [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ff:91,bridge_name='br-int',has_traffic_filtering=True,id=178a5871-43af-4e36-9665-07cdd3ecf1d7,network=Network(4180a6e3-2590-404c-a60c-3337b57fe61f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap178a5871-43')
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778206541',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1778206541',id=18,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyGmJYYbvr3QyeCIw1kBCEDSS3NCSiXW2VlUSJ3BJlyvfl1x3dvUE6dFKqzhvQizyxSx5x1rl4z0TjriBVD80sj4GqrlXMNMQraj8GWH5vb9kWh+w6HjvRfrn66x/EO9g==',key_name='tempest-keypair-530835063',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:05:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67b8bb76f54b4f5fa95f603550c269dd',ramdisk_id='',reservation_id='r-fz50cvhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1244088613',owner_user_name='tempest-TaggedBootDevicesTest_v242-1244088613-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:05:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bedf3f8df3e946b88a32ce4c78ee358c',uuid=b94a0a17-77e9-41cf-9919-37b57b364ff2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "857da07e-b7c7-4bb9-805a-8c9a7d30d6bf", "address": "fa:16:3e:e1:48:b9", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap857da07e-b7", "ovs_interfaceid": "857da07e-b7c7-4bb9-805a-8c9a7d30d6bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converting VIF {"id": "857da07e-b7c7-4bb9-805a-8c9a7d30d6bf", "address": "fa:16:3e:e1:48:b9", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap857da07e-b7", "ovs_interfaceid": "857da07e-b7c7-4bb9-805a-8c9a7d30d6bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:48:b9,bridge_name='br-int',has_traffic_filtering=True,id=857da07e-b7c7-4bb9-805a-8c9a7d30d6bf,network=Network(4180a6e3-2590-404c-a60c-3337b57fe61f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap857da07e-b7') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG os_vif [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:48:b9,bridge_name='br-int',has_traffic_filtering=True,id=857da07e-b7c7-4bb9-805a-8c9a7d30d6bf,network=Network(4180a6e3-2590-404c-a60c-3337b57fe61f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap857da07e-b7') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap857da07e-b7, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-0984efee-dcb1-4615-a729-76e1519778a7 req-cb2e9a50-8b50-49d4-92b5-b35d411b2219 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-plugged-58ede42b-dcc4-45f2-8be6-f1fba65e9f4c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0984efee-dcb1-4615-a729-76e1519778a7 req-cb2e9a50-8b50-49d4-92b5-b35d411b2219 service nova] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0984efee-dcb1-4615-a729-76e1519778a7 req-cb2e9a50-8b50-49d4-92b5-b35d411b2219 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0984efee-dcb1-4615-a729-76e1519778a7 req-cb2e9a50-8b50-49d4-92b5-b35d411b2219 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-0984efee-dcb1-4615-a729-76e1519778a7 req-cb2e9a50-8b50-49d4-92b5-b35d411b2219 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] No waiting events found dispatching network-vif-plugged-58ede42b-dcc4-45f2-8be6-f1fba65e9f4c {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:06:34 user nova-compute[74898]: WARNING nova.compute.manager [req-0984efee-dcb1-4615-a729-76e1519778a7 req-cb2e9a50-8b50-49d4-92b5-b35d411b2219 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received unexpected event network-vif-plugged-58ede42b-dcc4-45f2-8be6-f1fba65e9f4c for instance with vm_state active and task_state deleting.
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-0984efee-dcb1-4615-a729-76e1519778a7 req-cb2e9a50-8b50-49d4-92b5-b35d411b2219 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-unplugged-857da07e-b7c7-4bb9-805a-8c9a7d30d6bf {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0984efee-dcb1-4615-a729-76e1519778a7 req-cb2e9a50-8b50-49d4-92b5-b35d411b2219 service nova] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0984efee-dcb1-4615-a729-76e1519778a7 req-cb2e9a50-8b50-49d4-92b5-b35d411b2219 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0984efee-dcb1-4615-a729-76e1519778a7 req-cb2e9a50-8b50-49d4-92b5-b35d411b2219 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-0984efee-dcb1-4615-a729-76e1519778a7 req-cb2e9a50-8b50-49d4-92b5-b35d411b2219 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] No waiting events found dispatching network-vif-unplugged-857da07e-b7c7-4bb9-805a-8c9a7d30d6bf {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-0984efee-dcb1-4615-a729-76e1519778a7 req-cb2e9a50-8b50-49d4-92b5-b35d411b2219 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-unplugged-857da07e-b7c7-4bb9-805a-8c9a7d30d6bf for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-0984efee-dcb1-4615-a729-76e1519778a7 req-cb2e9a50-8b50-49d4-92b5-b35d411b2219 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-plugged-857da07e-b7c7-4bb9-805a-8c9a7d30d6bf {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0984efee-dcb1-4615-a729-76e1519778a7 req-cb2e9a50-8b50-49d4-92b5-b35d411b2219 service nova] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0984efee-dcb1-4615-a729-76e1519778a7 req-cb2e9a50-8b50-49d4-92b5-b35d411b2219 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0984efee-dcb1-4615-a729-76e1519778a7 req-cb2e9a50-8b50-49d4-92b5-b35d411b2219 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-0984efee-dcb1-4615-a729-76e1519778a7 req-cb2e9a50-8b50-49d4-92b5-b35d411b2219 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] No waiting events found dispatching network-vif-plugged-857da07e-b7c7-4bb9-805a-8c9a7d30d6bf {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:06:34 user nova-compute[74898]: WARNING nova.compute.manager [req-0984efee-dcb1-4615-a729-76e1519778a7 req-cb2e9a50-8b50-49d4-92b5-b35d411b2219 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received unexpected event network-vif-plugged-857da07e-b7c7-4bb9-805a-8c9a7d30d6bf for instance with vm_state active and task_state deleting.
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-0984efee-dcb1-4615-a729-76e1519778a7 req-cb2e9a50-8b50-49d4-92b5-b35d411b2219 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-unplugged-0559955f-ea89-4f72-93dd-22b0df42e380 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0984efee-dcb1-4615-a729-76e1519778a7 req-cb2e9a50-8b50-49d4-92b5-b35d411b2219 service nova] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0984efee-dcb1-4615-a729-76e1519778a7 req-cb2e9a50-8b50-49d4-92b5-b35d411b2219 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0984efee-dcb1-4615-a729-76e1519778a7 req-cb2e9a50-8b50-49d4-92b5-b35d411b2219 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-0984efee-dcb1-4615-a729-76e1519778a7 req-cb2e9a50-8b50-49d4-92b5-b35d411b2219 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] No waiting events found dispatching network-vif-unplugged-0559955f-ea89-4f72-93dd-22b0df42e380 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-0984efee-dcb1-4615-a729-76e1519778a7 req-cb2e9a50-8b50-49d4-92b5-b35d411b2219 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-unplugged-0559955f-ea89-4f72-93dd-22b0df42e380 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-0984efee-dcb1-4615-a729-76e1519778a7 req-cb2e9a50-8b50-49d4-92b5-b35d411b2219 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-plugged-0559955f-ea89-4f72-93dd-22b0df42e380 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0984efee-dcb1-4615-a729-76e1519778a7 req-cb2e9a50-8b50-49d4-92b5-b35d411b2219 service nova] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0984efee-dcb1-4615-a729-76e1519778a7 req-cb2e9a50-8b50-49d4-92b5-b35d411b2219 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0984efee-dcb1-4615-a729-76e1519778a7 req-cb2e9a50-8b50-49d4-92b5-b35d411b2219 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-0984efee-dcb1-4615-a729-76e1519778a7 req-cb2e9a50-8b50-49d4-92b5-b35d411b2219 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] No waiting events found dispatching network-vif-plugged-0559955f-ea89-4f72-93dd-22b0df42e380 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:06:34 user nova-compute[74898]: WARNING nova.compute.manager [req-0984efee-dcb1-4615-a729-76e1519778a7 req-cb2e9a50-8b50-49d4-92b5-b35d411b2219 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received unexpected event network-vif-plugged-0559955f-ea89-4f72-93dd-22b0df42e380 for instance with vm_state active and task_state deleting.
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a2859c2-40a1-49ac-8578-63aea852b89f) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: INFO os_vif [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:48:b9,bridge_name='br-int',has_traffic_filtering=True,id=857da07e-b7c7-4bb9-805a-8c9a7d30d6bf,network=Network(4180a6e3-2590-404c-a60c-3337b57fe61f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap857da07e-b7')
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778206541',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1778206541',id=18,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyGmJYYbvr3QyeCIw1kBCEDSS3NCSiXW2VlUSJ3BJlyvfl1x3dvUE6dFKqzhvQizyxSx5x1rl4z0TjriBVD80sj4GqrlXMNMQraj8GWH5vb9kWh+w6HjvRfrn66x/EO9g==',key_name='tempest-keypair-530835063',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:05:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67b8bb76f54b4f5fa95f603550c269dd',ramdisk_id='',reservation_id='r-fz50cvhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1244088613',owner_user_name='tempest-TaggedBootDevicesTest_v242-1244088613-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:05:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bedf3f8df3e946b88a32ce4c78ee358c',uuid=b94a0a17-77e9-41cf-9919-37b57b364ff2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86a69795-c167-4353-b46e-0137384a0af5", "address": "fa:16:3e:8b:e1:c7", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a69795-c1", "ovs_interfaceid": "86a69795-c167-4353-b46e-0137384a0af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converting VIF {"id": "86a69795-c167-4353-b46e-0137384a0af5", "address": "fa:16:3e:8b:e1:c7", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a69795-c1", "ovs_interfaceid": "86a69795-c167-4353-b46e-0137384a0af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e1:c7,bridge_name='br-int',has_traffic_filtering=True,id=86a69795-c167-4353-b46e-0137384a0af5,network=Network(4180a6e3-2590-404c-a60c-3337b57fe61f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a69795-c1') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG os_vif [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e1:c7,bridge_name='br-int',has_traffic_filtering=True,id=86a69795-c167-4353-b46e-0137384a0af5,network=Network(4180a6e3-2590-404c-a60c-3337b57fe61f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a69795-c1') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86a69795-c1, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7375e734-1715-4a62-bf03-8fd2c89fe80e) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-ddf72609-b28d-4237-9d2b-de46d0010665 req-e14dd6da-cbd6-40ba-b02f-5665eb90dca0 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-plugged-704c171d-d5bc-4f60-af76-4b00f98191c6 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ddf72609-b28d-4237-9d2b-de46d0010665 req-e14dd6da-cbd6-40ba-b02f-5665eb90dca0 service nova] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ddf72609-b28d-4237-9d2b-de46d0010665 req-e14dd6da-cbd6-40ba-b02f-5665eb90dca0 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ddf72609-b28d-4237-9d2b-de46d0010665 req-e14dd6da-cbd6-40ba-b02f-5665eb90dca0 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-ddf72609-b28d-4237-9d2b-de46d0010665 req-e14dd6da-cbd6-40ba-b02f-5665eb90dca0 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] No waiting events found dispatching network-vif-plugged-704c171d-d5bc-4f60-af76-4b00f98191c6 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:06:34 user nova-compute[74898]: WARNING nova.compute.manager [req-ddf72609-b28d-4237-9d2b-de46d0010665 req-e14dd6da-cbd6-40ba-b02f-5665eb90dca0 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received unexpected event network-vif-plugged-704c171d-d5bc-4f60-af76-4b00f98191c6 for instance with vm_state active and task_state deleting.
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-ddf72609-b28d-4237-9d2b-de46d0010665 req-e14dd6da-cbd6-40ba-b02f-5665eb90dca0 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-unplugged-86a69795-c167-4353-b46e-0137384a0af5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ddf72609-b28d-4237-9d2b-de46d0010665 req-e14dd6da-cbd6-40ba-b02f-5665eb90dca0 service nova] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ddf72609-b28d-4237-9d2b-de46d0010665 req-e14dd6da-cbd6-40ba-b02f-5665eb90dca0 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ddf72609-b28d-4237-9d2b-de46d0010665 req-e14dd6da-cbd6-40ba-b02f-5665eb90dca0 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-ddf72609-b28d-4237-9d2b-de46d0010665 req-e14dd6da-cbd6-40ba-b02f-5665eb90dca0 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] No waiting events found dispatching network-vif-unplugged-86a69795-c167-4353-b46e-0137384a0af5 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-ddf72609-b28d-4237-9d2b-de46d0010665 req-e14dd6da-cbd6-40ba-b02f-5665eb90dca0 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-unplugged-86a69795-c167-4353-b46e-0137384a0af5 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-ddf72609-b28d-4237-9d2b-de46d0010665 req-e14dd6da-cbd6-40ba-b02f-5665eb90dca0 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-plugged-86a69795-c167-4353-b46e-0137384a0af5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ddf72609-b28d-4237-9d2b-de46d0010665 req-e14dd6da-cbd6-40ba-b02f-5665eb90dca0 service nova] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ddf72609-b28d-4237-9d2b-de46d0010665 req-e14dd6da-cbd6-40ba-b02f-5665eb90dca0 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ddf72609-b28d-4237-9d2b-de46d0010665 req-e14dd6da-cbd6-40ba-b02f-5665eb90dca0 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-ddf72609-b28d-4237-9d2b-de46d0010665 req-e14dd6da-cbd6-40ba-b02f-5665eb90dca0 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] No waiting events found dispatching network-vif-plugged-86a69795-c167-4353-b46e-0137384a0af5 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:06:34 user nova-compute[74898]: WARNING nova.compute.manager [req-ddf72609-b28d-4237-9d2b-de46d0010665 req-e14dd6da-cbd6-40ba-b02f-5665eb90dca0 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received unexpected event network-vif-plugged-86a69795-c167-4353-b46e-0137384a0af5 for instance with vm_state active and task_state deleting.
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: INFO os_vif [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e1:c7,bridge_name='br-int',has_traffic_filtering=True,id=86a69795-c167-4353-b46e-0137384a0af5,network=Network(4180a6e3-2590-404c-a60c-3337b57fe61f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a69795-c1')
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778206541',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1778206541',id=18,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyGmJYYbvr3QyeCIw1kBCEDSS3NCSiXW2VlUSJ3BJlyvfl1x3dvUE6dFKqzhvQizyxSx5x1rl4z0TjriBVD80sj4GqrlXMNMQraj8GWH5vb9kWh+w6HjvRfrn66x/EO9g==',key_name='tempest-keypair-530835063',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:05:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67b8bb76f54b4f5fa95f603550c269dd',ramdisk_id='',reservation_id='r-fz50cvhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1244088613',owner_user_name='tempest-TaggedBootDevicesTest_v242-1244088613-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:05:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bedf3f8df3e946b88a32ce4c78ee358c',uuid=b94a0a17-77e9-41cf-9919-37b57b364ff2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "189360e5-7bc0-4711-8069-8939c57a28d7", "address": "fa:16:3e:45:f0:2c", "network": {"id": "0e992b1f-b626-47b5-b861-9b1420f22a3d", "bridge": "br-int", "label": "tempest-device-tagging-net2-855379110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189360e5-7b", "ovs_interfaceid": "189360e5-7bc0-4711-8069-8939c57a28d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converting VIF {"id": "189360e5-7bc0-4711-8069-8939c57a28d7", "address": "fa:16:3e:45:f0:2c", "network": {"id": "0e992b1f-b626-47b5-b861-9b1420f22a3d", "bridge": "br-int", "label": "tempest-device-tagging-net2-855379110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189360e5-7b", "ovs_interfaceid": "189360e5-7bc0-4711-8069-8939c57a28d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:f0:2c,bridge_name='br-int',has_traffic_filtering=True,id=189360e5-7bc0-4711-8069-8939c57a28d7,network=Network(0e992b1f-b626-47b5-b861-9b1420f22a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189360e5-7b') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG os_vif [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:f0:2c,bridge_name='br-int',has_traffic_filtering=True,id=189360e5-7bc0-4711-8069-8939c57a28d7,network=Network(0e992b1f-b626-47b5-b861-9b1420f22a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189360e5-7b') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap189360e5-7b, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f8b9ded9-58a9-4ade-82da-a40059f89726) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: INFO os_vif [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:f0:2c,bridge_name='br-int',has_traffic_filtering=True,id=189360e5-7bc0-4711-8069-8939c57a28d7,network=Network(0e992b1f-b626-47b5-b861-9b1420f22a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189360e5-7b')
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T03:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778206541',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1778206541',id=18,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyGmJYYbvr3QyeCIw1kBCEDSS3NCSiXW2VlUSJ3BJlyvfl1x3dvUE6dFKqzhvQizyxSx5x1rl4z0TjriBVD80sj4GqrlXMNMQraj8GWH5vb9kWh+w6HjvRfrn66x/EO9g==',key_name='tempest-keypair-530835063',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:05:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67b8bb76f54b4f5fa95f603550c269dd',ramdisk_id='',reservation_id='r-fz50cvhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1244088613',owner_user_name='tempest-TaggedBootDevicesTest_v242-1244088613-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:05:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bedf3f8df3e946b88a32ce4c78ee358c',uuid=b94a0a17-77e9-41cf-9919-37b57b364ff2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0559955f-ea89-4f72-93dd-22b0df42e380", "address": "fa:16:3e:cb:58:f5", "network": {"id": "0e992b1f-b626-47b5-b861-9b1420f22a3d", "bridge": "br-int", "label": "tempest-device-tagging-net2-855379110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0559955f-ea", "ovs_interfaceid": "0559955f-ea89-4f72-93dd-22b0df42e380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converting VIF {"id": "0559955f-ea89-4f72-93dd-22b0df42e380", "address": "fa:16:3e:cb:58:f5", "network": {"id": "0e992b1f-b626-47b5-b861-9b1420f22a3d", "bridge": "br-int", "label": "tempest-device-tagging-net2-855379110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0559955f-ea", "ovs_interfaceid": "0559955f-ea89-4f72-93dd-22b0df42e380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:58:f5,bridge_name='br-int',has_traffic_filtering=True,id=0559955f-ea89-4f72-93dd-22b0df42e380,network=Network(0e992b1f-b626-47b5-b861-9b1420f22a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0559955f-ea') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG os_vif [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:58:f5,bridge_name='br-int',has_traffic_filtering=True,id=0559955f-ea89-4f72-93dd-22b0df42e380,network=Network(0e992b1f-b626-47b5-b861-9b1420f22a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0559955f-ea') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0559955f-ea, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec6cea36-d384-4f47-8fb5-0b5cb22d8d36) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:34 user nova-compute[74898]: INFO os_vif [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:58:f5,bridge_name='br-int',has_traffic_filtering=True,id=0559955f-ea89-4f72-93dd-22b0df42e380,network=Network(0e992b1f-b626-47b5-b861-9b1420f22a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0559955f-ea')
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SvfAsLhz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:06:34 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:06:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb367f1-299b-461d-8bf7-8ef923f935dc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:06:34 user nova-compute[74898]: No targets found.
Nov 17 03:06:34 user nova-compute[74898]: iSNS:
Nov 17 03:06:34 user nova-compute[74898]: No targets found.
Nov 17 03:06:34 user nova-compute[74898]: STATIC:
Nov 17 03:06:34 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981
Nov 17 03:06:34 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:34 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:34 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45
Nov 17 03:06:34 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:34 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:34 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248
Nov 17 03:06:34 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:34 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:34 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484
Nov 17 03:06:34 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:34 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:34 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146
Nov 17 03:06:34 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:34 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:34 user nova-compute[74898]: FIRMWARE:
Nov 17 03:06:34 user nova-compute[74898]: No targets found.
Nov 17 03:06:34 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:06:34 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:06:34 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[18acb3b5-0af1-4dec-bfbe-f0e50f25c5ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e86cfa6-fc92-4358-80de-a4dd08115fbd]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:06:34 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:06:34 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:06:34 user nova-compute[74898]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:06:34 user nova-compute[74898]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)
Nov 17 03:06:34 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 (non-flash)
Nov 17 03:06:34 user nova-compute[74898]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:06:34 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:06:34 user nova-compute[74898]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:06:34 user nova-compute[74898]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)
Nov 17 03:06:34 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9c187dcd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248'): ({'sdc'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Removing single pathed devices sdc {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-126ec644-2794-4d93-9afb-4a47aa71c000 req-b896d751-5eac-4f43-9549-0c4637ed70e1 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-plugged-178a5871-43af-4e36-9665-07cdd3ecf1d7 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-126ec644-2794-4d93-9afb-4a47aa71c000 req-b896d751-5eac-4f43-9549-0c4637ed70e1 service nova] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-126ec644-2794-4d93-9afb-4a47aa71c000 req-b896d751-5eac-4f43-9549-0c4637ed70e1 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-126ec644-2794-4d93-9afb-4a47aa71c000 req-b896d751-5eac-4f43-9549-0c4637ed70e1 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-126ec644-2794-4d93-9afb-4a47aa71c000 req-b896d751-5eac-4f43-9549-0c4637ed70e1 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] No waiting events found dispatching network-vif-plugged-178a5871-43af-4e36-9665-07cdd3ecf1d7 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:06:34 user nova-compute[74898]: WARNING nova.compute.manager [req-126ec644-2794-4d93-9afb-4a47aa71c000 req-b896d751-5eac-4f43-9549-0c4637ed70e1 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received unexpected event network-vif-plugged-178a5871-43af-4e36-9665-07cdd3ecf1d7 for instance with vm_state active and task_state deleting.
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-126ec644-2794-4d93-9afb-4a47aa71c000 req-b896d751-5eac-4f43-9549-0c4637ed70e1 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-unplugged-189360e5-7bc0-4711-8069-8939c57a28d7 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-126ec644-2794-4d93-9afb-4a47aa71c000 req-b896d751-5eac-4f43-9549-0c4637ed70e1 service nova] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-126ec644-2794-4d93-9afb-4a47aa71c000 req-b896d751-5eac-4f43-9549-0c4637ed70e1 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-126ec644-2794-4d93-9afb-4a47aa71c000 req-b896d751-5eac-4f43-9549-0c4637ed70e1 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-126ec644-2794-4d93-9afb-4a47aa71c000 req-b896d751-5eac-4f43-9549-0c4637ed70e1 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] No waiting events found dispatching network-vif-unplugged-189360e5-7bc0-4711-8069-8939c57a28d7 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-126ec644-2794-4d93-9afb-4a47aa71c000 req-b896d751-5eac-4f43-9549-0c4637ed70e1 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-unplugged-189360e5-7bc0-4711-8069-8939c57a28d7 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-126ec644-2794-4d93-9afb-4a47aa71c000 req-b896d751-5eac-4f43-9549-0c4637ed70e1 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-plugged-189360e5-7bc0-4711-8069-8939c57a28d7 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-126ec644-2794-4d93-9afb-4a47aa71c000 req-b896d751-5eac-4f43-9549-0c4637ed70e1 service nova] Acquiring lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-126ec644-2794-4d93-9afb-4a47aa71c000 req-b896d751-5eac-4f43-9549-0c4637ed70e1 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-126ec644-2794-4d93-9afb-4a47aa71c000 req-b896d751-5eac-4f43-9549-0c4637ed70e1 service nova] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-126ec644-2794-4d93-9afb-4a47aa71c000 req-b896d751-5eac-4f43-9549-0c4637ed70e1 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] No waiting events found dispatching network-vif-plugged-189360e5-7bc0-4711-8069-8939c57a28d7 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:06:34 user nova-compute[74898]: WARNING nova.compute.manager [req-126ec644-2794-4d93-9afb-4a47aa71c000 req-b896d751-5eac-4f43-9549-0c4637ed70e1 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received unexpected event network-vif-plugged-189360e5-7bc0-4711-8069-8939c57a28d7 for instance with vm_state active and task_state deleting.
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa40c4a-b3c7-4af7-9e50-f34ef22328cb]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f58b3f-88de-4097-bebe-59a147fb4022]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Flushing IO for device /dev/sdc {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2af131-f463-4e10-b8b9-e7680d7191be]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:06:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[17228611-029f-44ee-ad7a-b505735372f6]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] SCSI volumes sdc have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[831e7ccb-b9f1-489e-acf3-706a62f1274a]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[add88533-b7c2-41f0-8b0e-4c4e5fbfa0de]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248, portal: 172.16.0.220,3260]
Nov 17 03:06:35 user nova-compute[74898]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248, portal: 172.16.0.220,3260] successful.
Nov 17 03:06:35 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59c7c3e8-f2e8-471c-8a4a-75bcd771c248 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f01bc9-e4c5-46bd-9946-6b9b2e13a5cc]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] <== disconnect_volume: return (303ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZkFQSWyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:06:35 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e29bae-bce8-44fb-9895-b6def107aa48]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:06:35 user nova-compute[74898]: No targets found.
Nov 17 03:06:35 user nova-compute[74898]: iSNS:
Nov 17 03:06:35 user nova-compute[74898]: No targets found.
Nov 17 03:06:35 user nova-compute[74898]: STATIC:
Nov 17 03:06:35 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981
Nov 17 03:06:35 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:35 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:35 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45
Nov 17 03:06:35 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:35 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:35 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484
Nov 17 03:06:35 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:35 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:35 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146
Nov 17 03:06:35 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:35 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:35 user nova-compute[74898]: FIRMWARE:
Nov 17 03:06:35 user nova-compute[74898]: No targets found.
Nov 17 03:06:35 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:06:35 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:06:35 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a3df9c-a554-4367-86d5-cb0f5f72f138]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[610c8f1f-16c9-4fd2-8d1d-6aa2ca896419]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:06:35 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:06:35 user nova-compute[74898]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:06:35 user nova-compute[74898]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)
Nov 17 03:06:35 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 (non-flash)
Nov 17 03:06:35 user nova-compute[74898]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:06:35 user nova-compute[74898]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:06:35 user nova-compute[74898]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)
Nov 17 03:06:35 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf869dbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484'): ({'sdg'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Removing single pathed devices sdg {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a6117e-89d5-46cc-97c7-efad904c38cc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebd043c-60e6-4441-98c2-de6111a11640]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Flushing IO for device /dev/sdg {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd43fe4-15b5-4326-a455-037d7d8cada7]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[38396706-38aa-4fcd-8ff1-46e1f334b11c]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] SCSI volumes sdg have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1f4fb0-393d-49d9-817b-58ab1c4c371a]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ac863c-3eef-46aa-a58c-a7f1ac519a25]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484, portal: 172.16.0.220,3260]
Nov 17 03:06:35 user nova-compute[74898]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484, portal: 172.16.0.220,3260] successful.
Nov 17 03:06:35 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f795638-f9a2-4bfc-afb7-416e6274b484 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f670730-165a-4f1d-8cb1-31ac665d95d6]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] <== disconnect_volume: return (292ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBZpwrLx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:06:35 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[451b1e0e-6bfc-4fc7-b361-c5fab1cd4b0f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:06:35 user nova-compute[74898]: No targets found.
Nov 17 03:06:35 user nova-compute[74898]: iSNS:
Nov 17 03:06:35 user nova-compute[74898]: No targets found.
Nov 17 03:06:35 user nova-compute[74898]: STATIC:
Nov 17 03:06:35 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981
Nov 17 03:06:35 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:35 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:35 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45
Nov 17 03:06:35 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:35 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:35 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146
Nov 17 03:06:35 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:35 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:35 user nova-compute[74898]: FIRMWARE:
Nov 17 03:06:35 user nova-compute[74898]: No targets found.
Nov 17 03:06:35 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:06:35 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:06:35 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0b79b5-0fde-441c-9669-9ee0ddd9713e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[94dbcb3a-6535-428a-99b5-17743f85ffd8]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:06:35 user nova-compute[74898]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:06:35 user nova-compute[74898]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)
Nov 17 03:06:35 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 (non-flash)
Nov 17 03:06:35 user nova-compute[74898]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:06:35 user nova-compute[74898]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)
Nov 17 03:06:35 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf869dbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981'): ({'sdh'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Removing single pathed devices sdh {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cc033d-91b2-40ca-8df2-3aafca1321e4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bdf16d-808c-4d0a-bced-e49c857e5917]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Flushing IO for device /dev/sdh {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedcd19a-faf3-4e17-9bbf-afc1bb2baca6]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.041s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d63d8a-cf41-43c1-bbf7-19bd5dbb2cbe]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] SCSI volumes sdh have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd6afad-ef96-4674-b9c9-cc6681ec05e4]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96edf76-e073-44b3-8411-7e6f6c571146]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981, portal: 172.16.0.220,3260]
Nov 17 03:06:35 user nova-compute[74898]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981, portal: 172.16.0.220,3260] successful.
Nov 17 03:06:35 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d87f49d-4f84-4e40-a806-f8c534350981 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[283f9cf0-058b-448c-9d29-d08e8acceaf0]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] <== disconnect_volume: return (312ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:06:35 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Deleting instance files /opt/stack/data/nova/instances/b94a0a17-77e9-41cf-9919-37b57b364ff2_del
Nov 17 03:06:35 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Deletion of /opt/stack/data/nova/instances/b94a0a17-77e9-41cf-9919-37b57b364ff2_del complete
Nov 17 03:06:35 user nova-compute[74898]: INFO nova.compute.manager [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Took 3.60 seconds to destroy the instance on the hypervisor.
Nov 17 03:06:35 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:06:35 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:06:36 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 474a469d-9ebe-4e91-9ec4-3f610bdd4d27 is timed out.
Nov 17 03:06:36 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Successfully detached device vdb from instance 474a469d-9ebe-4e91-9ec4-3f610bdd4d27 from the live domain config.
Nov 17 03:06:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'frPOnDuL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': 'a3c6e9a5-ff67-437f-8a8a-90dcfee9a146'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:06:36 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:06:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4788e5b-1c0b-4024-add4-8d11298b5c8a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:06:36 user nova-compute[74898]: No targets found.
Nov 17 03:06:36 user nova-compute[74898]: iSNS:
Nov 17 03:06:36 user nova-compute[74898]: No targets found.
Nov 17 03:06:36 user nova-compute[74898]: STATIC:
Nov 17 03:06:36 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45
Nov 17 03:06:36 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:36 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:36 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146
Nov 17 03:06:36 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:06:36 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:06:36 user nova-compute[74898]: FIRMWARE:
Nov 17 03:06:36 user nova-compute[74898]: No targets found.
Nov 17 03:06:36 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:06:36 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:06:36 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[547b2e0b-5194-4afc-8c4b-d159883b63cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2c39d9-9102-455d-817d-9997167c0ade]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:06:36 user nova-compute[74898]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)
Nov 17 03:06:36 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:06:36 user nova-compute[74898]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 (non-flash)
Nov 17 03:06:36 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9c289e80d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146'): ({'sde'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Removing single pathed devices sde {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90d86f8-a039-4f8d-b325-1d9a47e4c8ec]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[91892575-3e95-4c9e-bbd0-b224bbdeff02]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Flushing IO for device /dev/sde {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1daaa255-eba8-404e-9bcd-46ea76439d31]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a10fef-3c8d-48a9-9592-dfd59888ec55]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] SCSI volumes sde have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d224fe8-80c7-4775-9488-ae5f65295aaa]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e278aea-dde2-4eaf-896a-c551b0cd6063]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146, portal: 172.16.0.220,3260]
Nov 17 03:06:36 user nova-compute[74898]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146, portal: 172.16.0.220,3260] successful.
Nov 17 03:06:36 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3c6e9a5-ff67-437f-8a8a-90dcfee9a146 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[160197aa-1054-4766-93e7-090b32ff92e6]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] <== disconnect_volume: return (330ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f87da039-3322-4896-9fdc-39322733b545 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Acquiring lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f87da039-3322-4896-9fdc-39322733b545 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f87da039-3322-4896-9fdc-39322733b545 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Acquiring lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f87da039-3322-4896-9fdc-39322733b545 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f87da039-3322-4896-9fdc-39322733b545 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:36 user nova-compute[74898]: INFO nova.compute.manager [None req-f87da039-3322-4896-9fdc-39322733b545 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Terminating instance
Nov 17 03:06:36 user nova-compute[74898]: DEBUG nova.compute.manager [None req-f87da039-3322-4896-9fdc-39322733b545 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:37 user nova-compute[74898]: DEBUG nova.compute.manager [req-7c4d4e1a-a15b-49af-922a-b762a0df604d req-32a71296-05e9-4ef7-a3f7-ea790f4a0b8f service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Received event network-vif-unplugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7c4d4e1a-a15b-49af-922a-b762a0df604d req-32a71296-05e9-4ef7-a3f7-ea790f4a0b8f service nova] Acquiring lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7c4d4e1a-a15b-49af-922a-b762a0df604d req-32a71296-05e9-4ef7-a3f7-ea790f4a0b8f service nova] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7c4d4e1a-a15b-49af-922a-b762a0df604d req-32a71296-05e9-4ef7-a3f7-ea790f4a0b8f service nova] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:37 user nova-compute[74898]: DEBUG nova.compute.manager [req-7c4d4e1a-a15b-49af-922a-b762a0df604d req-32a71296-05e9-4ef7-a3f7-ea790f4a0b8f service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] No waiting events found dispatching network-vif-unplugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:06:37 user nova-compute[74898]: DEBUG nova.compute.manager [req-7c4d4e1a-a15b-49af-922a-b762a0df604d req-32a71296-05e9-4ef7-a3f7-ea790f4a0b8f service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Received event network-vif-unplugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:06:37 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Instance destroyed successfully.
Nov 17 03:06:37 user nova-compute[74898]: DEBUG nova.objects.instance [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lazy-loading 'flavor' on Instance uuid 474a469d-9ebe-4e91-9ec4-3f610bdd4d27 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:06:37 user nova-compute[74898]: DEBUG nova.objects.instance [None req-f87da039-3322-4896-9fdc-39322733b545 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lazy-loading 'resources' on Instance uuid 015ff42a-4d69-4f60-b86c-c6bd68d23c99 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:06:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-f87da039-3322-4896-9fdc-39322733b545 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:59:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-79461071',display_name='tempest-ServerStableDeviceRescueTest-server-79461071',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-79461071',id=5,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3ScoMcY64cOmhLR5MRqP3FGji32oeJktiJUi4U3NwH7+yAWoEgDSQgmx/yQzS0wVqsxpjUYQDyGQwbr5p0i4LUVJlGd/b4gDnj3xIHz2RcTwm9n6DLaujAEe7PSgJ6+A==',key_name='tempest-keypair-1704675523',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:03:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74014d7708574848bee4da7056ab1f09',ramdisk_id='',reservation_id='r-75bj56av',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1390708223',owner_user_name='tempest-ServerStableDeviceRescueTest-1390708223-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14311a1fee1548f8a3dc603cebaf42dd',uuid=015ff42a-4d69-4f60-b86c-c6bd68d23c99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "address": "fa:16:3e:88:21:6c", "network": {"id": "bf964a06-b5fd-41c4-9dfe-5d485019bbdd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-848964430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74014d7708574848bee4da7056ab1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d80c52a-1f", "ovs_interfaceid": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:06:37 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-f87da039-3322-4896-9fdc-39322733b545 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Converting VIF {"id": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "address": "fa:16:3e:88:21:6c", "network": {"id": "bf964a06-b5fd-41c4-9dfe-5d485019bbdd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-848964430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74014d7708574848bee4da7056ab1f09", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d80c52a-1f", "ovs_interfaceid": "9d80c52a-1fc2-43ca-bed1-126c6b8e204f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:06:37 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-f87da039-3322-4896-9fdc-39322733b545 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:21:6c,bridge_name='br-int',has_traffic_filtering=True,id=9d80c52a-1fc2-43ca-bed1-126c6b8e204f,network=Network(bf964a06-b5fd-41c4-9dfe-5d485019bbdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d80c52a-1f') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:06:37 user nova-compute[74898]: DEBUG os_vif [None req-f87da039-3322-4896-9fdc-39322733b545 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:21:6c,bridge_name='br-int',has_traffic_filtering=True,id=9d80c52a-1fc2-43ca-bed1-126c6b8e204f,network=Network(bf964a06-b5fd-41c4-9dfe-5d485019bbdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d80c52a-1f') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:06:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d80c52a-1f, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:06:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:06:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=274ebe1e-8404-4236-9aff-cba67a7ae748) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:06:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:06:37 user nova-compute[74898]: INFO os_vif [None req-f87da039-3322-4896-9fdc-39322733b545 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:21:6c,bridge_name='br-int',has_traffic_filtering=True,id=9d80c52a-1fc2-43ca-bed1-126c6b8e204f,network=Network(bf964a06-b5fd-41c4-9dfe-5d485019bbdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d80c52a-1f')
Nov 17 03:06:37 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-f87da039-3322-4896-9fdc-39322733b545 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Deleting instance files /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99_del
Nov 17 03:06:37 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-f87da039-3322-4896-9fdc-39322733b545 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Deletion of /opt/stack/data/nova/instances/015ff42a-4d69-4f60-b86c-c6bd68d23c99_del complete
Nov 17 03:06:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-9bc80cb2-02ce-4fa7-a8ff-6dab3fc19ce0 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.032s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:37 user nova-compute[74898]: INFO nova.compute.manager [None req-f87da039-3322-4896-9fdc-39322733b545 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 17 03:06:37 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-f87da039-3322-4896-9fdc-39322733b545 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:06:37 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:06:37 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:06:38 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:06:38 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Took 0.78 seconds to deallocate network for instance.
Nov 17 03:06:38 user nova-compute[74898]: DEBUG nova.compute.manager [req-0fef302a-7f92-4cf7-b952-cd1cff0fc9d3 req-56738c8e-7b79-44de-8170-c8f54ed172e4 service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Received event network-vif-deleted-9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:38 user nova-compute[74898]: INFO nova.compute.manager [req-0fef302a-7f92-4cf7-b952-cd1cff0fc9d3 req-56738c8e-7b79-44de-8170-c8f54ed172e4 service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Neutron deleted interface 9d80c52a-1fc2-43ca-bed1-126c6b8e204f; detaching it from the instance and deleting it from the info cache
Nov 17 03:06:38 user nova-compute[74898]: DEBUG nova.network.neutron [req-0fef302a-7f92-4cf7-b952-cd1cff0fc9d3 req-56738c8e-7b79-44de-8170-c8f54ed172e4 service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:06:38 user nova-compute[74898]: DEBUG nova.compute.manager [req-0fef302a-7f92-4cf7-b952-cd1cff0fc9d3 req-56738c8e-7b79-44de-8170-c8f54ed172e4 service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Detach interface failed, port_id=9d80c52a-1fc2-43ca-bed1-126c6b8e204f, reason: Instance 015ff42a-4d69-4f60-b86c-c6bd68d23c99 could not be found. {{(pid=74898) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 03:06:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f87da039-3322-4896-9fdc-39322733b545 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f87da039-3322-4896-9fdc-39322733b545 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:38 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-f87da039-3322-4896-9fdc-39322733b545 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:06:38 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-f87da039-3322-4896-9fdc-39322733b545 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:06:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f87da039-3322-4896-9fdc-39322733b545 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.253s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:38 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-f87da039-3322-4896-9fdc-39322733b545 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Deleted allocations for instance 015ff42a-4d69-4f60-b86c-c6bd68d23c99
Nov 17 03:06:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f87da039-3322-4896-9fdc-39322733b545 tempest-ServerStableDeviceRescueTest-1390708223 tempest-ServerStableDeviceRescueTest-1390708223-project-member] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.170s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-06195519-15b3-4ef7-96a8-ad49de7df350 req-53929a13-8662-4872-844d-21a986d9c7b1 service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Received event network-vif-plugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-06195519-15b3-4ef7-96a8-ad49de7df350 req-53929a13-8662-4872-844d-21a986d9c7b1 service nova] Acquiring lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-06195519-15b3-4ef7-96a8-ad49de7df350 req-53929a13-8662-4872-844d-21a986d9c7b1 service nova] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-06195519-15b3-4ef7-96a8-ad49de7df350 req-53929a13-8662-4872-844d-21a986d9c7b1 service nova] Lock "015ff42a-4d69-4f60-b86c-c6bd68d23c99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-06195519-15b3-4ef7-96a8-ad49de7df350 req-53929a13-8662-4872-844d-21a986d9c7b1 service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] No waiting events found dispatching network-vif-plugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:06:39 user nova-compute[74898]: WARNING nova.compute.manager [req-06195519-15b3-4ef7-96a8-ad49de7df350 req-53929a13-8662-4872-844d-21a986d9c7b1 service nova] [instance: 015ff42a-4d69-4f60-b86c-c6bd68d23c99] Received unexpected event network-vif-plugged-9d80c52a-1fc2-43ca-bed1-126c6b8e204f for instance with vm_state deleted and task_state None.
Nov 17 03:06:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-06195519-15b3-4ef7-96a8-ad49de7df350 req-53929a13-8662-4872-844d-21a986d9c7b1 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-deleted-857da07e-b7c7-4bb9-805a-8c9a7d30d6bf {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:39 user nova-compute[74898]: INFO nova.compute.manager [req-06195519-15b3-4ef7-96a8-ad49de7df350 req-53929a13-8662-4872-844d-21a986d9c7b1 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Neutron deleted interface 857da07e-b7c7-4bb9-805a-8c9a7d30d6bf; detaching it from the instance and deleting it from the info cache
Nov 17 03:06:39 user nova-compute[74898]: DEBUG nova.network.neutron [req-06195519-15b3-4ef7-96a8-ad49de7df350 req-53929a13-8662-4872-844d-21a986d9c7b1 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Updating instance_info_cache with network_info: [{"id": "58ede42b-dcc4-45f2-8be6-f1fba65e9f4c", "address": "fa:16:3e:26:35:f5", "network": {"id": "2e9858af-0eb1-4e7c-bd29-7238d7eb070e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1878259197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ede42b-dc", "ovs_interfaceid": "58ede42b-dcc4-45f2-8be6-f1fba65e9f4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "704c171d-d5bc-4f60-af76-4b00f98191c6", "address": "fa:16:3e:d8:69:fc", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704c171d-d5", "ovs_interfaceid": "704c171d-d5bc-4f60-af76-4b00f98191c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "178a5871-43af-4e36-9665-07cdd3ecf1d7", "address": "fa:16:3e:f6:ff:91", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178a5871-43", "ovs_interfaceid": "178a5871-43af-4e36-9665-07cdd3ecf1d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "86a69795-c167-4353-b46e-0137384a0af5", "address": "fa:16:3e:8b:e1:c7", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a69795-c1", "ovs_interfaceid": "86a69795-c167-4353-b46e-0137384a0af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "189360e5-7bc0-4711-8069-8939c57a28d7", "address": "fa:16:3e:45:f0:2c", "network": {"id": "0e992b1f-b626-47b5-b861-9b1420f22a3d", "bridge": "br-int", "label": "tempest-device-tagging-net2-855379110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189360e5-7b", "ovs_interfaceid": "189360e5-7bc0-4711-8069-8939c57a28d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0559955f-ea89-4f72-93dd-22b0df42e380", "address": "fa:16:3e:cb:58:f5", "network": {"id": "0e992b1f-b626-47b5-b861-9b1420f22a3d", "bridge": "br-int", "label": "tempest-device-tagging-net2-855379110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0559955f-ea", "ovs_interfaceid": "0559955f-ea89-4f72-93dd-22b0df42e380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:06:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-06195519-15b3-4ef7-96a8-ad49de7df350 req-53929a13-8662-4872-844d-21a986d9c7b1 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Detach interface failed, port_id=857da07e-b7c7-4bb9-805a-8c9a7d30d6bf, reason: Instance b94a0a17-77e9-41cf-9919-37b57b364ff2 could not be found. {{(pid=74898) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 03:06:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-06195519-15b3-4ef7-96a8-ad49de7df350 req-53929a13-8662-4872-844d-21a986d9c7b1 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-deleted-86a69795-c167-4353-b46e-0137384a0af5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:39 user nova-compute[74898]: INFO nova.compute.manager [req-06195519-15b3-4ef7-96a8-ad49de7df350 req-53929a13-8662-4872-844d-21a986d9c7b1 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Neutron deleted interface 86a69795-c167-4353-b46e-0137384a0af5; detaching it from the instance and deleting it from the info cache
Nov 17 03:06:39 user nova-compute[74898]: DEBUG nova.network.neutron [req-06195519-15b3-4ef7-96a8-ad49de7df350 req-53929a13-8662-4872-844d-21a986d9c7b1 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Updating instance_info_cache with network_info: [{"id": "58ede42b-dcc4-45f2-8be6-f1fba65e9f4c", "address": "fa:16:3e:26:35:f5", "network": {"id": "2e9858af-0eb1-4e7c-bd29-7238d7eb070e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1878259197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58ede42b-dc", "ovs_interfaceid": "58ede42b-dcc4-45f2-8be6-f1fba65e9f4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "704c171d-d5bc-4f60-af76-4b00f98191c6", "address": "fa:16:3e:d8:69:fc", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704c171d-d5", "ovs_interfaceid": "704c171d-d5bc-4f60-af76-4b00f98191c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "178a5871-43af-4e36-9665-07cdd3ecf1d7", "address": "fa:16:3e:f6:ff:91", "network": {"id": "4180a6e3-2590-404c-a60c-3337b57fe61f", "bridge": "br-int", "label": "tempest-device-tagging-net1-2004083357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178a5871-43", "ovs_interfaceid": "178a5871-43af-4e36-9665-07cdd3ecf1d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "189360e5-7bc0-4711-8069-8939c57a28d7", "address": "fa:16:3e:45:f0:2c", "network": {"id": "0e992b1f-b626-47b5-b861-9b1420f22a3d", "bridge": "br-int", "label": "tempest-device-tagging-net2-855379110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189360e5-7b", "ovs_interfaceid": "189360e5-7bc0-4711-8069-8939c57a28d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0559955f-ea89-4f72-93dd-22b0df42e380", "address": "fa:16:3e:cb:58:f5", "network": {"id": "0e992b1f-b626-47b5-b861-9b1420f22a3d", "bridge": "br-int", "label": "tempest-device-tagging-net2-855379110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "67b8bb76f54b4f5fa95f603550c269dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0559955f-ea", "ovs_interfaceid": "0559955f-ea89-4f72-93dd-22b0df42e380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:06:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-06195519-15b3-4ef7-96a8-ad49de7df350 req-53929a13-8662-4872-844d-21a986d9c7b1 service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Detach interface failed, port_id=86a69795-c167-4353-b46e-0137384a0af5, reason: Instance b94a0a17-77e9-41cf-9919-37b57b364ff2 could not be found. {{(pid=74898) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 03:06:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:40 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:06:40 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Took 5.03 seconds to deallocate network for instance.
Nov 17 03:06:41 user nova-compute[74898]: DEBUG nova.compute.manager [req-d999152a-d918-4eaf-a8df-72e44ef3e580 req-089af019-d586-4769-bdcc-c95d75374ffd service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-deleted-189360e5-7bc0-4711-8069-8939c57a28d7 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:41 user nova-compute[74898]: DEBUG nova.compute.manager [req-d999152a-d918-4eaf-a8df-72e44ef3e580 req-089af019-d586-4769-bdcc-c95d75374ffd service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-deleted-58ede42b-dcc4-45f2-8be6-f1fba65e9f4c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:41 user nova-compute[74898]: DEBUG nova.compute.manager [req-d999152a-d918-4eaf-a8df-72e44ef3e580 req-089af019-d586-4769-bdcc-c95d75374ffd service nova] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Received event network-vif-deleted-0559955f-ea89-4f72-93dd-22b0df42e380 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:43 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:06:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:43 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:06:43 user nova-compute[74898]: INFO nova.compute.claims [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Claim successful on node user
Nov 17 03:06:43 user nova-compute[74898]: INFO nova.compute.manager [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] [instance: b94a0a17-77e9-41cf-9919-37b57b364ff2] Took 2.45 seconds to detach 3 volumes for instance.
Nov 17 03:06:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:43 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:06:43 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:06:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:43 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:06:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.107s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:43 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:06:43 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:06:43 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:06:43 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:06:43 user nova-compute[74898]: DEBUG nova.policy [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '28445b2b2360414bac2607ec94166369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff82629b7d7486a86574994974fabda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:06:43 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:06:43 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:06:43 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:06:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:06:43 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Creating image(s)
Nov 17 03:06:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "/opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "/opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "/opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:43 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Deleted allocations for instance b94a0a17-77e9-41cf-9919-37b57b364ff2
Nov 17 03:06:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.175s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1968e480-5c31-4a52-8733-42cdd77a2719 tempest-TaggedBootDevicesTest_v242-1244088613 tempest-TaggedBootDevicesTest_v242-1244088613-project-member] Lock "b94a0a17-77e9-41cf-9919-37b57b364ff2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.828s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.198s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk 1073741824" returned: 0 in 0.072s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.175s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:44 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:06:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:44 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Successfully created port: f819d75d-a65d-4342-9912-944d2fb13dd3 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:06:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:44 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Cannot resize image /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:06:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:06:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Ensure instance console log exists: /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:06:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Successfully updated port: f819d75d-a65d-4342-9912-944d2fb13dd3 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "refresh_cache-f25ef6a9-d007-419d-8478-2a9e79d5f03a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquired lock "refresh_cache-f25ef6a9-d007-419d-8478-2a9e79d5f03a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.compute.manager [req-6eed6c9c-da3e-489c-8b88-f0c5ef0617e2 req-af75f641-914a-45b9-aa84-7b54eef65ae7 service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Received event network-changed-f819d75d-a65d-4342-9912-944d2fb13dd3 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.compute.manager [req-6eed6c9c-da3e-489c-8b88-f0c5ef0617e2 req-af75f641-914a-45b9-aa84-7b54eef65ae7 service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Refreshing instance network info cache due to event network-changed-f819d75d-a65d-4342-9912-944d2fb13dd3. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-6eed6c9c-da3e-489c-8b88-f0c5ef0617e2 req-af75f641-914a-45b9-aa84-7b54eef65ae7 service nova] Acquiring lock "refresh_cache-f25ef6a9-d007-419d-8478-2a9e79d5f03a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Updating instance_info_cache with network_info: [{"id": "f819d75d-a65d-4342-9912-944d2fb13dd3", "address": "fa:16:3e:89:06:c8", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf819d75d-a6", "ovs_interfaceid": "f819d75d-a65d-4342-9912-944d2fb13dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Releasing lock "refresh_cache-f25ef6a9-d007-419d-8478-2a9e79d5f03a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Instance network_info: |[{"id": "f819d75d-a65d-4342-9912-944d2fb13dd3", "address": "fa:16:3e:89:06:c8", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf819d75d-a6", "ovs_interfaceid": "f819d75d-a65d-4342-9912-944d2fb13dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-6eed6c9c-da3e-489c-8b88-f0c5ef0617e2 req-af75f641-914a-45b9-aa84-7b54eef65ae7 service nova] Acquired lock "refresh_cache-f25ef6a9-d007-419d-8478-2a9e79d5f03a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.network.neutron [req-6eed6c9c-da3e-489c-8b88-f0c5ef0617e2 req-af75f641-914a-45b9-aa84-7b54eef65ae7 service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Refreshing network info cache for port f819d75d-a65d-4342-9912-944d2fb13dd3 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Start _get_guest_xml network_info=[{"id": "f819d75d-a65d-4342-9912-944d2fb13dd3", "address": "fa:16:3e:89:06:c8", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf819d75d-a6", "ovs_interfaceid": "f819d75d-a65d-4342-9912-944d2fb13dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:06:45 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:06:45 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:06:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-300218009',display_name='tempest-tempest.common.compute-instance-300218009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-300218009',id=19,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHj48AyfPGEuTYyaaXRPfUux/t0c9DvnKU2/5+czxQ0LiT4+FXnkFmRFT1qWvFotFB4OLCF7MZEn857VDvvqJISIgLBUP+o+9WiZvKEG2wWiBy731G5vP6ol8yd3WhW9MQ==',key_name='tempest-keypair-278072850',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ff82629b7d7486a86574994974fabda',ramdisk_id='',reservation_id='r-orvyz1o1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-214359699',owner_user_name='tempest-ServerActionsTestOtherA-214359699-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:06:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28445b2b2360414bac2607ec94166369',uuid=f25ef6a9-d007-419d-8478-2a9e79d5f03a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f819d75d-a65d-4342-9912-944d2fb13dd3", "address": "fa:16:3e:89:06:c8", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf819d75d-a6", "ovs_interfaceid": "f819d75d-a65d-4342-9912-944d2fb13dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Converting VIF {"id": "f819d75d-a65d-4342-9912-944d2fb13dd3", "address": "fa:16:3e:89:06:c8", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf819d75d-a6", "ovs_interfaceid": "f819d75d-a65d-4342-9912-944d2fb13dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:06:c8,bridge_name='br-int',has_traffic_filtering=True,id=f819d75d-a65d-4342-9912-944d2fb13dd3,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf819d75d-a6') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.objects.instance [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lazy-loading 'pci_devices' on Instance uuid f25ef6a9-d007-419d-8478-2a9e79d5f03a {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:06:45 user nova-compute[74898]:   <uuid>f25ef6a9-d007-419d-8478-2a9e79d5f03a</uuid>
Nov 17 03:06:45 user nova-compute[74898]:   <name>instance-00000013</name>
Nov 17 03:06:45 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:06:45 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:06:45 user nova-compute[74898]:   <metadata>
Nov 17 03:06:45 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:06:45 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:06:45 user nova-compute[74898]:       <nova:name>tempest-tempest.common.compute-instance-300218009</nova:name>
Nov 17 03:06:45 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:06:45</nova:creationTime>
Nov 17 03:06:45 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:06:45 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:06:45 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:06:45 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:06:45 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:06:45 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:06:45 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:06:45 user nova-compute[74898]:       <nova:owner>
Nov 17 03:06:45 user nova-compute[74898]:         <nova:user uuid="28445b2b2360414bac2607ec94166369">tempest-ServerActionsTestOtherA-214359699-project-member</nova:user>
Nov 17 03:06:45 user nova-compute[74898]:         <nova:project uuid="4ff82629b7d7486a86574994974fabda">tempest-ServerActionsTestOtherA-214359699</nova:project>
Nov 17 03:06:45 user nova-compute[74898]:       </nova:owner>
Nov 17 03:06:45 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:06:45 user nova-compute[74898]:       <nova:ports>
Nov 17 03:06:45 user nova-compute[74898]:         <nova:port uuid="f819d75d-a65d-4342-9912-944d2fb13dd3">
Nov 17 03:06:45 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 17 03:06:45 user nova-compute[74898]:         </nova:port>
Nov 17 03:06:45 user nova-compute[74898]:       </nova:ports>
Nov 17 03:06:45 user nova-compute[74898]:     </nova:instance>
Nov 17 03:06:45 user nova-compute[74898]:   </metadata>
Nov 17 03:06:45 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:06:45 user nova-compute[74898]:     <system>
Nov 17 03:06:45 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:06:45 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:06:45 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:06:45 user nova-compute[74898]:       <entry name="serial">f25ef6a9-d007-419d-8478-2a9e79d5f03a</entry>
Nov 17 03:06:45 user nova-compute[74898]:       <entry name="uuid">f25ef6a9-d007-419d-8478-2a9e79d5f03a</entry>
Nov 17 03:06:45 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:06:45 user nova-compute[74898]:     </system>
Nov 17 03:06:45 user nova-compute[74898]:   </sysinfo>
Nov 17 03:06:45 user nova-compute[74898]:   <os>
Nov 17 03:06:45 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:06:45 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:06:45 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:06:45 user nova-compute[74898]:   </os>
Nov 17 03:06:45 user nova-compute[74898]:   <features>
Nov 17 03:06:45 user nova-compute[74898]:     <acpi/>
Nov 17 03:06:45 user nova-compute[74898]:     <apic/>
Nov 17 03:06:45 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:06:45 user nova-compute[74898]:   </features>
Nov 17 03:06:45 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:06:45 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:06:45 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:06:45 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:06:45 user nova-compute[74898]:   </clock>
Nov 17 03:06:45 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:06:45 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:06:45 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:06:45 user nova-compute[74898]:   </cpu>
Nov 17 03:06:45 user nova-compute[74898]:   <devices>
Nov 17 03:06:45 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:06:45 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:06:45 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk"/>
Nov 17 03:06:45 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:06:45 user nova-compute[74898]:     </disk>
Nov 17 03:06:45 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:06:45 user nova-compute[74898]:       <mac address="fa:16:3e:89:06:c8"/>
Nov 17 03:06:45 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:06:45 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:06:45 user nova-compute[74898]:       <target dev="tapf819d75d-a6"/>
Nov 17 03:06:45 user nova-compute[74898]:     </interface>
Nov 17 03:06:45 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:06:45 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/console.log" append="off"/>
Nov 17 03:06:45 user nova-compute[74898]:     </serial>
Nov 17 03:06:45 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:06:45 user nova-compute[74898]:     <video>
Nov 17 03:06:45 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:06:45 user nova-compute[74898]:     </video>
Nov 17 03:06:45 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:06:45 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:06:45 user nova-compute[74898]:     </rng>
Nov 17 03:06:45 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:06:45 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:06:45 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:06:45 user nova-compute[74898]:     </memballoon>
Nov 17 03:06:45 user nova-compute[74898]:   </devices>
Nov 17 03:06:45 user nova-compute[74898]: </domain>
Nov 17 03:06:45 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:06:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-300218009',display_name='tempest-tempest.common.compute-instance-300218009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-300218009',id=19,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHj48AyfPGEuTYyaaXRPfUux/t0c9DvnKU2/5+czxQ0LiT4+FXnkFmRFT1qWvFotFB4OLCF7MZEn857VDvvqJISIgLBUP+o+9WiZvKEG2wWiBy731G5vP6ol8yd3WhW9MQ==',key_name='tempest-keypair-278072850',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ff82629b7d7486a86574994974fabda',ramdisk_id='',reservation_id='r-orvyz1o1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-214359699',owner_user_name='tempest-ServerActionsTestOtherA-214359699-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:06:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28445b2b2360414bac2607ec94166369',uuid=f25ef6a9-d007-419d-8478-2a9e79d5f03a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f819d75d-a65d-4342-9912-944d2fb13dd3", "address": "fa:16:3e:89:06:c8", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf819d75d-a6", "ovs_interfaceid": "f819d75d-a65d-4342-9912-944d2fb13dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Converting VIF {"id": "f819d75d-a65d-4342-9912-944d2fb13dd3", "address": "fa:16:3e:89:06:c8", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf819d75d-a6", "ovs_interfaceid": "f819d75d-a65d-4342-9912-944d2fb13dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:06:c8,bridge_name='br-int',has_traffic_filtering=True,id=f819d75d-a65d-4342-9912-944d2fb13dd3,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf819d75d-a6') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG os_vif [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:06:c8,bridge_name='br-int',has_traffic_filtering=True,id=f819d75d-a65d-4342-9912-944d2fb13dd3,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf819d75d-a6') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8167e7f7-6ada-5ff5-a732-6170eb4d4d23', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf819d75d-a6, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf819d75d-a6, col_values=(('qos', UUID('9a7e3c99-741f-4b43-ac8a-c5a36d2de7cd')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf819d75d-a6, col_values=(('external_ids', {'iface-id': 'f819d75d-a65d-4342-9912-944d2fb13dd3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:06:c8', 'vm-uuid': 'f25ef6a9-d007-419d-8478-2a9e79d5f03a'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:45 user nova-compute[74898]: INFO os_vif [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:06:c8,bridge_name='br-int',has_traffic_filtering=True,id=f819d75d-a65d-4342-9912-944d2fb13dd3,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf819d75d-a6')
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] No VIF found with MAC fa:16:3e:89:06:c8, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.network.neutron [req-6eed6c9c-da3e-489c-8b88-f0c5ef0617e2 req-af75f641-914a-45b9-aa84-7b54eef65ae7 service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Updated VIF entry in instance network info cache for port f819d75d-a65d-4342-9912-944d2fb13dd3. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG nova.network.neutron [req-6eed6c9c-da3e-489c-8b88-f0c5ef0617e2 req-af75f641-914a-45b9-aa84-7b54eef65ae7 service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Updating instance_info_cache with network_info: [{"id": "f819d75d-a65d-4342-9912-944d2fb13dd3", "address": "fa:16:3e:89:06:c8", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf819d75d-a6", "ovs_interfaceid": "f819d75d-a65d-4342-9912-944d2fb13dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:06:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-6eed6c9c-da3e-489c-8b88-f0c5ef0617e2 req-af75f641-914a-45b9-aa84-7b54eef65ae7 service nova] Releasing lock "refresh_cache-f25ef6a9-d007-419d-8478-2a9e79d5f03a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:06:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:47 user nova-compute[74898]: DEBUG nova.compute.manager [req-fc69ddb8-b357-41ac-8c3b-af7e119ac94c req-ccbc71c4-2ea8-42bc-9695-4d593d267ea4 service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Received event network-vif-plugged-f819d75d-a65d-4342-9912-944d2fb13dd3 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fc69ddb8-b357-41ac-8c3b-af7e119ac94c req-ccbc71c4-2ea8-42bc-9695-4d593d267ea4 service nova] Acquiring lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fc69ddb8-b357-41ac-8c3b-af7e119ac94c req-ccbc71c4-2ea8-42bc-9695-4d593d267ea4 service nova] Lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fc69ddb8-b357-41ac-8c3b-af7e119ac94c req-ccbc71c4-2ea8-42bc-9695-4d593d267ea4 service nova] Lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:47 user nova-compute[74898]: DEBUG nova.compute.manager [req-fc69ddb8-b357-41ac-8c3b-af7e119ac94c req-ccbc71c4-2ea8-42bc-9695-4d593d267ea4 service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] No waiting events found dispatching network-vif-plugged-f819d75d-a65d-4342-9912-944d2fb13dd3 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:06:47 user nova-compute[74898]: WARNING nova.compute.manager [req-fc69ddb8-b357-41ac-8c3b-af7e119ac94c req-ccbc71c4-2ea8-42bc-9695-4d593d267ea4 service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Received unexpected event network-vif-plugged-f819d75d-a65d-4342-9912-944d2fb13dd3 for instance with vm_state building and task_state spawning.
Nov 17 03:06:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "f457f5c7-58e3-4f7f-b495-6cfd3440d7dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "f457f5c7-58e3-4f7f-b495-6cfd3440d7dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:48 user nova-compute[74898]: DEBUG nova.compute.manager [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:06:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:06:48 user nova-compute[74898]: INFO nova.compute.claims [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Claim successful on node user
Nov 17 03:06:48 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:06:48 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:06:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:48 user nova-compute[74898]: DEBUG nova.compute.manager [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:06:48 user nova-compute[74898]: DEBUG nova.compute.manager [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:06:48 user nova-compute[74898]: DEBUG nova.network.neutron [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:06:48 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:06:48 user nova-compute[74898]: DEBUG nova.compute.manager [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:06:48 user nova-compute[74898]: DEBUG nova.policy [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8507fa418393437cbba167b470aa7dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3251ef4d69740409c9beec4f368bf72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:06:49 user nova-compute[74898]: DEBUG nova.compute.manager [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:06:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:06:49 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Creating image(s)
Nov 17 03:06:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "/opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "/opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "/opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "40315d6ce94519c12a1481c805e1ff1a40e6f475" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "40315d6ce94519c12a1481c805e1ff1a40e6f475" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40315d6ce94519c12a1481c805e1ff1a40e6f475.part --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:49 user nova-compute[74898]: DEBUG nova.network.neutron [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Successfully created port: bc696f62-bbd0-40f8-8c83-2622f22ff494 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:06:49 user nova-compute[74898]: DEBUG nova.compute.manager [req-4e21ba44-12c8-413d-a5b1-ee2881310192 req-4440dbce-366e-4119-918f-4c2f9a7ec29c service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Received event network-vif-plugged-f819d75d-a65d-4342-9912-944d2fb13dd3 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4e21ba44-12c8-413d-a5b1-ee2881310192 req-4440dbce-366e-4119-918f-4c2f9a7ec29c service nova] Acquiring lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4e21ba44-12c8-413d-a5b1-ee2881310192 req-4440dbce-366e-4119-918f-4c2f9a7ec29c service nova] Lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4e21ba44-12c8-413d-a5b1-ee2881310192 req-4440dbce-366e-4119-918f-4c2f9a7ec29c service nova] Lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:49 user nova-compute[74898]: DEBUG nova.compute.manager [req-4e21ba44-12c8-413d-a5b1-ee2881310192 req-4440dbce-366e-4119-918f-4c2f9a7ec29c service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] No waiting events found dispatching network-vif-plugged-f819d75d-a65d-4342-9912-944d2fb13dd3 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:06:49 user nova-compute[74898]: WARNING nova.compute.manager [req-4e21ba44-12c8-413d-a5b1-ee2881310192 req-4440dbce-366e-4119-918f-4c2f9a7ec29c service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Received unexpected event network-vif-plugged-f819d75d-a65d-4342-9912-944d2fb13dd3 for instance with vm_state building and task_state spawning.
Nov 17 03:06:49 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:06:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:06:49 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Instance spawned successfully.
Nov 17 03:06:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:06:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:06:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:06:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:06:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:06:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:06:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:06:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40315d6ce94519c12a1481c805e1ff1a40e6f475.part --force-share --output=json" returned: 0 in 0.179s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:49 user nova-compute[74898]: DEBUG nova.virt.images [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] ffdd166f-d8b8-46ac-bd56-f641ea3131cb was qcow2, converting to raw {{(pid=74898) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 17 03:06:49 user nova-compute[74898]: DEBUG nova.privsep.utils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74898) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 03:06:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/40315d6ce94519c12a1481c805e1ff1a40e6f475.part /opt/stack/data/nova/instances/_base/40315d6ce94519c12a1481c805e1ff1a40e6f475.converted {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:49 user nova-compute[74898]: INFO nova.compute.manager [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Took 5.96 seconds to spawn the instance on the hypervisor.
Nov 17 03:06:49 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:06:49 user nova-compute[74898]: INFO nova.compute.manager [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Took 6.72 seconds to build instance.
Nov 17 03:06:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e0a2d6bf-86d8-4a5c-841f-397638dec8a6 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.819s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/40315d6ce94519c12a1481c805e1ff1a40e6f475.part /opt/stack/data/nova/instances/_base/40315d6ce94519c12a1481c805e1ff1a40e6f475.converted" returned: 0 in 0.420s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40315d6ce94519c12a1481c805e1ff1a40e6f475.converted --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40315d6ce94519c12a1481c805e1ff1a40e6f475.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "40315d6ce94519c12a1481c805e1ff1a40e6f475" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.537s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40315d6ce94519c12a1481c805e1ff1a40e6f475 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40315d6ce94519c12a1481c805e1ff1a40e6f475 --force-share --output=json" returned: 0 in 0.175s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "40315d6ce94519c12a1481c805e1ff1a40e6f475" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "40315d6ce94519c12a1481c805e1ff1a40e6f475" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40315d6ce94519c12a1481c805e1ff1a40e6f475 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:50 user nova-compute[74898]: DEBUG nova.network.neutron [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Successfully updated port: bc696f62-bbd0-40f8-8c83-2622f22ff494 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:06:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "refresh_cache-f457f5c7-58e3-4f7f-b495-6cfd3440d7dd" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:06:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquired lock "refresh_cache-f457f5c7-58e3-4f7f-b495-6cfd3440d7dd" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:06:50 user nova-compute[74898]: DEBUG nova.network.neutron [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:06:50 user nova-compute[74898]: DEBUG nova.compute.manager [req-585f1bdb-f0fb-4c34-81c8-59e5265ded0a req-d378dbbc-13f3-453e-97dc-4a982848a37d service nova] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Received event network-changed-bc696f62-bbd0-40f8-8c83-2622f22ff494 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:50 user nova-compute[74898]: DEBUG nova.compute.manager [req-585f1bdb-f0fb-4c34-81c8-59e5265ded0a req-d378dbbc-13f3-453e-97dc-4a982848a37d service nova] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Refreshing instance network info cache due to event network-changed-bc696f62-bbd0-40f8-8c83-2622f22ff494. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:06:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-585f1bdb-f0fb-4c34-81c8-59e5265ded0a req-d378dbbc-13f3-453e-97dc-4a982848a37d service nova] Acquiring lock "refresh_cache-f457f5c7-58e3-4f7f-b495-6cfd3440d7dd" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:06:50 user nova-compute[74898]: DEBUG nova.network.neutron [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:06:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40315d6ce94519c12a1481c805e1ff1a40e6f475 --force-share --output=json" returned: 0 in 0.197s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/40315d6ce94519c12a1481c805e1ff1a40e6f475,backing_fmt=raw /opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/40315d6ce94519c12a1481c805e1ff1a40e6f475,backing_fmt=raw /opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/disk 1073741824" returned: 0 in 0.046s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "40315d6ce94519c12a1481c805e1ff1a40e6f475" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40315d6ce94519c12a1481c805e1ff1a40e6f475 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.network.neutron [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Updating instance_info_cache with network_info: [{"id": "bc696f62-bbd0-40f8-8c83-2622f22ff494", "address": "fa:16:3e:a0:44:e9", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc696f62-bb", "ovs_interfaceid": "bc696f62-bbd0-40f8-8c83-2622f22ff494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40315d6ce94519c12a1481c805e1ff1a40e6f475 --force-share --output=json" returned: 0 in 0.178s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Cannot resize image /opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Ensure instance console log exists: /opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Releasing lock "refresh_cache-f457f5c7-58e3-4f7f-b495-6cfd3440d7dd" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.compute.manager [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Instance network_info: |[{"id": "bc696f62-bbd0-40f8-8c83-2622f22ff494", "address": "fa:16:3e:a0:44:e9", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc696f62-bb", "ovs_interfaceid": "bc696f62-bbd0-40f8-8c83-2622f22ff494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-585f1bdb-f0fb-4c34-81c8-59e5265ded0a req-d378dbbc-13f3-453e-97dc-4a982848a37d service nova] Acquired lock "refresh_cache-f457f5c7-58e3-4f7f-b495-6cfd3440d7dd" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.network.neutron [req-585f1bdb-f0fb-4c34-81c8-59e5265ded0a req-d378dbbc-13f3-453e-97dc-4a982848a37d service nova] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Refreshing network info cache for port bc696f62-bbd0-40f8-8c83-2622f22ff494 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Start _get_guest_xml network_info=[{"id": "bc696f62-bbd0-40f8-8c83-2622f22ff494", "address": "fa:16:3e:a0:44:e9", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc696f62-bb", "ovs_interfaceid": "bc696f62-bbd0-40f8-8c83-2622f22ff494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T03:06:46Z,direct_url=<?>,disk_format='qcow2',id=ffdd166f-d8b8-46ac-bd56-f641ea3131cb,min_disk=0,min_ram=0,name='tempest-scenario-img--1552283576',owner='e3251ef4d69740409c9beec4f368bf72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T03:06:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': 'ffdd166f-d8b8-46ac-bd56-f641ea3131cb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:06:51 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:06:51 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T03:06:46Z,direct_url=<?>,disk_format='qcow2',id=ffdd166f-d8b8-46ac-bd56-f641ea3131cb,min_disk=0,min_ram=0,name='tempest-scenario-img--1552283576',owner='e3251ef4d69740409c9beec4f368bf72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T03:06:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-811665424',display_name='tempest-TestMinimumBasicScenario-server-811665424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-811665424',id=20,image_ref='ffdd166f-d8b8-46ac-bd56-f641ea3131cb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7moiPS/URWGjOpnoXa2/0/YNsKrwdAmA6Q5SQ4CqXTVSx+V/BMH/oVgEDkkA45FSqK7ToQ41yeGODe/WVJdnOv77H+6nORZzKciRW20riqL3y2vVaPhSldTkMof/EiKQ==',key_name='tempest-TestMinimumBasicScenario-234024958',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3251ef4d69740409c9beec4f368bf72',ramdisk_id='',reservation_id='r-oqszxo22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ffdd166f-d8b8-46ac-bd56-f641ea3131cb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1625508354',owner_user_name='tempest-TestMinimumBasicScenario-1625508354-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:06:49Z,user_data=None,user_id='8507fa418393437cbba167b470aa7dc1',uuid=f457f5c7-58e3-4f7f-b495-6cfd3440d7dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc696f62-bbd0-40f8-8c83-2622f22ff494", "address": "fa:16:3e:a0:44:e9", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc696f62-bb", "ovs_interfaceid": "bc696f62-bbd0-40f8-8c83-2622f22ff494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Converting VIF {"id": "bc696f62-bbd0-40f8-8c83-2622f22ff494", "address": "fa:16:3e:a0:44:e9", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc696f62-bb", "ovs_interfaceid": "bc696f62-bbd0-40f8-8c83-2622f22ff494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:44:e9,bridge_name='br-int',has_traffic_filtering=True,id=bc696f62-bbd0-40f8-8c83-2622f22ff494,network=Network(7b139a66-9d14-40e3-b129-0febdd13b264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc696f62-bb') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.objects.instance [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lazy-loading 'pci_devices' on Instance uuid f457f5c7-58e3-4f7f-b495-6cfd3440d7dd {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:06:51 user nova-compute[74898]:   <uuid>f457f5c7-58e3-4f7f-b495-6cfd3440d7dd</uuid>
Nov 17 03:06:51 user nova-compute[74898]:   <name>instance-00000014</name>
Nov 17 03:06:51 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:06:51 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:06:51 user nova-compute[74898]:   <metadata>
Nov 17 03:06:51 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:06:51 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:06:51 user nova-compute[74898]:       <nova:name>tempest-TestMinimumBasicScenario-server-811665424</nova:name>
Nov 17 03:06:51 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:06:51</nova:creationTime>
Nov 17 03:06:51 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:06:51 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:06:51 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:06:51 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:06:51 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:06:51 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:06:51 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:06:51 user nova-compute[74898]:       <nova:owner>
Nov 17 03:06:51 user nova-compute[74898]:         <nova:user uuid="8507fa418393437cbba167b470aa7dc1">tempest-TestMinimumBasicScenario-1625508354-project-member</nova:user>
Nov 17 03:06:51 user nova-compute[74898]:         <nova:project uuid="e3251ef4d69740409c9beec4f368bf72">tempest-TestMinimumBasicScenario-1625508354</nova:project>
Nov 17 03:06:51 user nova-compute[74898]:       </nova:owner>
Nov 17 03:06:51 user nova-compute[74898]:       <nova:root type="image" uuid="ffdd166f-d8b8-46ac-bd56-f641ea3131cb"/>
Nov 17 03:06:51 user nova-compute[74898]:       <nova:ports>
Nov 17 03:06:51 user nova-compute[74898]:         <nova:port uuid="bc696f62-bbd0-40f8-8c83-2622f22ff494">
Nov 17 03:06:51 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 17 03:06:51 user nova-compute[74898]:         </nova:port>
Nov 17 03:06:51 user nova-compute[74898]:       </nova:ports>
Nov 17 03:06:51 user nova-compute[74898]:     </nova:instance>
Nov 17 03:06:51 user nova-compute[74898]:   </metadata>
Nov 17 03:06:51 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:06:51 user nova-compute[74898]:     <system>
Nov 17 03:06:51 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:06:51 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:06:51 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:06:51 user nova-compute[74898]:       <entry name="serial">f457f5c7-58e3-4f7f-b495-6cfd3440d7dd</entry>
Nov 17 03:06:51 user nova-compute[74898]:       <entry name="uuid">f457f5c7-58e3-4f7f-b495-6cfd3440d7dd</entry>
Nov 17 03:06:51 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:06:51 user nova-compute[74898]:     </system>
Nov 17 03:06:51 user nova-compute[74898]:   </sysinfo>
Nov 17 03:06:51 user nova-compute[74898]:   <os>
Nov 17 03:06:51 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:06:51 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:06:51 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:06:51 user nova-compute[74898]:   </os>
Nov 17 03:06:51 user nova-compute[74898]:   <features>
Nov 17 03:06:51 user nova-compute[74898]:     <acpi/>
Nov 17 03:06:51 user nova-compute[74898]:     <apic/>
Nov 17 03:06:51 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:06:51 user nova-compute[74898]:   </features>
Nov 17 03:06:51 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:06:51 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:06:51 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:06:51 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:06:51 user nova-compute[74898]:   </clock>
Nov 17 03:06:51 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:06:51 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:06:51 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:06:51 user nova-compute[74898]:   </cpu>
Nov 17 03:06:51 user nova-compute[74898]:   <devices>
Nov 17 03:06:51 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:06:51 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:06:51 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/disk"/>
Nov 17 03:06:51 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:06:51 user nova-compute[74898]:     </disk>
Nov 17 03:06:51 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:06:51 user nova-compute[74898]:       <mac address="fa:16:3e:a0:44:e9"/>
Nov 17 03:06:51 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:06:51 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:06:51 user nova-compute[74898]:       <target dev="tapbc696f62-bb"/>
Nov 17 03:06:51 user nova-compute[74898]:     </interface>
Nov 17 03:06:51 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:06:51 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/console.log" append="off"/>
Nov 17 03:06:51 user nova-compute[74898]:     </serial>
Nov 17 03:06:51 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:06:51 user nova-compute[74898]:     <video>
Nov 17 03:06:51 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:06:51 user nova-compute[74898]:     </video>
Nov 17 03:06:51 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:06:51 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:06:51 user nova-compute[74898]:     </rng>
Nov 17 03:06:51 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:06:51 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:06:51 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:06:51 user nova-compute[74898]:     </memballoon>
Nov 17 03:06:51 user nova-compute[74898]:   </devices>
Nov 17 03:06:51 user nova-compute[74898]: </domain>
Nov 17 03:06:51 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-811665424',display_name='tempest-TestMinimumBasicScenario-server-811665424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-811665424',id=20,image_ref='ffdd166f-d8b8-46ac-bd56-f641ea3131cb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7moiPS/URWGjOpnoXa2/0/YNsKrwdAmA6Q5SQ4CqXTVSx+V/BMH/oVgEDkkA45FSqK7ToQ41yeGODe/WVJdnOv77H+6nORZzKciRW20riqL3y2vVaPhSldTkMof/EiKQ==',key_name='tempest-TestMinimumBasicScenario-234024958',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3251ef4d69740409c9beec4f368bf72',ramdisk_id='',reservation_id='r-oqszxo22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ffdd166f-d8b8-46ac-bd56-f641ea3131cb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1625508354',owner_user_name='tempest-TestMinimumBasicScenario-1625508354-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:06:49Z,user_data=None,user_id='8507fa418393437cbba167b470aa7dc1',uuid=f457f5c7-58e3-4f7f-b495-6cfd3440d7dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc696f62-bbd0-40f8-8c83-2622f22ff494", "address": "fa:16:3e:a0:44:e9", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc696f62-bb", "ovs_interfaceid": "bc696f62-bbd0-40f8-8c83-2622f22ff494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Converting VIF {"id": "bc696f62-bbd0-40f8-8c83-2622f22ff494", "address": "fa:16:3e:a0:44:e9", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc696f62-bb", "ovs_interfaceid": "bc696f62-bbd0-40f8-8c83-2622f22ff494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:44:e9,bridge_name='br-int',has_traffic_filtering=True,id=bc696f62-bbd0-40f8-8c83-2622f22ff494,network=Network(7b139a66-9d14-40e3-b129-0febdd13b264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc696f62-bb') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG os_vif [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:44:e9,bridge_name='br-int',has_traffic_filtering=True,id=bc696f62-bbd0-40f8-8c83-2622f22ff494,network=Network(7b139a66-9d14-40e3-b129-0febdd13b264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc696f62-bb') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba1a00a7-337b-5758-9ba2-cf2b8a1f062c', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc696f62-bb, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbc696f62-bb, col_values=(('qos', UUID('1333c6ee-0f29-4732-8958-17aa36eae6c4')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbc696f62-bb, col_values=(('external_ids', {'iface-id': 'bc696f62-bbd0-40f8-8c83-2622f22ff494', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:44:e9', 'vm-uuid': 'f457f5c7-58e3-4f7f-b495-6cfd3440d7dd'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:51 user nova-compute[74898]: INFO os_vif [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:44:e9,bridge_name='br-int',has_traffic_filtering=True,id=bc696f62-bbd0-40f8-8c83-2622f22ff494,network=Network(7b139a66-9d14-40e3-b129-0febdd13b264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc696f62-bb')
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] No VIF found with MAC fa:16:3e:a0:44:e9, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.network.neutron [req-585f1bdb-f0fb-4c34-81c8-59e5265ded0a req-d378dbbc-13f3-453e-97dc-4a982848a37d service nova] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Updated VIF entry in instance network info cache for port bc696f62-bbd0-40f8-8c83-2622f22ff494. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG nova.network.neutron [req-585f1bdb-f0fb-4c34-81c8-59e5265ded0a req-d378dbbc-13f3-453e-97dc-4a982848a37d service nova] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Updating instance_info_cache with network_info: [{"id": "bc696f62-bbd0-40f8-8c83-2622f22ff494", "address": "fa:16:3e:a0:44:e9", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc696f62-bb", "ovs_interfaceid": "bc696f62-bbd0-40f8-8c83-2622f22ff494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:06:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-585f1bdb-f0fb-4c34-81c8-59e5265ded0a req-d378dbbc-13f3-453e-97dc-4a982848a37d service nova] Releasing lock "refresh_cache-f457f5c7-58e3-4f7f-b495-6cfd3440d7dd" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:06:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:53 user nova-compute[74898]: DEBUG nova.compute.manager [req-567ba72c-284d-4ac3-b160-8d16285ea23b req-d21824b1-6db2-4ab9-ae53-23f73f0cfa7a service nova] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Received event network-vif-plugged-bc696f62-bbd0-40f8-8c83-2622f22ff494 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-567ba72c-284d-4ac3-b160-8d16285ea23b req-d21824b1-6db2-4ab9-ae53-23f73f0cfa7a service nova] Acquiring lock "f457f5c7-58e3-4f7f-b495-6cfd3440d7dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-567ba72c-284d-4ac3-b160-8d16285ea23b req-d21824b1-6db2-4ab9-ae53-23f73f0cfa7a service nova] Lock "f457f5c7-58e3-4f7f-b495-6cfd3440d7dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-567ba72c-284d-4ac3-b160-8d16285ea23b req-d21824b1-6db2-4ab9-ae53-23f73f0cfa7a service nova] Lock "f457f5c7-58e3-4f7f-b495-6cfd3440d7dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:53 user nova-compute[74898]: DEBUG nova.compute.manager [req-567ba72c-284d-4ac3-b160-8d16285ea23b req-d21824b1-6db2-4ab9-ae53-23f73f0cfa7a service nova] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] No waiting events found dispatching network-vif-plugged-bc696f62-bbd0-40f8-8c83-2622f22ff494 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:06:53 user nova-compute[74898]: WARNING nova.compute.manager [req-567ba72c-284d-4ac3-b160-8d16285ea23b req-d21824b1-6db2-4ab9-ae53-23f73f0cfa7a service nova] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Received unexpected event network-vif-plugged-bc696f62-bbd0-40f8-8c83-2622f22ff494 for instance with vm_state building and task_state spawning.
Nov 17 03:06:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:55 user nova-compute[74898]: DEBUG nova.compute.manager [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:06:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:06:55 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Instance spawned successfully.
Nov 17 03:06:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:06:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:06:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:06:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:06:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:06:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:06:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:06:55 user nova-compute[74898]: INFO nova.compute.manager [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Took 6.14 seconds to spawn the instance on the hypervisor.
Nov 17 03:06:55 user nova-compute[74898]: DEBUG nova.compute.manager [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:06:55 user nova-compute[74898]: DEBUG nova.compute.manager [req-eb7b9fc1-912e-421e-bbb0-1b709be014c8 req-46def779-dcbc-4bd1-90cb-958a3eea8bee service nova] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Received event network-vif-plugged-bc696f62-bbd0-40f8-8c83-2622f22ff494 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:06:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-eb7b9fc1-912e-421e-bbb0-1b709be014c8 req-46def779-dcbc-4bd1-90cb-958a3eea8bee service nova] Acquiring lock "f457f5c7-58e3-4f7f-b495-6cfd3440d7dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:06:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-eb7b9fc1-912e-421e-bbb0-1b709be014c8 req-46def779-dcbc-4bd1-90cb-958a3eea8bee service nova] Lock "f457f5c7-58e3-4f7f-b495-6cfd3440d7dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:06:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-eb7b9fc1-912e-421e-bbb0-1b709be014c8 req-46def779-dcbc-4bd1-90cb-958a3eea8bee service nova] Lock "f457f5c7-58e3-4f7f-b495-6cfd3440d7dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:55 user nova-compute[74898]: DEBUG nova.compute.manager [req-eb7b9fc1-912e-421e-bbb0-1b709be014c8 req-46def779-dcbc-4bd1-90cb-958a3eea8bee service nova] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] No waiting events found dispatching network-vif-plugged-bc696f62-bbd0-40f8-8c83-2622f22ff494 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:06:55 user nova-compute[74898]: WARNING nova.compute.manager [req-eb7b9fc1-912e-421e-bbb0-1b709be014c8 req-46def779-dcbc-4bd1-90cb-958a3eea8bee service nova] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Received unexpected event network-vif-plugged-bc696f62-bbd0-40f8-8c83-2622f22ff494 for instance with vm_state building and task_state spawning.
Nov 17 03:06:55 user nova-compute[74898]: INFO nova.compute.manager [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Took 6.93 seconds to build instance.
Nov 17 03:06:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6a86f23e-ce50-4ca3-9b98-da276409699d tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "f457f5c7-58e3-4f7f-b495-6cfd3440d7dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.019s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:06:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:06:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:07:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-85835b8d-ff4b-407a-809a-5c97b0245d77 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Acquiring lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-85835b8d-ff4b-407a-809a-5c97b0245d77 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-85835b8d-ff4b-407a-809a-5c97b0245d77 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Acquiring lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-85835b8d-ff4b-407a-809a-5c97b0245d77 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-85835b8d-ff4b-407a-809a-5c97b0245d77 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:05 user nova-compute[74898]: INFO nova.compute.manager [None req-85835b8d-ff4b-407a-809a-5c97b0245d77 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Terminating instance
Nov 17 03:07:05 user nova-compute[74898]: DEBUG nova.compute.manager [None req-85835b8d-ff4b-407a-809a-5c97b0245d77 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:07:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:06 user nova-compute[74898]: DEBUG nova.compute.manager [req-c8d1a174-9f5d-41c5-8b61-883abae3a571 req-5c6013ca-7f45-4cc8-8daf-90498592cb90 service nova] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Received event network-vif-unplugged-8b4bafcd-1db9-460a-bb53-3e92498fa50c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:07:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c8d1a174-9f5d-41c5-8b61-883abae3a571 req-5c6013ca-7f45-4cc8-8daf-90498592cb90 service nova] Acquiring lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c8d1a174-9f5d-41c5-8b61-883abae3a571 req-5c6013ca-7f45-4cc8-8daf-90498592cb90 service nova] Lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c8d1a174-9f5d-41c5-8b61-883abae3a571 req-5c6013ca-7f45-4cc8-8daf-90498592cb90 service nova] Lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:06 user nova-compute[74898]: DEBUG nova.compute.manager [req-c8d1a174-9f5d-41c5-8b61-883abae3a571 req-5c6013ca-7f45-4cc8-8daf-90498592cb90 service nova] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] No waiting events found dispatching network-vif-unplugged-8b4bafcd-1db9-460a-bb53-3e92498fa50c {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:07:06 user nova-compute[74898]: DEBUG nova.compute.manager [req-c8d1a174-9f5d-41c5-8b61-883abae3a571 req-5c6013ca-7f45-4cc8-8daf-90498592cb90 service nova] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Received event network-vif-unplugged-8b4bafcd-1db9-460a-bb53-3e92498fa50c for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:07:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:06 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Instance destroyed successfully.
Nov 17 03:07:06 user nova-compute[74898]: DEBUG nova.objects.instance [None req-85835b8d-ff4b-407a-809a-5c97b0245d77 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lazy-loading 'resources' on Instance uuid 474a469d-9ebe-4e91-9ec4-3f610bdd4d27 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:07:06 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-85835b8d-ff4b-407a-809a-5c97b0245d77 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:03:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-832865533',display_name='tempest-TestVolumeSwap-server-832865533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-832865533',id=15,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNPMXlQY1G7ZNE0JYuewp1SXrE3SrH0Iv7QgrLPcx5q/50+8l9jbD9mx7dXbPyKGsS94r93jf40zH/ASI95F9odWDJoNLXWkYZk9XXn2X3ksAnOAED64uX0oLkBjfwW5A==',key_name='tempest-keypair-1676175423',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:03:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11f0d4a6654645f49a5f57d48cc52d2e',ramdisk_id='',reservation_id='r-1bzqfumt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1425883188',owner_user_name='tempest-TestVolumeSwap-1425883188-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:03:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1bcce35856143b0bbd89aaaeb520954',uuid=474a469d-9ebe-4e91-9ec4-3f610bdd4d27,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b4bafcd-1db9-460a-bb53-3e92498fa50c", "address": "fa:16:3e:28:47:a5", "network": {"id": "253a5a85-21b7-42d7-8893-2a97d76e7849", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1666014168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f0d4a6654645f49a5f57d48cc52d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4bafcd-1d", "ovs_interfaceid": "8b4bafcd-1db9-460a-bb53-3e92498fa50c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:07:06 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-85835b8d-ff4b-407a-809a-5c97b0245d77 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Converting VIF {"id": "8b4bafcd-1db9-460a-bb53-3e92498fa50c", "address": "fa:16:3e:28:47:a5", "network": {"id": "253a5a85-21b7-42d7-8893-2a97d76e7849", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1666014168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f0d4a6654645f49a5f57d48cc52d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4bafcd-1d", "ovs_interfaceid": "8b4bafcd-1db9-460a-bb53-3e92498fa50c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:07:06 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-85835b8d-ff4b-407a-809a-5c97b0245d77 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:47:a5,bridge_name='br-int',has_traffic_filtering=True,id=8b4bafcd-1db9-460a-bb53-3e92498fa50c,network=Network(253a5a85-21b7-42d7-8893-2a97d76e7849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4bafcd-1d') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:07:06 user nova-compute[74898]: DEBUG os_vif [None req-85835b8d-ff4b-407a-809a-5c97b0245d77 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:47:a5,bridge_name='br-int',has_traffic_filtering=True,id=8b4bafcd-1db9-460a-bb53-3e92498fa50c,network=Network(253a5a85-21b7-42d7-8893-2a97d76e7849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4bafcd-1d') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:07:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b4bafcd-1d, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:07:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:07:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=446c49b2-04b9-47d6-ad67-fa63b9f77269) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:07:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:07:06 user nova-compute[74898]: INFO os_vif [None req-85835b8d-ff4b-407a-809a-5c97b0245d77 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:47:a5,bridge_name='br-int',has_traffic_filtering=True,id=8b4bafcd-1db9-460a-bb53-3e92498fa50c,network=Network(253a5a85-21b7-42d7-8893-2a97d76e7849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4bafcd-1d')
Nov 17 03:07:06 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-85835b8d-ff4b-407a-809a-5c97b0245d77 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Deleting instance files /opt/stack/data/nova/instances/474a469d-9ebe-4e91-9ec4-3f610bdd4d27_del
Nov 17 03:07:06 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-85835b8d-ff4b-407a-809a-5c97b0245d77 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Deletion of /opt/stack/data/nova/instances/474a469d-9ebe-4e91-9ec4-3f610bdd4d27_del complete
Nov 17 03:07:06 user nova-compute[74898]: INFO nova.compute.manager [None req-85835b8d-ff4b-407a-809a-5c97b0245d77 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 17 03:07:06 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-85835b8d-ff4b-407a-809a-5c97b0245d77 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:07:06 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:07:06 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:07:07 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:07:07 user nova-compute[74898]: DEBUG nova.compute.manager [req-95a8c374-5ddf-4de5-981d-4ffba8293bcc req-e7fb1193-c1ca-4f49-b71f-5881f6bcc589 service nova] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Received event network-vif-deleted-8b4bafcd-1db9-460a-bb53-3e92498fa50c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:07:07 user nova-compute[74898]: INFO nova.compute.manager [req-95a8c374-5ddf-4de5-981d-4ffba8293bcc req-e7fb1193-c1ca-4f49-b71f-5881f6bcc589 service nova] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Neutron deleted interface 8b4bafcd-1db9-460a-bb53-3e92498fa50c; detaching it from the instance and deleting it from the info cache
Nov 17 03:07:07 user nova-compute[74898]: DEBUG nova.network.neutron [req-95a8c374-5ddf-4de5-981d-4ffba8293bcc req-e7fb1193-c1ca-4f49-b71f-5881f6bcc589 service nova] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:07:07 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Took 0.74 seconds to deallocate network for instance.
Nov 17 03:07:07 user nova-compute[74898]: DEBUG nova.compute.manager [req-95a8c374-5ddf-4de5-981d-4ffba8293bcc req-e7fb1193-c1ca-4f49-b71f-5881f6bcc589 service nova] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Detach interface failed, port_id=8b4bafcd-1db9-460a-bb53-3e92498fa50c, reason: Instance 474a469d-9ebe-4e91-9ec4-3f610bdd4d27 could not be found. {{(pid=74898) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 03:07:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-85835b8d-ff4b-407a-809a-5c97b0245d77 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-85835b8d-ff4b-407a-809a-5c97b0245d77 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:07 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-85835b8d-ff4b-407a-809a-5c97b0245d77 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:07:07 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-85835b8d-ff4b-407a-809a-5c97b0245d77 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:07:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-85835b8d-ff4b-407a-809a-5c97b0245d77 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:08 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-85835b8d-ff4b-407a-809a-5c97b0245d77 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Deleted allocations for instance 474a469d-9ebe-4e91-9ec4-3f610bdd4d27
Nov 17 03:07:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-85835b8d-ff4b-407a-809a-5c97b0245d77 tempest-TestVolumeSwap-1425883188 tempest-TestVolumeSwap-1425883188-project-member] Lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.226s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:08 user nova-compute[74898]: DEBUG nova.compute.manager [req-124e5000-0b90-4d78-9e12-5705902cb726 req-2c4935ca-d01f-42c5-af63-b2551f37468a service nova] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Received event network-vif-plugged-8b4bafcd-1db9-460a-bb53-3e92498fa50c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:07:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-124e5000-0b90-4d78-9e12-5705902cb726 req-2c4935ca-d01f-42c5-af63-b2551f37468a service nova] Acquiring lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-124e5000-0b90-4d78-9e12-5705902cb726 req-2c4935ca-d01f-42c5-af63-b2551f37468a service nova] Lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-124e5000-0b90-4d78-9e12-5705902cb726 req-2c4935ca-d01f-42c5-af63-b2551f37468a service nova] Lock "474a469d-9ebe-4e91-9ec4-3f610bdd4d27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:08 user nova-compute[74898]: DEBUG nova.compute.manager [req-124e5000-0b90-4d78-9e12-5705902cb726 req-2c4935ca-d01f-42c5-af63-b2551f37468a service nova] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] No waiting events found dispatching network-vif-plugged-8b4bafcd-1db9-460a-bb53-3e92498fa50c {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:07:08 user nova-compute[74898]: WARNING nova.compute.manager [req-124e5000-0b90-4d78-9e12-5705902cb726 req-2c4935ca-d01f-42c5-af63-b2551f37468a service nova] [instance: 474a469d-9ebe-4e91-9ec4-3f610bdd4d27] Received unexpected event network-vif-plugged-8b4bafcd-1db9-460a-bb53-3e92498fa50c for instance with vm_state deleted and task_state None.
Nov 17 03:07:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "13449e5c-809b-4db2-af0b-53f5865eb3a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "13449e5c-809b-4db2-af0b-53f5865eb3a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:11 user nova-compute[74898]: DEBUG nova.compute.manager [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:07:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:12 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:07:12 user nova-compute[74898]: INFO nova.compute.claims [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Claim successful on node user
Nov 17 03:07:12 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:07:12 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:07:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:12 user nova-compute[74898]: DEBUG nova.compute.manager [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:07:12 user nova-compute[74898]: DEBUG nova.compute.manager [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:07:12 user nova-compute[74898]: DEBUG nova.network.neutron [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:07:12 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:07:12 user nova-compute[74898]: DEBUG nova.compute.manager [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:07:12 user nova-compute[74898]: DEBUG nova.policy [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05397a6b586843338aafbc8a17c6e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cd941de23248d8ac93b03f930f565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:07:12 user nova-compute[74898]: DEBUG nova.compute.manager [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:07:12 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:07:12 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Creating image(s)
Nov 17 03:07:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "/opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "/opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "/opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.172s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.188s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk 1073741824" returned: 0 in 0.046s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:13 user nova-compute[74898]: DEBUG nova.network.neutron [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Successfully created port: 2bdfdbe2-b457-4078-b4be-979a51ba442a {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:07:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.169s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:13 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Checking if we can resize image /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:07:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:13 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Cannot resize image /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:07:13 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:07:13 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Ensure instance console log exists: /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:07:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:13 user nova-compute[74898]: DEBUG nova.network.neutron [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Successfully updated port: 2bdfdbe2-b457-4078-b4be-979a51ba442a {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:07:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "refresh_cache-13449e5c-809b-4db2-af0b-53f5865eb3a4" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:07:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquired lock "refresh_cache-13449e5c-809b-4db2-af0b-53f5865eb3a4" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:07:13 user nova-compute[74898]: DEBUG nova.network.neutron [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:07:13 user nova-compute[74898]: DEBUG nova.compute.manager [req-44176162-506a-4888-a580-88db7ee29c4d req-3f9c541e-5dab-4d07-9dc4-cd181023805d service nova] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Received event network-changed-2bdfdbe2-b457-4078-b4be-979a51ba442a {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:07:13 user nova-compute[74898]: DEBUG nova.compute.manager [req-44176162-506a-4888-a580-88db7ee29c4d req-3f9c541e-5dab-4d07-9dc4-cd181023805d service nova] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Refreshing instance network info cache due to event network-changed-2bdfdbe2-b457-4078-b4be-979a51ba442a. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:07:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-44176162-506a-4888-a580-88db7ee29c4d req-3f9c541e-5dab-4d07-9dc4-cd181023805d service nova] Acquiring lock "refresh_cache-13449e5c-809b-4db2-af0b-53f5865eb3a4" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:07:13 user nova-compute[74898]: DEBUG nova.network.neutron [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:07:13 user nova-compute[74898]: DEBUG nova.network.neutron [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Updating instance_info_cache with network_info: [{"id": "2bdfdbe2-b457-4078-b4be-979a51ba442a", "address": "fa:16:3e:a1:96:f0", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdfdbe2-b4", "ovs_interfaceid": "2bdfdbe2-b457-4078-b4be-979a51ba442a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Releasing lock "refresh_cache-13449e5c-809b-4db2-af0b-53f5865eb3a4" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.compute.manager [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Instance network_info: |[{"id": "2bdfdbe2-b457-4078-b4be-979a51ba442a", "address": "fa:16:3e:a1:96:f0", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdfdbe2-b4", "ovs_interfaceid": "2bdfdbe2-b457-4078-b4be-979a51ba442a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-44176162-506a-4888-a580-88db7ee29c4d req-3f9c541e-5dab-4d07-9dc4-cd181023805d service nova] Acquired lock "refresh_cache-13449e5c-809b-4db2-af0b-53f5865eb3a4" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.network.neutron [req-44176162-506a-4888-a580-88db7ee29c4d req-3f9c541e-5dab-4d07-9dc4-cd181023805d service nova] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Refreshing network info cache for port 2bdfdbe2-b457-4078-b4be-979a51ba442a {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Start _get_guest_xml network_info=[{"id": "2bdfdbe2-b457-4078-b4be-979a51ba442a", "address": "fa:16:3e:a1:96:f0", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdfdbe2-b4", "ovs_interfaceid": "2bdfdbe2-b457-4078-b4be-979a51ba442a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:07:14 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:07:14 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:07:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-705097225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-705097225',id=21,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0cd941de23248d8ac93b03f930f565f',ramdisk_id='',reservation_id='r-yer2px48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-507656828',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:07:13Z,user_data=None,user_id='05397a6b586843338aafbc8a17c6e42c',uuid=13449e5c-809b-4db2-af0b-53f5865eb3a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bdfdbe2-b457-4078-b4be-979a51ba442a", "address": "fa:16:3e:a1:96:f0", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdfdbe2-b4", "ovs_interfaceid": "2bdfdbe2-b457-4078-b4be-979a51ba442a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Converting VIF {"id": "2bdfdbe2-b457-4078-b4be-979a51ba442a", "address": "fa:16:3e:a1:96:f0", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdfdbe2-b4", "ovs_interfaceid": "2bdfdbe2-b457-4078-b4be-979a51ba442a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:96:f0,bridge_name='br-int',has_traffic_filtering=True,id=2bdfdbe2-b457-4078-b4be-979a51ba442a,network=Network(9302cb9a-12f9-4845-b6cc-905f4bf24b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdfdbe2-b4') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.objects.instance [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lazy-loading 'pci_devices' on Instance uuid 13449e5c-809b-4db2-af0b-53f5865eb3a4 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:07:14 user nova-compute[74898]:   <uuid>13449e5c-809b-4db2-af0b-53f5865eb3a4</uuid>
Nov 17 03:07:14 user nova-compute[74898]:   <name>instance-00000015</name>
Nov 17 03:07:14 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:07:14 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:07:14 user nova-compute[74898]:   <metadata>
Nov 17 03:07:14 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:07:14 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:07:14 user nova-compute[74898]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-705097225</nova:name>
Nov 17 03:07:14 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:07:14</nova:creationTime>
Nov 17 03:07:14 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:07:14 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:07:14 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:07:14 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:07:14 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:07:14 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:07:14 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:07:14 user nova-compute[74898]:       <nova:owner>
Nov 17 03:07:14 user nova-compute[74898]:         <nova:user uuid="05397a6b586843338aafbc8a17c6e42c">tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member</nova:user>
Nov 17 03:07:14 user nova-compute[74898]:         <nova:project uuid="b0cd941de23248d8ac93b03f930f565f">tempest-ServerBootFromVolumeStableRescueTest-507656828</nova:project>
Nov 17 03:07:14 user nova-compute[74898]:       </nova:owner>
Nov 17 03:07:14 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:07:14 user nova-compute[74898]:       <nova:ports>
Nov 17 03:07:14 user nova-compute[74898]:         <nova:port uuid="2bdfdbe2-b457-4078-b4be-979a51ba442a">
Nov 17 03:07:14 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 17 03:07:14 user nova-compute[74898]:         </nova:port>
Nov 17 03:07:14 user nova-compute[74898]:       </nova:ports>
Nov 17 03:07:14 user nova-compute[74898]:     </nova:instance>
Nov 17 03:07:14 user nova-compute[74898]:   </metadata>
Nov 17 03:07:14 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:07:14 user nova-compute[74898]:     <system>
Nov 17 03:07:14 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:07:14 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:07:14 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:07:14 user nova-compute[74898]:       <entry name="serial">13449e5c-809b-4db2-af0b-53f5865eb3a4</entry>
Nov 17 03:07:14 user nova-compute[74898]:       <entry name="uuid">13449e5c-809b-4db2-af0b-53f5865eb3a4</entry>
Nov 17 03:07:14 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:07:14 user nova-compute[74898]:     </system>
Nov 17 03:07:14 user nova-compute[74898]:   </sysinfo>
Nov 17 03:07:14 user nova-compute[74898]:   <os>
Nov 17 03:07:14 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:07:14 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:07:14 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:07:14 user nova-compute[74898]:   </os>
Nov 17 03:07:14 user nova-compute[74898]:   <features>
Nov 17 03:07:14 user nova-compute[74898]:     <acpi/>
Nov 17 03:07:14 user nova-compute[74898]:     <apic/>
Nov 17 03:07:14 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:07:14 user nova-compute[74898]:   </features>
Nov 17 03:07:14 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:07:14 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:07:14 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:07:14 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:07:14 user nova-compute[74898]:   </clock>
Nov 17 03:07:14 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:07:14 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:07:14 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:07:14 user nova-compute[74898]:   </cpu>
Nov 17 03:07:14 user nova-compute[74898]:   <devices>
Nov 17 03:07:14 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:07:14 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:07:14 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk"/>
Nov 17 03:07:14 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:07:14 user nova-compute[74898]:     </disk>
Nov 17 03:07:14 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:07:14 user nova-compute[74898]:       <mac address="fa:16:3e:a1:96:f0"/>
Nov 17 03:07:14 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:07:14 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:07:14 user nova-compute[74898]:       <target dev="tap2bdfdbe2-b4"/>
Nov 17 03:07:14 user nova-compute[74898]:     </interface>
Nov 17 03:07:14 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:07:14 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/console.log" append="off"/>
Nov 17 03:07:14 user nova-compute[74898]:     </serial>
Nov 17 03:07:14 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:07:14 user nova-compute[74898]:     <video>
Nov 17 03:07:14 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:07:14 user nova-compute[74898]:     </video>
Nov 17 03:07:14 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:07:14 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:07:14 user nova-compute[74898]:     </rng>
Nov 17 03:07:14 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:07:14 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:07:14 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:07:14 user nova-compute[74898]:     </memballoon>
Nov 17 03:07:14 user nova-compute[74898]:   </devices>
Nov 17 03:07:14 user nova-compute[74898]: </domain>
Nov 17 03:07:14 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:07:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-705097225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-705097225',id=21,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0cd941de23248d8ac93b03f930f565f',ramdisk_id='',reservation_id='r-yer2px48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-507656828',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:07:13Z,user_data=None,user_id='05397a6b586843338aafbc8a17c6e42c',uuid=13449e5c-809b-4db2-af0b-53f5865eb3a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bdfdbe2-b457-4078-b4be-979a51ba442a", "address": "fa:16:3e:a1:96:f0", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdfdbe2-b4", "ovs_interfaceid": "2bdfdbe2-b457-4078-b4be-979a51ba442a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Converting VIF {"id": "2bdfdbe2-b457-4078-b4be-979a51ba442a", "address": "fa:16:3e:a1:96:f0", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdfdbe2-b4", "ovs_interfaceid": "2bdfdbe2-b457-4078-b4be-979a51ba442a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:96:f0,bridge_name='br-int',has_traffic_filtering=True,id=2bdfdbe2-b457-4078-b4be-979a51ba442a,network=Network(9302cb9a-12f9-4845-b6cc-905f4bf24b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdfdbe2-b4') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG os_vif [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:96:f0,bridge_name='br-int',has_traffic_filtering=True,id=2bdfdbe2-b457-4078-b4be-979a51ba442a,network=Network(9302cb9a-12f9-4845-b6cc-905f4bf24b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdfdbe2-b4') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b769a7b-fae7-52e8-9ba3-9c118503d23d', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2bdfdbe2-b4, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2bdfdbe2-b4, col_values=(('qos', UUID('db5f09f2-fc18-4522-a52f-49ccd9fb3c95')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2bdfdbe2-b4, col_values=(('external_ids', {'iface-id': '2bdfdbe2-b457-4078-b4be-979a51ba442a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:96:f0', 'vm-uuid': '13449e5c-809b-4db2-af0b-53f5865eb3a4'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:14 user nova-compute[74898]: INFO os_vif [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:96:f0,bridge_name='br-int',has_traffic_filtering=True,id=2bdfdbe2-b457-4078-b4be-979a51ba442a,network=Network(9302cb9a-12f9-4845-b6cc-905f4bf24b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdfdbe2-b4')
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] No VIF found with MAC fa:16:3e:a1:96:f0, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.network.neutron [req-44176162-506a-4888-a580-88db7ee29c4d req-3f9c541e-5dab-4d07-9dc4-cd181023805d service nova] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Updated VIF entry in instance network info cache for port 2bdfdbe2-b457-4078-b4be-979a51ba442a. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG nova.network.neutron [req-44176162-506a-4888-a580-88db7ee29c4d req-3f9c541e-5dab-4d07-9dc4-cd181023805d service nova] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Updating instance_info_cache with network_info: [{"id": "2bdfdbe2-b457-4078-b4be-979a51ba442a", "address": "fa:16:3e:a1:96:f0", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdfdbe2-b4", "ovs_interfaceid": "2bdfdbe2-b457-4078-b4be-979a51ba442a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:07:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-44176162-506a-4888-a580-88db7ee29c4d req-3f9c541e-5dab-4d07-9dc4-cd181023805d service nova] Releasing lock "refresh_cache-13449e5c-809b-4db2-af0b-53f5865eb3a4" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:07:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:16 user nova-compute[74898]: DEBUG nova.compute.manager [req-c587463d-cf55-4981-a0ff-03f9159854d2 req-a67f56db-5001-42e3-8655-7ffe0eb6fd75 service nova] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Received event network-vif-plugged-2bdfdbe2-b457-4078-b4be-979a51ba442a {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:07:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c587463d-cf55-4981-a0ff-03f9159854d2 req-a67f56db-5001-42e3-8655-7ffe0eb6fd75 service nova] Acquiring lock "13449e5c-809b-4db2-af0b-53f5865eb3a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c587463d-cf55-4981-a0ff-03f9159854d2 req-a67f56db-5001-42e3-8655-7ffe0eb6fd75 service nova] Lock "13449e5c-809b-4db2-af0b-53f5865eb3a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c587463d-cf55-4981-a0ff-03f9159854d2 req-a67f56db-5001-42e3-8655-7ffe0eb6fd75 service nova] Lock "13449e5c-809b-4db2-af0b-53f5865eb3a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:16 user nova-compute[74898]: DEBUG nova.compute.manager [req-c587463d-cf55-4981-a0ff-03f9159854d2 req-a67f56db-5001-42e3-8655-7ffe0eb6fd75 service nova] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] No waiting events found dispatching network-vif-plugged-2bdfdbe2-b457-4078-b4be-979a51ba442a {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:07:16 user nova-compute[74898]: WARNING nova.compute.manager [req-c587463d-cf55-4981-a0ff-03f9159854d2 req-a67f56db-5001-42e3-8655-7ffe0eb6fd75 service nova] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Received unexpected event network-vif-plugged-2bdfdbe2-b457-4078-b4be-979a51ba442a for instance with vm_state building and task_state spawning.
Nov 17 03:07:16 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:16 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:16 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:16 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:07:16 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:07:17 user nova-compute[74898]: DEBUG nova.compute.manager [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:07:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:07:17 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Instance spawned successfully.
Nov 17 03:07:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:07:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:07:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:07:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:07:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:07:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:07:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:07:17 user nova-compute[74898]: INFO nova.compute.manager [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Took 5.04 seconds to spawn the instance on the hypervisor.
Nov 17 03:07:17 user nova-compute[74898]: DEBUG nova.compute.manager [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:07:17 user nova-compute[74898]: INFO nova.compute.manager [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Took 5.74 seconds to build instance.
Nov 17 03:07:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-700e2d24-61a8-46b0-b05d-17e84d086f01 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "13449e5c-809b-4db2-af0b-53f5865eb3a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.874s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:17 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:07:17 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:07:17 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:07:18 user nova-compute[74898]: DEBUG nova.compute.manager [req-314bb122-a322-43be-821e-1e7b68d0586c req-c19f7cb9-e4d4-4554-98a4-b9f6c9acd74f service nova] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Received event network-vif-plugged-2bdfdbe2-b457-4078-b4be-979a51ba442a {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:07:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-314bb122-a322-43be-821e-1e7b68d0586c req-c19f7cb9-e4d4-4554-98a4-b9f6c9acd74f service nova] Acquiring lock "13449e5c-809b-4db2-af0b-53f5865eb3a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-314bb122-a322-43be-821e-1e7b68d0586c req-c19f7cb9-e4d4-4554-98a4-b9f6c9acd74f service nova] Lock "13449e5c-809b-4db2-af0b-53f5865eb3a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-314bb122-a322-43be-821e-1e7b68d0586c req-c19f7cb9-e4d4-4554-98a4-b9f6c9acd74f service nova] Lock "13449e5c-809b-4db2-af0b-53f5865eb3a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:18 user nova-compute[74898]: DEBUG nova.compute.manager [req-314bb122-a322-43be-821e-1e7b68d0586c req-c19f7cb9-e4d4-4554-98a4-b9f6c9acd74f service nova] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] No waiting events found dispatching network-vif-plugged-2bdfdbe2-b457-4078-b4be-979a51ba442a {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:07:18 user nova-compute[74898]: WARNING nova.compute.manager [req-314bb122-a322-43be-821e-1e7b68d0586c req-c19f7cb9-e4d4-4554-98a4-b9f6c9acd74f service nova] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Received unexpected event network-vif-plugged-2bdfdbe2-b457-4078-b4be-979a51ba442a for instance with vm_state active and task_state None.
Nov 17 03:07:18 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:07:18 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:07:18 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Rebuilding the list of instances to heal {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 03:07:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:07:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:07:18 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:07:18 user nova-compute[74898]: DEBUG nova.objects.instance [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lazy-loading 'info_cache' on Instance uuid 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:07:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:19 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Updating instance_info_cache with network_info: [{"id": "78bdfbfa-3578-4ef5-b499-decd609cba62", "address": "fa:16:3e:b1:55:61", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78bdfbfa-35", "ovs_interfaceid": "78bdfbfa-3578-4ef5-b499-decd609cba62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:07:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:07:19 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:07:19 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:07:19 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:07:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:21 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:07:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:21 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:07:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.311s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:24 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:07:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:25 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:07:25 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:07:25 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=7798MB free_disk=25.487674713134766GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:07:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:25 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:07:25 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance e733574a-56ba-4e24-babd-855bcb5bda61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:07:25 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 11704034-7afe-475c-ae43-1324b40f0d92 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:07:25 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 42994e39-187a-4fb6-a293-24a4eb57177b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:07:25 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance f25ef6a9-d007-419d-8478-2a9e79d5f03a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:07:25 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance f457f5c7-58e3-4f7f-b495-6cfd3440d7dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:07:25 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 13449e5c-809b-4db2-af0b-53f5865eb3a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:07:25 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:07:25 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:07:26 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:07:26 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:07:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:07:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.440s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:27 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:07:28 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:07:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Acquiring lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:44 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:07:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:44 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:07:44 user nova-compute[74898]: INFO nova.compute.claims [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Claim successful on node user
Nov 17 03:07:45 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:07:45 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:07:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:45 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:07:45 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:07:45 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:07:45 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:07:45 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:07:45 user nova-compute[74898]: INFO nova.virt.block_device [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Booting with volume 317e439b-e336-4f22-9638-809454e990f7 at /dev/vda
Nov 17 03:07:45 user nova-compute[74898]: DEBUG nova.policy [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '633094c28d414c1fac599af2a16bc1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9e17e2cb304d88832baac8d20b6ae8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:07:45 user nova-compute[74898]: DEBUG os_brick.utils [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:07:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a94c1c-87ee-4db0-a33c-e3519e015154]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:07:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c8d6e4-1ce6-4dfe-8b5f-0561b400c807]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:07:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4bce9d-3004-435a-b022-1e89059036f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:07:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[43601bbc-916c-4fd3-be23-ec3b05052f13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:07:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:07:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:07:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:07:45 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:07:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7160419-83a5-44cf-b0a5-fc24f1fc842d]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:07:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:07:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:07:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:07:45 user nova-compute[74898]: DEBUG os_brick.utils [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:07:45 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Updating existing volume attachment record: 099f1310-83d8-4561-b70f-e49ed368c59c {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:07:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:46 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Successfully created port: 1ab100dc-5533-4676-9814-2c9ce077e75e {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:07:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:46 user nova-compute[74898]: DEBUG nova.compute.manager [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:07:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:46 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:07:46 user nova-compute[74898]: INFO nova.compute.claims [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Claim successful on node user
Nov 17 03:07:46 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:07:46 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:07:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:46 user nova-compute[74898]: DEBUG nova.compute.manager [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG nova.compute.manager [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG nova.network.neutron [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:07:47 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:07:47 user nova-compute[74898]: DEBUG nova.compute.manager [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG nova.policy [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f67341bd3d3a47698364dcfc7a7c8a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b13b86a294437da9a38ca4fd9b98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Successfully updated port: 1ab100dc-5533-4676-9814-2c9ce077e75e {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG nova.compute.manager [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:07:47 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Creating image(s)
Nov 17 03:07:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "/opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "/opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "/opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Acquiring lock "refresh_cache-e188cb77-4a1d-4cab-9b32-9e3d442bb64d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Acquired lock "refresh_cache-e188cb77-4a1d-4cab-9b32-9e3d442bb64d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG nova.compute.manager [req-5c278dee-2a23-49b7-9400-75e044704403 req-69fb1fe1-2948-48d1-8347-f8a8bb98708a service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Received event network-changed-1ab100dc-5533-4676-9814-2c9ce077e75e {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG nova.compute.manager [req-5c278dee-2a23-49b7-9400-75e044704403 req-69fb1fe1-2948-48d1-8347-f8a8bb98708a service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Refreshing instance network info cache due to event network-changed-1ab100dc-5533-4676-9814-2c9ce077e75e. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5c278dee-2a23-49b7-9400-75e044704403 req-69fb1fe1-2948-48d1-8347-f8a8bb98708a service nova] Acquiring lock "refresh_cache-e188cb77-4a1d-4cab-9b32-9e3d442bb64d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.196s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Updating instance_info_cache with network_info: [{"id": "1ab100dc-5533-4676-9814-2c9ce077e75e", "address": "fa:16:3e:15:59:1e", "network": {"id": "52b2b9ce-ab0e-4516-b46f-04f1670a5859", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349717026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e17e2cb304d88832baac8d20b6ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab100dc-55", "ovs_interfaceid": "1ab100dc-5533-4676-9814-2c9ce077e75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Releasing lock "refresh_cache-e188cb77-4a1d-4cab-9b32-9e3d442bb64d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Instance network_info: |[{"id": "1ab100dc-5533-4676-9814-2c9ce077e75e", "address": "fa:16:3e:15:59:1e", "network": {"id": "52b2b9ce-ab0e-4516-b46f-04f1670a5859", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349717026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e17e2cb304d88832baac8d20b6ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab100dc-55", "ovs_interfaceid": "1ab100dc-5533-4676-9814-2c9ce077e75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5c278dee-2a23-49b7-9400-75e044704403 req-69fb1fe1-2948-48d1-8347-f8a8bb98708a service nova] Acquired lock "refresh_cache-e188cb77-4a1d-4cab-9b32-9e3d442bb64d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG nova.network.neutron [req-5c278dee-2a23-49b7-9400-75e044704403 req-69fb1fe1-2948-48d1-8347-f8a8bb98708a service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Refreshing network info cache for port 1ab100dc-5533-4676-9814-2c9ce077e75e {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.252s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk 1073741824" returned: 0 in 0.049s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG nova.network.neutron [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Successfully created port: 89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.178s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:07:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Cannot resize image /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Ensure instance console log exists: /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG nova.network.neutron [req-5c278dee-2a23-49b7-9400-75e044704403 req-69fb1fe1-2948-48d1-8347-f8a8bb98708a service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Updated VIF entry in instance network info cache for port 1ab100dc-5533-4676-9814-2c9ce077e75e. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG nova.network.neutron [req-5c278dee-2a23-49b7-9400-75e044704403 req-69fb1fe1-2948-48d1-8347-f8a8bb98708a service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Updating instance_info_cache with network_info: [{"id": "1ab100dc-5533-4676-9814-2c9ce077e75e", "address": "fa:16:3e:15:59:1e", "network": {"id": "52b2b9ce-ab0e-4516-b46f-04f1670a5859", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349717026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e17e2cb304d88832baac8d20b6ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab100dc-55", "ovs_interfaceid": "1ab100dc-5533-4676-9814-2c9ce077e75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5c278dee-2a23-49b7-9400-75e044704403 req-69fb1fe1-2948-48d1-8347-f8a8bb98708a service nova] Releasing lock "refresh_cache-e188cb77-4a1d-4cab-9b32-9e3d442bb64d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG nova.network.neutron [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Successfully updated port: 89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "refresh_cache-c49f4ec3-6f9b-4e14-ba29-208aa026301e" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquired lock "refresh_cache-c49f4ec3-6f9b-4e14-ba29-208aa026301e" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG nova.network.neutron [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG nova.compute.manager [req-035e8f23-a5e1-4576-abf2-79ca92269e34 req-4e87faa8-0848-4f85-9f9c-486983968cec service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Received event network-changed-89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG nova.compute.manager [req-035e8f23-a5e1-4576-abf2-79ca92269e34 req-4e87faa8-0848-4f85-9f9c-486983968cec service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Refreshing instance network info cache due to event network-changed-89cfa577-9add-4c3b-81be-59ddb7e34d59. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-035e8f23-a5e1-4576-abf2-79ca92269e34 req-4e87faa8-0848-4f85-9f9c-486983968cec service nova] Acquiring lock "refresh_cache-c49f4ec3-6f9b-4e14-ba29-208aa026301e" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG nova.network.neutron [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG nova.network.neutron [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Updating instance_info_cache with network_info: [{"id": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "address": "fa:16:3e:7d:3c:56", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89cfa577-9a", "ovs_interfaceid": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Releasing lock "refresh_cache-c49f4ec3-6f9b-4e14-ba29-208aa026301e" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG nova.compute.manager [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Instance network_info: |[{"id": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "address": "fa:16:3e:7d:3c:56", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89cfa577-9a", "ovs_interfaceid": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-035e8f23-a5e1-4576-abf2-79ca92269e34 req-4e87faa8-0848-4f85-9f9c-486983968cec service nova] Acquired lock "refresh_cache-c49f4ec3-6f9b-4e14-ba29-208aa026301e" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG nova.network.neutron [req-035e8f23-a5e1-4576-abf2-79ca92269e34 req-4e87faa8-0848-4f85-9f9c-486983968cec service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Refreshing network info cache for port 89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Start _get_guest_xml network_info=[{"id": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "address": "fa:16:3e:7d:3c:56", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89cfa577-9a", "ovs_interfaceid": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:07:48 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:07:48 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:07:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:07:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:07:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-559848382',display_name='tempest-AttachVolumeTestJSON-server-559848382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-559848382',id=23,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbyIJI2eENCayym7wJaTE5mkfjBea5My/OAyGGxTUZlk7cC9WDtXyYqwoAMcoNPQD8MTCjcX10bj1aNkxQk64CCPBoHWZhGjVWIxFCC/x0O8IS9lweYLOVUWDQLxxg2Nw==',key_name='tempest-keypair-1028377093',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08b13b86a294437da9a38ca4fd9b98e1',ramdisk_id='',reservation_id='r-ctvf81kq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1097544794',owner_user_name='tempest-AttachVolumeTestJSON-1097544794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:07:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f67341bd3d3a47698364dcfc7a7c8a9a',uuid=c49f4ec3-6f9b-4e14-ba29-208aa026301e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "address": "fa:16:3e:7d:3c:56", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89cfa577-9a", "ovs_interfaceid": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:07:49 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Converting VIF {"id": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "address": "fa:16:3e:7d:3c:56", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89cfa577-9a", "ovs_interfaceid": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:07:49 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:3c:56,bridge_name='br-int',has_traffic_filtering=True,id=89cfa577-9add-4c3b-81be-59ddb7e34d59,network=Network(b4bcd1f2-7a46-421a-8979-8ba9aca50ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89cfa577-9a') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:07:49 user nova-compute[74898]: DEBUG nova.objects.instance [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'pci_devices' on Instance uuid c49f4ec3-6f9b-4e14-ba29-208aa026301e {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:07:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:07:49 user nova-compute[74898]:   <uuid>c49f4ec3-6f9b-4e14-ba29-208aa026301e</uuid>
Nov 17 03:07:49 user nova-compute[74898]:   <name>instance-00000017</name>
Nov 17 03:07:49 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:07:49 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:07:49 user nova-compute[74898]:   <metadata>
Nov 17 03:07:49 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:07:49 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:07:49 user nova-compute[74898]:       <nova:name>tempest-AttachVolumeTestJSON-server-559848382</nova:name>
Nov 17 03:07:49 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:07:48</nova:creationTime>
Nov 17 03:07:49 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:07:49 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:07:49 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:07:49 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:07:49 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:07:49 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:07:49 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:07:49 user nova-compute[74898]:       <nova:owner>
Nov 17 03:07:49 user nova-compute[74898]:         <nova:user uuid="f67341bd3d3a47698364dcfc7a7c8a9a">tempest-AttachVolumeTestJSON-1097544794-project-member</nova:user>
Nov 17 03:07:49 user nova-compute[74898]:         <nova:project uuid="08b13b86a294437da9a38ca4fd9b98e1">tempest-AttachVolumeTestJSON-1097544794</nova:project>
Nov 17 03:07:49 user nova-compute[74898]:       </nova:owner>
Nov 17 03:07:49 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:07:49 user nova-compute[74898]:       <nova:ports>
Nov 17 03:07:49 user nova-compute[74898]:         <nova:port uuid="89cfa577-9add-4c3b-81be-59ddb7e34d59">
Nov 17 03:07:49 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 17 03:07:49 user nova-compute[74898]:         </nova:port>
Nov 17 03:07:49 user nova-compute[74898]:       </nova:ports>
Nov 17 03:07:49 user nova-compute[74898]:     </nova:instance>
Nov 17 03:07:49 user nova-compute[74898]:   </metadata>
Nov 17 03:07:49 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:07:49 user nova-compute[74898]:     <system>
Nov 17 03:07:49 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:07:49 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:07:49 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:07:49 user nova-compute[74898]:       <entry name="serial">c49f4ec3-6f9b-4e14-ba29-208aa026301e</entry>
Nov 17 03:07:49 user nova-compute[74898]:       <entry name="uuid">c49f4ec3-6f9b-4e14-ba29-208aa026301e</entry>
Nov 17 03:07:49 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:07:49 user nova-compute[74898]:     </system>
Nov 17 03:07:49 user nova-compute[74898]:   </sysinfo>
Nov 17 03:07:49 user nova-compute[74898]:   <os>
Nov 17 03:07:49 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:07:49 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:07:49 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:07:49 user nova-compute[74898]:   </os>
Nov 17 03:07:49 user nova-compute[74898]:   <features>
Nov 17 03:07:49 user nova-compute[74898]:     <acpi/>
Nov 17 03:07:49 user nova-compute[74898]:     <apic/>
Nov 17 03:07:49 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:07:49 user nova-compute[74898]:   </features>
Nov 17 03:07:49 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:07:49 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:07:49 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:07:49 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:07:49 user nova-compute[74898]:   </clock>
Nov 17 03:07:49 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:07:49 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:07:49 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:07:49 user nova-compute[74898]:   </cpu>
Nov 17 03:07:49 user nova-compute[74898]:   <devices>
Nov 17 03:07:49 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:07:49 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:07:49 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk"/>
Nov 17 03:07:49 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:07:49 user nova-compute[74898]:     </disk>
Nov 17 03:07:49 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:07:49 user nova-compute[74898]:       <mac address="fa:16:3e:7d:3c:56"/>
Nov 17 03:07:49 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:07:49 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:07:49 user nova-compute[74898]:       <target dev="tap89cfa577-9a"/>
Nov 17 03:07:49 user nova-compute[74898]:     </interface>
Nov 17 03:07:49 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:07:49 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/console.log" append="off"/>
Nov 17 03:07:49 user nova-compute[74898]:     </serial>
Nov 17 03:07:49 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:07:49 user nova-compute[74898]:     <video>
Nov 17 03:07:49 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:07:49 user nova-compute[74898]:     </video>
Nov 17 03:07:49 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:07:49 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:07:49 user nova-compute[74898]:     </rng>
Nov 17 03:07:49 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:07:49 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:07:49 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:07:49 user nova-compute[74898]:     </memballoon>
Nov 17 03:07:49 user nova-compute[74898]:   </devices>
Nov 17 03:07:49 user nova-compute[74898]: </domain>
Nov 17 03:07:49 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:07:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-559848382',display_name='tempest-AttachVolumeTestJSON-server-559848382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-559848382',id=23,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbyIJI2eENCayym7wJaTE5mkfjBea5My/OAyGGxTUZlk7cC9WDtXyYqwoAMcoNPQD8MTCjcX10bj1aNkxQk64CCPBoHWZhGjVWIxFCC/x0O8IS9lweYLOVUWDQLxxg2Nw==',key_name='tempest-keypair-1028377093',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08b13b86a294437da9a38ca4fd9b98e1',ramdisk_id='',reservation_id='r-ctvf81kq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1097544794',owner_user_name='tempest-AttachVolumeTestJSON-1097544794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:07:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f67341bd3d3a47698364dcfc7a7c8a9a',uuid=c49f4ec3-6f9b-4e14-ba29-208aa026301e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "address": "fa:16:3e:7d:3c:56", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89cfa577-9a", "ovs_interfaceid": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:07:49 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Converting VIF {"id": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "address": "fa:16:3e:7d:3c:56", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89cfa577-9a", "ovs_interfaceid": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:07:49 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:3c:56,bridge_name='br-int',has_traffic_filtering=True,id=89cfa577-9add-4c3b-81be-59ddb7e34d59,network=Network(b4bcd1f2-7a46-421a-8979-8ba9aca50ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89cfa577-9a') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:07:49 user nova-compute[74898]: DEBUG os_vif [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:3c:56,bridge_name='br-int',has_traffic_filtering=True,id=89cfa577-9add-4c3b-81be-59ddb7e34d59,network=Network(b4bcd1f2-7a46-421a-8979-8ba9aca50ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89cfa577-9a') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:07:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:07:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:07:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5092eaa1-7329-5a46-b318-86d1f893c038', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:07:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:07:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89cfa577-9a, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:07:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89cfa577-9a, col_values=(('qos', UUID('4e9f8273-b160-4db1-8137-5bf327cd4529')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:07:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89cfa577-9a, col_values=(('external_ids', {'iface-id': '89cfa577-9add-4c3b-81be-59ddb7e34d59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:3c:56', 'vm-uuid': 'c49f4ec3-6f9b-4e14-ba29-208aa026301e'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:07:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:07:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:49 user nova-compute[74898]: INFO os_vif [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:3c:56,bridge_name='br-int',has_traffic_filtering=True,id=89cfa577-9add-4c3b-81be-59ddb7e34d59,network=Network(b4bcd1f2-7a46-421a-8979-8ba9aca50ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89cfa577-9a')
Nov 17 03:07:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:07:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] No VIF found with MAC fa:16:3e:7d:3c:56, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:07:49 user nova-compute[74898]: DEBUG nova.network.neutron [req-035e8f23-a5e1-4576-abf2-79ca92269e34 req-4e87faa8-0848-4f85-9f9c-486983968cec service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Updated VIF entry in instance network info cache for port 89cfa577-9add-4c3b-81be-59ddb7e34d59. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:07:49 user nova-compute[74898]: DEBUG nova.network.neutron [req-035e8f23-a5e1-4576-abf2-79ca92269e34 req-4e87faa8-0848-4f85-9f9c-486983968cec service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Updating instance_info_cache with network_info: [{"id": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "address": "fa:16:3e:7d:3c:56", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89cfa577-9a", "ovs_interfaceid": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:07:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-035e8f23-a5e1-4576-abf2-79ca92269e34 req-4e87faa8-0848-4f85-9f9c-486983968cec service nova] Releasing lock "refresh_cache-c49f4ec3-6f9b-4e14-ba29-208aa026301e" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:07:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:50 user nova-compute[74898]: DEBUG nova.compute.manager [req-967662c2-f034-47da-98a8-4c5de6c4e042 req-bd887144-e3b5-4028-adf6-8025ded0224e service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Received event network-vif-plugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:07:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-967662c2-f034-47da-98a8-4c5de6c4e042 req-bd887144-e3b5-4028-adf6-8025ded0224e service nova] Acquiring lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-967662c2-f034-47da-98a8-4c5de6c4e042 req-bd887144-e3b5-4028-adf6-8025ded0224e service nova] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-967662c2-f034-47da-98a8-4c5de6c4e042 req-bd887144-e3b5-4028-adf6-8025ded0224e service nova] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:50 user nova-compute[74898]: DEBUG nova.compute.manager [req-967662c2-f034-47da-98a8-4c5de6c4e042 req-bd887144-e3b5-4028-adf6-8025ded0224e service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] No waiting events found dispatching network-vif-plugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:07:50 user nova-compute[74898]: WARNING nova.compute.manager [req-967662c2-f034-47da-98a8-4c5de6c4e042 req-bd887144-e3b5-4028-adf6-8025ded0224e service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Received unexpected event network-vif-plugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 for instance with vm_state building and task_state spawning.
Nov 17 03:07:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:07:51 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Creating image(s)
Nov 17 03:07:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Did not create local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Ensure instance console log exists: /opt/stack/data/nova/instances/e188cb77-4a1d-4cab-9b32-9e3d442bb64d/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Start _get_guest_xml network_info=[{"id": "1ab100dc-5533-4676-9814-2c9ce077e75e", "address": "fa:16:3e:15:59:1e", "network": {"id": "52b2b9ce-ab0e-4516-b46f-04f1670a5859", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349717026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e17e2cb304d88832baac8d20b6ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab100dc-55", "ovs_interfaceid": "1ab100dc-5533-4676-9814-2c9ce077e75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgCfIaPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e188cb77-4a1d-4cab-9b32-9e3d442bb64d', 'attached_at': '', 'detached_at': '', 'volume_id': '317e439b-e336-4f22-9638-809454e990f7', 'serial': '317e439b-e336-4f22-9638-809454e990f7'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '099f1310-83d8-4561-b70f-e49ed368c59c', 'volume_type': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:07:51 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:07:51 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:07:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgCfIaPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:07:51 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:07:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:07:51 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:07:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:07:51 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:07:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd8af45-3b5d-4f36-acc2-5f245e3bf710]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:07:51 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[11750973-e982-4ae5-a402-25692854c86c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7] added
Nov 17 03:07:51 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae41beb1-f55b-4bd5-99ff-5d895739dc7b]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[97063cc5-c0fd-4547-ae16-25dcb8f7fc1d]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jgCfIaPB {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jgCfIaPB" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2c6ae1-0488-4f23-bc20-0d0be35ce9d4]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jgCfIaPB'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[feff12ce-ae62-4093-8d5b-05e22d8dda76]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[836b9720-40ef-4e59-8e3b-20b0de0923fc]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:07:51 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:07:51 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:07:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[36956c1d-2f5b-43cb-a320-1d148fd0469b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:07:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7, portal: 172.16.0.220,3260]
Nov 17 03:07:52 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7, portal: 172.16.0.220,3260] successful.
Nov 17 03:07:52 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:07:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[105f47ac-cf41-4dd2-b7af-9f4b817f66e2]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:07:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:07:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e8c015-18cc-4196-be8d-b8d5d9e6a1f2]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:07:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:07:52 user nova-compute[74898]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:07:52 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:07:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:07:52 user nova-compute[74898]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:07:52 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:07:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:07:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:07:52 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:07:52 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:07:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fb2dc4-8251-4707-a1f3-bc4d18f08b91]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:07:52 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:07:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgCfIaPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:07:52 user nova-compute[74898]: DEBUG nova.compute.manager [req-621e3fde-6867-42b7-87a9-cddfc6223dab req-b94fc54c-d36b-4b74-a86c-53df19f7c08b service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Received event network-vif-plugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:07:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-621e3fde-6867-42b7-87a9-cddfc6223dab req-b94fc54c-d36b-4b74-a86c-53df19f7c08b service nova] Acquiring lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-621e3fde-6867-42b7-87a9-cddfc6223dab req-b94fc54c-d36b-4b74-a86c-53df19f7c08b service nova] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-621e3fde-6867-42b7-87a9-cddfc6223dab req-b94fc54c-d36b-4b74-a86c-53df19f7c08b service nova] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:52 user nova-compute[74898]: DEBUG nova.compute.manager [req-621e3fde-6867-42b7-87a9-cddfc6223dab req-b94fc54c-d36b-4b74-a86c-53df19f7c08b service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] No waiting events found dispatching network-vif-plugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:07:52 user nova-compute[74898]: WARNING nova.compute.manager [req-621e3fde-6867-42b7-87a9-cddfc6223dab req-b94fc54c-d36b-4b74-a86c-53df19f7c08b service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Received unexpected event network-vif-plugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 for instance with vm_state building and task_state spawning.
Nov 17 03:07:52 user nova-compute[74898]: DEBUG nova.compute.manager [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:07:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:07:52 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Instance spawned successfully.
Nov 17 03:07:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:07:53 user nova-compute[74898]: INFO nova.compute.manager [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Took 5.92 seconds to spawn the instance on the hypervisor.
Nov 17 03:07:53 user nova-compute[74898]: DEBUG nova.compute.manager [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23262363462313037', 'path': '/dev/sdb'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262363462313037', 'path': '/dev/sdb'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:07:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-438225612',display_name='tempest-TestShelveInstance-server-438225612',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-438225612',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDmSd2NGubOcYAcKcy9vf9FFiaZ53lvPXbeSEL0PYEMFkGQuwJsRdb52jAzPICFCNpjRnvRgeRQ61dhOkF/dPmPwKEFLeDVySR2pJ9NtHk/FzrMRYBMjdFKARvsHGoSKg==',key_name='tempest-TestShelveInstance-1240625614',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c9e17e2cb304d88832baac8d20b6ae8',ramdisk_id='',reservation_id='r-6x3ptz5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-440551976',owner_user_name='tempest-TestShelveInstance-440551976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:07:45Z,user_data=None,user_id='633094c28d414c1fac599af2a16bc1f6',uuid=e188cb77-4a1d-4cab-9b32-9e3d442bb64d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ab100dc-5533-4676-9814-2c9ce077e75e", "address": "fa:16:3e:15:59:1e", "network": {"id": "52b2b9ce-ab0e-4516-b46f-04f1670a5859", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349717026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e17e2cb304d88832baac8d20b6ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab100dc-55", "ovs_interfaceid": "1ab100dc-5533-4676-9814-2c9ce077e75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Converting VIF {"id": "1ab100dc-5533-4676-9814-2c9ce077e75e", "address": "fa:16:3e:15:59:1e", "network": {"id": "52b2b9ce-ab0e-4516-b46f-04f1670a5859", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349717026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e17e2cb304d88832baac8d20b6ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab100dc-55", "ovs_interfaceid": "1ab100dc-5533-4676-9814-2c9ce077e75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:59:1e,bridge_name='br-int',has_traffic_filtering=True,id=1ab100dc-5533-4676-9814-2c9ce077e75e,network=Network(52b2b9ce-ab0e-4516-b46f-04f1670a5859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ab100dc-55') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG nova.objects.instance [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lazy-loading 'pci_devices' on Instance uuid e188cb77-4a1d-4cab-9b32-9e3d442bb64d {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:07:53 user nova-compute[74898]: INFO nova.compute.manager [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Took 6.85 seconds to build instance.
Nov 17 03:07:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:07:53 user nova-compute[74898]:   <uuid>e188cb77-4a1d-4cab-9b32-9e3d442bb64d</uuid>
Nov 17 03:07:53 user nova-compute[74898]:   <name>instance-00000016</name>
Nov 17 03:07:53 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:07:53 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:07:53 user nova-compute[74898]:   <metadata>
Nov 17 03:07:53 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:07:53 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:07:53 user nova-compute[74898]:       <nova:name>tempest-TestShelveInstance-server-438225612</nova:name>
Nov 17 03:07:53 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:07:51</nova:creationTime>
Nov 17 03:07:53 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:07:53 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:07:53 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:07:53 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:07:53 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:07:53 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:07:53 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:07:53 user nova-compute[74898]:       <nova:owner>
Nov 17 03:07:53 user nova-compute[74898]:         <nova:user uuid="633094c28d414c1fac599af2a16bc1f6">tempest-TestShelveInstance-440551976-project-member</nova:user>
Nov 17 03:07:53 user nova-compute[74898]:         <nova:project uuid="3c9e17e2cb304d88832baac8d20b6ae8">tempest-TestShelveInstance-440551976</nova:project>
Nov 17 03:07:53 user nova-compute[74898]:       </nova:owner>
Nov 17 03:07:53 user nova-compute[74898]:       <nova:ports>
Nov 17 03:07:53 user nova-compute[74898]:         <nova:port uuid="1ab100dc-5533-4676-9814-2c9ce077e75e">
Nov 17 03:07:53 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 17 03:07:53 user nova-compute[74898]:         </nova:port>
Nov 17 03:07:53 user nova-compute[74898]:       </nova:ports>
Nov 17 03:07:53 user nova-compute[74898]:     </nova:instance>
Nov 17 03:07:53 user nova-compute[74898]:   </metadata>
Nov 17 03:07:53 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:07:53 user nova-compute[74898]:     <system>
Nov 17 03:07:53 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:07:53 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:07:53 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:07:53 user nova-compute[74898]:       <entry name="serial">e188cb77-4a1d-4cab-9b32-9e3d442bb64d</entry>
Nov 17 03:07:53 user nova-compute[74898]:       <entry name="uuid">e188cb77-4a1d-4cab-9b32-9e3d442bb64d</entry>
Nov 17 03:07:53 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:07:53 user nova-compute[74898]:     </system>
Nov 17 03:07:53 user nova-compute[74898]:   </sysinfo>
Nov 17 03:07:53 user nova-compute[74898]:   <os>
Nov 17 03:07:53 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:07:53 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:07:53 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:07:53 user nova-compute[74898]:   </os>
Nov 17 03:07:53 user nova-compute[74898]:   <features>
Nov 17 03:07:53 user nova-compute[74898]:     <acpi/>
Nov 17 03:07:53 user nova-compute[74898]:     <apic/>
Nov 17 03:07:53 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:07:53 user nova-compute[74898]:   </features>
Nov 17 03:07:53 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:07:53 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:07:53 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:07:53 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:07:53 user nova-compute[74898]:   </clock>
Nov 17 03:07:53 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:07:53 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:07:53 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:07:53 user nova-compute[74898]:   </cpu>
Nov 17 03:07:53 user nova-compute[74898]:   <devices>
Nov 17 03:07:53 user nova-compute[74898]:     <disk type="block" device="disk">
Nov 17 03:07:53 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:07:53 user nova-compute[74898]:       <source dev="/dev/sdb"/>
Nov 17 03:07:53 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:07:53 user nova-compute[74898]:       <serial>317e439b-e336-4f22-9638-809454e990f7</serial>
Nov 17 03:07:53 user nova-compute[74898]:     </disk>
Nov 17 03:07:53 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:07:53 user nova-compute[74898]:       <mac address="fa:16:3e:15:59:1e"/>
Nov 17 03:07:53 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:07:53 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:07:53 user nova-compute[74898]:       <target dev="tap1ab100dc-55"/>
Nov 17 03:07:53 user nova-compute[74898]:     </interface>
Nov 17 03:07:53 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:07:53 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/e188cb77-4a1d-4cab-9b32-9e3d442bb64d/console.log" append="off"/>
Nov 17 03:07:53 user nova-compute[74898]:     </serial>
Nov 17 03:07:53 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:07:53 user nova-compute[74898]:     <video>
Nov 17 03:07:53 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:07:53 user nova-compute[74898]:     </video>
Nov 17 03:07:53 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:07:53 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:07:53 user nova-compute[74898]:     </rng>
Nov 17 03:07:53 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:07:53 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:07:53 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:07:53 user nova-compute[74898]:     </memballoon>
Nov 17 03:07:53 user nova-compute[74898]:   </devices>
Nov 17 03:07:53 user nova-compute[74898]: </domain>
Nov 17 03:07:53 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:07:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-438225612',display_name='tempest-TestShelveInstance-server-438225612',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-438225612',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDmSd2NGubOcYAcKcy9vf9FFiaZ53lvPXbeSEL0PYEMFkGQuwJsRdb52jAzPICFCNpjRnvRgeRQ61dhOkF/dPmPwKEFLeDVySR2pJ9NtHk/FzrMRYBMjdFKARvsHGoSKg==',key_name='tempest-TestShelveInstance-1240625614',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c9e17e2cb304d88832baac8d20b6ae8',ramdisk_id='',reservation_id='r-6x3ptz5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-440551976',owner_user_name='tempest-TestShelveInstance-440551976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:07:45Z,user_data=None,user_id='633094c28d414c1fac599af2a16bc1f6',uuid=e188cb77-4a1d-4cab-9b32-9e3d442bb64d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ab100dc-5533-4676-9814-2c9ce077e75e", "address": "fa:16:3e:15:59:1e", "network": {"id": "52b2b9ce-ab0e-4516-b46f-04f1670a5859", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349717026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e17e2cb304d88832baac8d20b6ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab100dc-55", "ovs_interfaceid": "1ab100dc-5533-4676-9814-2c9ce077e75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Converting VIF {"id": "1ab100dc-5533-4676-9814-2c9ce077e75e", "address": "fa:16:3e:15:59:1e", "network": {"id": "52b2b9ce-ab0e-4516-b46f-04f1670a5859", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349717026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e17e2cb304d88832baac8d20b6ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab100dc-55", "ovs_interfaceid": "1ab100dc-5533-4676-9814-2c9ce077e75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:59:1e,bridge_name='br-int',has_traffic_filtering=True,id=1ab100dc-5533-4676-9814-2c9ce077e75e,network=Network(52b2b9ce-ab0e-4516-b46f-04f1670a5859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ab100dc-55') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG os_vif [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:59:1e,bridge_name='br-int',has_traffic_filtering=True,id=1ab100dc-5533-4676-9814-2c9ce077e75e,network=Network(52b2b9ce-ab0e-4516-b46f-04f1670a5859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ab100dc-55') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4dc64343-1e3f-5781-bbc0-d1cfaf4ec410', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d4622c44-631f-4f49-b8fa-a8c2a2915c6e tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.953s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ab100dc-55, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1ab100dc-55, col_values=(('qos', UUID('67ba565f-2f90-4cff-a3c3-3694c7e820cc')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1ab100dc-55, col_values=(('external_ids', {'iface-id': '1ab100dc-5533-4676-9814-2c9ce077e75e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:59:1e', 'vm-uuid': 'e188cb77-4a1d-4cab-9b32-9e3d442bb64d'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:53 user nova-compute[74898]: INFO os_vif [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:59:1e,bridge_name='br-int',has_traffic_filtering=True,id=1ab100dc-5533-4676-9814-2c9ce077e75e,network=Network(52b2b9ce-ab0e-4516-b46f-04f1670a5859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ab100dc-55')
Nov 17 03:07:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] No VIF found with MAC fa:16:3e:15:59:1e, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG nova.compute.manager [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:53 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:07:53 user nova-compute[74898]: INFO nova.compute.claims [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Claim successful on node user
Nov 17 03:07:54 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:07:54 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:07:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.556s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:54 user nova-compute[74898]: DEBUG nova.compute.manager [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:07:54 user nova-compute[74898]: DEBUG nova.compute.manager [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:07:54 user nova-compute[74898]: DEBUG nova.network.neutron [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:07:54 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:07:54 user nova-compute[74898]: DEBUG nova.compute.manager [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:07:54 user nova-compute[74898]: DEBUG nova.policy [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '303dca207b5f4da297e8ab1fc41ff466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ccd434df9e458f80e5524c5c4c7a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:07:54 user nova-compute[74898]: DEBUG nova.compute.manager [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:07:54 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:07:54 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Creating image(s)
Nov 17 03:07:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "/opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "/opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "/opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.284s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG nova.compute.manager [req-0b3c43b9-0347-4c3a-aaa8-9ca7688fb1db req-ce7cf98b-6420-4032-8dfa-56a1cea4f746 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Received event network-vif-plugged-1ab100dc-5533-4676-9814-2c9ce077e75e {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0b3c43b9-0347-4c3a-aaa8-9ca7688fb1db req-ce7cf98b-6420-4032-8dfa-56a1cea4f746 service nova] Acquiring lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0b3c43b9-0347-4c3a-aaa8-9ca7688fb1db req-ce7cf98b-6420-4032-8dfa-56a1cea4f746 service nova] Lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0b3c43b9-0347-4c3a-aaa8-9ca7688fb1db req-ce7cf98b-6420-4032-8dfa-56a1cea4f746 service nova] Lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG nova.compute.manager [req-0b3c43b9-0347-4c3a-aaa8-9ca7688fb1db req-ce7cf98b-6420-4032-8dfa-56a1cea4f746 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] No waiting events found dispatching network-vif-plugged-1ab100dc-5533-4676-9814-2c9ce077e75e {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:07:55 user nova-compute[74898]: WARNING nova.compute.manager [req-0b3c43b9-0347-4c3a-aaa8-9ca7688fb1db req-ce7cf98b-6420-4032-8dfa-56a1cea4f746 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Received unexpected event network-vif-plugged-1ab100dc-5533-4676-9814-2c9ce077e75e for instance with vm_state building and task_state spawning.
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.263s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk 1073741824" returned: 0 in 0.075s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.353s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "dbaabab0-92f0-480d-8f81-0db980c8f333" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "dbaabab0-92f0-480d-8f81-0db980c8f333" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.004s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:55 user nova-compute[74898]: INFO nova.compute.manager [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Unshelving
Nov 17 03:07:55 user nova-compute[74898]: INFO nova.virt.block_device [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Booting with volume 8d24908f-8f15-470a-9a16-bbb3ab658329 at /dev/vdc
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.264s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG os_brick.utils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[28af7baa-b1bc-4690-8a7e-a89f89a7ccb2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG nova.network.neutron [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Successfully created port: 423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c862f98-373c-46fe-992e-147e57022bf8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9138ba6-f24e-4b06-a574-c2d2c2436adf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1823d47b-1607-4dbd-9e8c-0f27a8aea786]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:07:55 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5da275-59b5-46ad-83ef-45a26163f6ff]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG os_brick.utils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Updating existing volume attachment record: 49fb14ff-0fee-48d8-a454-f9cb7a0d07e6 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Cannot resize image /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Ensure instance console log exists: /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:56 user nova-compute[74898]: DEBUG nova.network.neutron [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Successfully updated port: 423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:07:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "refresh_cache-a92bce56-1038-4762-9c1e-19b5a7ff8cef" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:07:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquired lock "refresh_cache-a92bce56-1038-4762-9c1e-19b5a7ff8cef" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:07:56 user nova-compute[74898]: DEBUG nova.network.neutron [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:07:56 user nova-compute[74898]: DEBUG nova.compute.manager [req-0582852d-e4f8-4a9d-847e-9a34741696a3 req-465ffaa3-66f4-49b5-bc1f-2d4e2f9b75b6 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Received event network-changed-423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:07:56 user nova-compute[74898]: DEBUG nova.compute.manager [req-0582852d-e4f8-4a9d-847e-9a34741696a3 req-465ffaa3-66f4-49b5-bc1f-2d4e2f9b75b6 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Refreshing instance network info cache due to event network-changed-423e9165-99d6-4938-a3dc-3406806ce781. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:07:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0582852d-e4f8-4a9d-847e-9a34741696a3 req-465ffaa3-66f4-49b5-bc1f-2d4e2f9b75b6 service nova] Acquiring lock "refresh_cache-a92bce56-1038-4762-9c1e-19b5a7ff8cef" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:07:56 user nova-compute[74898]: DEBUG nova.network.neutron [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:07:56 user nova-compute[74898]: DEBUG nova.network.neutron [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Updating instance_info_cache with network_info: [{"id": "423e9165-99d6-4938-a3dc-3406806ce781", "address": "fa:16:3e:4a:ec:b4", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423e9165-99", "ovs_interfaceid": "423e9165-99d6-4938-a3dc-3406806ce781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Releasing lock "refresh_cache-a92bce56-1038-4762-9c1e-19b5a7ff8cef" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.compute.manager [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Instance network_info: |[{"id": "423e9165-99d6-4938-a3dc-3406806ce781", "address": "fa:16:3e:4a:ec:b4", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423e9165-99", "ovs_interfaceid": "423e9165-99d6-4938-a3dc-3406806ce781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0582852d-e4f8-4a9d-847e-9a34741696a3 req-465ffaa3-66f4-49b5-bc1f-2d4e2f9b75b6 service nova] Acquired lock "refresh_cache-a92bce56-1038-4762-9c1e-19b5a7ff8cef" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.network.neutron [req-0582852d-e4f8-4a9d-847e-9a34741696a3 req-465ffaa3-66f4-49b5-bc1f-2d4e2f9b75b6 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Refreshing network info cache for port 423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Start _get_guest_xml network_info=[{"id": "423e9165-99d6-4938-a3dc-3406806ce781", "address": "fa:16:3e:4a:ec:b4", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423e9165-99", "ovs_interfaceid": "423e9165-99d6-4938-a3dc-3406806ce781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:07:57 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:07:57 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:07:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-436984245',display_name='tempest-ServerRescueNegativeTestJSON-server-436984245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-436984245',id=24,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECdizGtive531FjE2lZPMidnS/5ohxOOHxeXR9JjL6+VkYLAxgcvmUVOdOq4w6BoU/42JviUPgFmvEUcflkqWaC438sZsa2QOwDlY96HCWN/5Qo9TFTt9fnEk6JUrhY6A==',key_name='tempest-keypair-56723668',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9ccd434df9e458f80e5524c5c4c7a1f',ramdisk_id='',reservation_id='r-k8x0ez55',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1788589536',owner_user_name='tempest-ServerRescueNegativeTestJSON-1788589536-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:07:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='303dca207b5f4da297e8ab1fc41ff466',uuid=a92bce56-1038-4762-9c1e-19b5a7ff8cef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "423e9165-99d6-4938-a3dc-3406806ce781", "address": "fa:16:3e:4a:ec:b4", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423e9165-99", "ovs_interfaceid": "423e9165-99d6-4938-a3dc-3406806ce781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Converting VIF {"id": "423e9165-99d6-4938-a3dc-3406806ce781", "address": "fa:16:3e:4a:ec:b4", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423e9165-99", "ovs_interfaceid": "423e9165-99d6-4938-a3dc-3406806ce781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ec:b4,bridge_name='br-int',has_traffic_filtering=True,id=423e9165-99d6-4938-a3dc-3406806ce781,network=Network(c153042b-16a0-4676-b024-f4583be62f74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap423e9165-99') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.objects.instance [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lazy-loading 'pci_devices' on Instance uuid a92bce56-1038-4762-9c1e-19b5a7ff8cef {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:07:57 user nova-compute[74898]:   <uuid>a92bce56-1038-4762-9c1e-19b5a7ff8cef</uuid>
Nov 17 03:07:57 user nova-compute[74898]:   <name>instance-00000018</name>
Nov 17 03:07:57 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:07:57 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:07:57 user nova-compute[74898]:   <metadata>
Nov 17 03:07:57 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:07:57 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:07:57 user nova-compute[74898]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-436984245</nova:name>
Nov 17 03:07:57 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:07:57</nova:creationTime>
Nov 17 03:07:57 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:07:57 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:07:57 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:07:57 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:07:57 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:07:57 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:07:57 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:07:57 user nova-compute[74898]:       <nova:owner>
Nov 17 03:07:57 user nova-compute[74898]:         <nova:user uuid="303dca207b5f4da297e8ab1fc41ff466">tempest-ServerRescueNegativeTestJSON-1788589536-project-member</nova:user>
Nov 17 03:07:57 user nova-compute[74898]:         <nova:project uuid="f9ccd434df9e458f80e5524c5c4c7a1f">tempest-ServerRescueNegativeTestJSON-1788589536</nova:project>
Nov 17 03:07:57 user nova-compute[74898]:       </nova:owner>
Nov 17 03:07:57 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:07:57 user nova-compute[74898]:       <nova:ports>
Nov 17 03:07:57 user nova-compute[74898]:         <nova:port uuid="423e9165-99d6-4938-a3dc-3406806ce781">
Nov 17 03:07:57 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 17 03:07:57 user nova-compute[74898]:         </nova:port>
Nov 17 03:07:57 user nova-compute[74898]:       </nova:ports>
Nov 17 03:07:57 user nova-compute[74898]:     </nova:instance>
Nov 17 03:07:57 user nova-compute[74898]:   </metadata>
Nov 17 03:07:57 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:07:57 user nova-compute[74898]:     <system>
Nov 17 03:07:57 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:07:57 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:07:57 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:07:57 user nova-compute[74898]:       <entry name="serial">a92bce56-1038-4762-9c1e-19b5a7ff8cef</entry>
Nov 17 03:07:57 user nova-compute[74898]:       <entry name="uuid">a92bce56-1038-4762-9c1e-19b5a7ff8cef</entry>
Nov 17 03:07:57 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:07:57 user nova-compute[74898]:     </system>
Nov 17 03:07:57 user nova-compute[74898]:   </sysinfo>
Nov 17 03:07:57 user nova-compute[74898]:   <os>
Nov 17 03:07:57 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:07:57 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:07:57 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:07:57 user nova-compute[74898]:   </os>
Nov 17 03:07:57 user nova-compute[74898]:   <features>
Nov 17 03:07:57 user nova-compute[74898]:     <acpi/>
Nov 17 03:07:57 user nova-compute[74898]:     <apic/>
Nov 17 03:07:57 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:07:57 user nova-compute[74898]:   </features>
Nov 17 03:07:57 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:07:57 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:07:57 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:07:57 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:07:57 user nova-compute[74898]:   </clock>
Nov 17 03:07:57 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:07:57 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:07:57 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:07:57 user nova-compute[74898]:   </cpu>
Nov 17 03:07:57 user nova-compute[74898]:   <devices>
Nov 17 03:07:57 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:07:57 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:07:57 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk"/>
Nov 17 03:07:57 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:07:57 user nova-compute[74898]:     </disk>
Nov 17 03:07:57 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:07:57 user nova-compute[74898]:       <mac address="fa:16:3e:4a:ec:b4"/>
Nov 17 03:07:57 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:07:57 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:07:57 user nova-compute[74898]:       <target dev="tap423e9165-99"/>
Nov 17 03:07:57 user nova-compute[74898]:     </interface>
Nov 17 03:07:57 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:07:57 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/console.log" append="off"/>
Nov 17 03:07:57 user nova-compute[74898]:     </serial>
Nov 17 03:07:57 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:07:57 user nova-compute[74898]:     <video>
Nov 17 03:07:57 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:07:57 user nova-compute[74898]:     </video>
Nov 17 03:07:57 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:07:57 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:07:57 user nova-compute[74898]:     </rng>
Nov 17 03:07:57 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:07:57 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:07:57 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:07:57 user nova-compute[74898]:     </memballoon>
Nov 17 03:07:57 user nova-compute[74898]:   </devices>
Nov 17 03:07:57 user nova-compute[74898]: </domain>
Nov 17 03:07:57 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:07:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-436984245',display_name='tempest-ServerRescueNegativeTestJSON-server-436984245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-436984245',id=24,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECdizGtive531FjE2lZPMidnS/5ohxOOHxeXR9JjL6+VkYLAxgcvmUVOdOq4w6BoU/42JviUPgFmvEUcflkqWaC438sZsa2QOwDlY96HCWN/5Qo9TFTt9fnEk6JUrhY6A==',key_name='tempest-keypair-56723668',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9ccd434df9e458f80e5524c5c4c7a1f',ramdisk_id='',reservation_id='r-k8x0ez55',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1788589536',owner_user_name='tempest-ServerRescueNegativeTestJSON-1788589536-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:07:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='303dca207b5f4da297e8ab1fc41ff466',uuid=a92bce56-1038-4762-9c1e-19b5a7ff8cef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "423e9165-99d6-4938-a3dc-3406806ce781", "address": "fa:16:3e:4a:ec:b4", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423e9165-99", "ovs_interfaceid": "423e9165-99d6-4938-a3dc-3406806ce781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Converting VIF {"id": "423e9165-99d6-4938-a3dc-3406806ce781", "address": "fa:16:3e:4a:ec:b4", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423e9165-99", "ovs_interfaceid": "423e9165-99d6-4938-a3dc-3406806ce781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ec:b4,bridge_name='br-int',has_traffic_filtering=True,id=423e9165-99d6-4938-a3dc-3406806ce781,network=Network(c153042b-16a0-4676-b024-f4583be62f74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap423e9165-99') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG os_vif [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ec:b4,bridge_name='br-int',has_traffic_filtering=True,id=423e9165-99d6-4938-a3dc-3406806ce781,network=Network(c153042b-16a0-4676-b024-f4583be62f74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap423e9165-99') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e9ed99f7-1aaf-5cdb-816f-5b980efe81a9', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap423e9165-99, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap423e9165-99, col_values=(('qos', UUID('000b9a0f-900a-4143-9271-234737c70cac')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap423e9165-99, col_values=(('external_ids', {'iface-id': '423e9165-99d6-4938-a3dc-3406806ce781', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:ec:b4', 'vm-uuid': 'a92bce56-1038-4762-9c1e-19b5a7ff8cef'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:57 user nova-compute[74898]: INFO os_vif [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ec:b4,bridge_name='br-int',has_traffic_filtering=True,id=423e9165-99d6-4938-a3dc-3406806ce781,network=Network(c153042b-16a0-4676-b024-f4583be62f74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap423e9165-99')
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] No VIF found with MAC fa:16:3e:4a:ec:b4, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.compute.manager [req-c74b629c-d4a0-49f6-99b2-3e04c20bac98 req-62b8d87a-75c5-4486-a2c6-05467de625c3 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Received event network-vif-plugged-1ab100dc-5533-4676-9814-2c9ce077e75e {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c74b629c-d4a0-49f6-99b2-3e04c20bac98 req-62b8d87a-75c5-4486-a2c6-05467de625c3 service nova] Acquiring lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c74b629c-d4a0-49f6-99b2-3e04c20bac98 req-62b8d87a-75c5-4486-a2c6-05467de625c3 service nova] Lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c74b629c-d4a0-49f6-99b2-3e04c20bac98 req-62b8d87a-75c5-4486-a2c6-05467de625c3 service nova] Lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.compute.manager [req-c74b629c-d4a0-49f6-99b2-3e04c20bac98 req-62b8d87a-75c5-4486-a2c6-05467de625c3 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] No waiting events found dispatching network-vif-plugged-1ab100dc-5533-4676-9814-2c9ce077e75e {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:07:57 user nova-compute[74898]: WARNING nova.compute.manager [req-c74b629c-d4a0-49f6-99b2-3e04c20bac98 req-62b8d87a-75c5-4486-a2c6-05467de625c3 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Received unexpected event network-vif-plugged-1ab100dc-5533-4676-9814-2c9ce077e75e for instance with vm_state building and task_state spawning.
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:07:57 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Instance spawned successfully.
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.network.neutron [req-0582852d-e4f8-4a9d-847e-9a34741696a3 req-465ffaa3-66f4-49b5-bc1f-2d4e2f9b75b6 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Updated VIF entry in instance network info cache for port 423e9165-99d6-4938-a3dc-3406806ce781. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.network.neutron [req-0582852d-e4f8-4a9d-847e-9a34741696a3 req-465ffaa3-66f4-49b5-bc1f-2d4e2f9b75b6 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Updating instance_info_cache with network_info: [{"id": "423e9165-99d6-4938-a3dc-3406806ce781", "address": "fa:16:3e:4a:ec:b4", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423e9165-99", "ovs_interfaceid": "423e9165-99d6-4938-a3dc-3406806ce781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:07:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0582852d-e4f8-4a9d-847e-9a34741696a3 req-465ffaa3-66f4-49b5-bc1f-2d4e2f9b75b6 service nova] Releasing lock "refresh_cache-a92bce56-1038-4762-9c1e-19b5a7ff8cef" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:07:57 user nova-compute[74898]: INFO nova.compute.manager [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Took 5.88 seconds to spawn the instance on the hypervisor.
Nov 17 03:07:57 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:07:57 user nova-compute[74898]: INFO nova.compute.manager [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Took 12.91 seconds to build instance.
Nov 17 03:07:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e4378634-d32a-40ca-843f-bb8f54e87f19 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.006s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:07:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-bdff8835-e5f5-4d0d-85d0-866daebbe3de req-2ce3f065-426b-4db9-b5cf-10b8dda740e8 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Received event network-vif-plugged-423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:07:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-bdff8835-e5f5-4d0d-85d0-866daebbe3de req-2ce3f065-426b-4db9-b5cf-10b8dda740e8 service nova] Acquiring lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:07:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-bdff8835-e5f5-4d0d-85d0-866daebbe3de req-2ce3f065-426b-4db9-b5cf-10b8dda740e8 service nova] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:07:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-bdff8835-e5f5-4d0d-85d0-866daebbe3de req-2ce3f065-426b-4db9-b5cf-10b8dda740e8 service nova] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:07:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-bdff8835-e5f5-4d0d-85d0-866daebbe3de req-2ce3f065-426b-4db9-b5cf-10b8dda740e8 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] No waiting events found dispatching network-vif-plugged-423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:07:59 user nova-compute[74898]: WARNING nova.compute.manager [req-bdff8835-e5f5-4d0d-85d0-866daebbe3de req-2ce3f065-426b-4db9-b5cf-10b8dda740e8 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Received unexpected event network-vif-plugged-423e9165-99d6-4938-a3dc-3406806ce781 for instance with vm_state building and task_state spawning.
Nov 17 03:08:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquiring lock "11704034-7afe-475c-ae43-1324b40f0d92" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:08:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "11704034-7afe-475c-ae43-1324b40f0d92" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:08:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquiring lock "11704034-7afe-475c-ae43-1324b40f0d92-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:08:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:08:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:08:01 user nova-compute[74898]: INFO nova.compute.manager [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Terminating instance
Nov 17 03:08:01 user nova-compute[74898]: DEBUG nova.compute.manager [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:08:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:01 user nova-compute[74898]: DEBUG nova.compute.manager [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:08:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:08:01 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Instance spawned successfully.
Nov 17 03:08:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:08:01 user nova-compute[74898]: DEBUG nova.compute.manager [req-5a2f449b-ec25-4d64-82b6-52c0778bf732 req-f9cfd7b6-ef17-4913-a225-b876ab1e1444 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Received event network-vif-plugged-423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:08:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5a2f449b-ec25-4d64-82b6-52c0778bf732 req-f9cfd7b6-ef17-4913-a225-b876ab1e1444 service nova] Acquiring lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:08:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5a2f449b-ec25-4d64-82b6-52c0778bf732 req-f9cfd7b6-ef17-4913-a225-b876ab1e1444 service nova] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:08:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5a2f449b-ec25-4d64-82b6-52c0778bf732 req-f9cfd7b6-ef17-4913-a225-b876ab1e1444 service nova] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:08:01 user nova-compute[74898]: DEBUG nova.compute.manager [req-5a2f449b-ec25-4d64-82b6-52c0778bf732 req-f9cfd7b6-ef17-4913-a225-b876ab1e1444 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] No waiting events found dispatching network-vif-plugged-423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:08:01 user nova-compute[74898]: WARNING nova.compute.manager [req-5a2f449b-ec25-4d64-82b6-52c0778bf732 req-f9cfd7b6-ef17-4913-a225-b876ab1e1444 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Received unexpected event network-vif-plugged-423e9165-99d6-4938-a3dc-3406806ce781 for instance with vm_state building and task_state spawning.
Nov 17 03:08:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:08:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:08:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:08:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:08:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:08:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:08:01 user nova-compute[74898]: DEBUG nova.compute.manager [req-ae3bfcf2-fcbd-4ebe-9a75-fccc6fc07ca9 req-9ff52173-199d-49ca-8e1d-1394a9850de8 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received event network-vif-unplugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:08:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ae3bfcf2-fcbd-4ebe-9a75-fccc6fc07ca9 req-9ff52173-199d-49ca-8e1d-1394a9850de8 service nova] Acquiring lock "11704034-7afe-475c-ae43-1324b40f0d92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:08:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ae3bfcf2-fcbd-4ebe-9a75-fccc6fc07ca9 req-9ff52173-199d-49ca-8e1d-1394a9850de8 service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:08:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ae3bfcf2-fcbd-4ebe-9a75-fccc6fc07ca9 req-9ff52173-199d-49ca-8e1d-1394a9850de8 service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:08:01 user nova-compute[74898]: DEBUG nova.compute.manager [req-ae3bfcf2-fcbd-4ebe-9a75-fccc6fc07ca9 req-9ff52173-199d-49ca-8e1d-1394a9850de8 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] No waiting events found dispatching network-vif-unplugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:08:01 user nova-compute[74898]: DEBUG nova.compute.manager [req-ae3bfcf2-fcbd-4ebe-9a75-fccc6fc07ca9 req-9ff52173-199d-49ca-8e1d-1394a9850de8 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received event network-vif-unplugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:08:01 user nova-compute[74898]: INFO nova.compute.manager [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Took 6.93 seconds to spawn the instance on the hypervisor.
Nov 17 03:08:01 user nova-compute[74898]: DEBUG nova.compute.manager [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:08:01 user nova-compute[74898]: INFO nova.compute.manager [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Took 7.96 seconds to build instance.
Nov 17 03:08:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-1c92b24d-f00b-4e11-b71e-e710c8e2e5b6 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.100s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:08:02 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Instance destroyed successfully.
Nov 17 03:08:02 user nova-compute[74898]: DEBUG nova.objects.instance [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lazy-loading 'resources' on Instance uuid 11704034-7afe-475c-ae43-1324b40f0d92 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2234992',display_name='tempest-ServerActionsTestOtherB-server-2234992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2234992',id=4,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDa4qtus/f7IjtzuxUsFF91hKDL1YzX3TcJUCEJl5/APKTelpFkHRN746k1MAjDCvCv80GeN8KM6dto88zEniSlfqFbxPMUk2N38IhkUm1HO5g3tqYF+QbpzM60KAg8lAA==',key_name='tempest-keypair-562322790',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:05:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b79304b161b748c4b105640273979318',ramdisk_id='',reservation_id='r-p8pu7pmp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1831504115',owner_user_name='tempest-ServerActionsTestOtherB-1831504115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:05:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92e234cf0f444581b2fa827b116959aa',uuid=11704034-7afe-475c-ae43-1324b40f0d92,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "address": "fa:16:3e:98:61:d2", "network": {"id": "ff76f13f-ae63-4dd0-a219-894c6ae65c00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1502020482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b79304b161b748c4b105640273979318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d1282-04", "ovs_interfaceid": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Converting VIF {"id": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "address": "fa:16:3e:98:61:d2", "network": {"id": "ff76f13f-ae63-4dd0-a219-894c6ae65c00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1502020482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b79304b161b748c4b105640273979318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d1282-04", "ovs_interfaceid": "7f2d1282-0400-4c1e-890d-46a51040a8b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:61:d2,bridge_name='br-int',has_traffic_filtering=True,id=7f2d1282-0400-4c1e-890d-46a51040a8b5,network=Network(ff76f13f-ae63-4dd0-a219-894c6ae65c00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d1282-04') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG os_vif [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:61:d2,bridge_name='br-int',has_traffic_filtering=True,id=7f2d1282-0400-4c1e-890d-46a51040a8b5,network=Network(ff76f13f-ae63-4dd0-a219-894c6ae65c00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d1282-04') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f2d1282-04, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48332543-633f-451b-9b3f-2b1911bea4a6) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:02 user nova-compute[74898]: INFO os_vif [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:61:d2,bridge_name='br-int',has_traffic_filtering=True,id=7f2d1282-0400-4c1e-890d-46a51040a8b5,network=Network(ff76f13f-ae63-4dd0-a219-894c6ae65c00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d1282-04')
Nov 17 03:08:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpmzNxqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:08:02 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:08:02 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c545e37-deff-4fd6-b468-afe3dece9600]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:08:02 user nova-compute[74898]: No targets found.
Nov 17 03:08:02 user nova-compute[74898]: iSNS:
Nov 17 03:08:02 user nova-compute[74898]: No targets found.
Nov 17 03:08:02 user nova-compute[74898]: STATIC:
Nov 17 03:08:02 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7
Nov 17 03:08:02 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:08:02 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:08:02 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45
Nov 17 03:08:02 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:08:02 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:08:02 user nova-compute[74898]: FIRMWARE:
Nov 17 03:08:02 user nova-compute[74898]: No targets found.
Nov 17 03:08:02 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:08:02 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:08:02 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c87738c-bb99-459e-8997-fa06e474df1c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9abf669-978a-4664-acc8-736499f30bbf]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:08:02 user nova-compute[74898]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:08:02 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 (non-flash)
Nov 17 03:08:02 user nova-compute[74898]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:08:02 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf8696680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45'): ({'sdd'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Removing single pathed devices sdd {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[317a79e9-0ccb-4cdc-9133-678c3dd478c0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fd433f-738d-4b29-8689-619899eac25c]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Flushing IO for device /dev/sdd {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e270b023-5226-4994-b25a-1f1477ae165f]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b612a4-5732-40e3-8ce0-8e626c67edf0]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] SCSI volumes sdd have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05795ca-73ac-4511-acaf-085a11e519c6]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcb506f-dd0b-4945-8579-d3feeb875035]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45, portal: 172.16.0.220,3260]
Nov 17 03:08:02 user nova-compute[74898]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45, portal: 172.16.0.220,3260] successful.
Nov 17 03:08:02 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2efad82a-fd47-4649-8ce0-ba22f7a22f45 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11a5855-cbc1-4f1c-866f-c625d8b3130b]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] <== disconnect_volume: return (357ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:08:02 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Deleting instance files /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92_del
Nov 17 03:08:02 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Deletion of /opt/stack/data/nova/instances/11704034-7afe-475c-ae43-1324b40f0d92_del complete
Nov 17 03:08:02 user nova-compute[74898]: INFO nova.compute.manager [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Took 1.43 seconds to destroy the instance on the hypervisor.
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG nova.objects.instance [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lazy-loading 'pci_requests' on Instance uuid dbaabab0-92f0-480d-8f81-0db980c8f333 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG nova.objects.instance [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lazy-loading 'numa_topology' on Instance uuid dbaabab0-92f0-480d-8f81-0db980c8f333 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:08:02 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:08:02 user nova-compute[74898]: INFO nova.compute.claims [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Claim successful on node user
Nov 17 03:08:03 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:08:03 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:08:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.686s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:08:03 user nova-compute[74898]: INFO nova.network.neutron [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Updating port 8e38fd27-07cd-40c1-bef7-67d150932e57 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 17 03:08:03 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:08:03 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Took 1.05 seconds to deallocate network for instance.
Nov 17 03:08:03 user nova-compute[74898]: DEBUG nova.compute.manager [req-57d2afa7-2d84-485b-868a-e3127aeaee30 req-9432e698-76c2-4ec7-90db-4e557b3b3d36 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received event network-vif-deleted-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:08:03 user nova-compute[74898]: INFO nova.compute.manager [req-57d2afa7-2d84-485b-868a-e3127aeaee30 req-9432e698-76c2-4ec7-90db-4e557b3b3d36 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Neutron deleted interface 7f2d1282-0400-4c1e-890d-46a51040a8b5; detaching it from the instance and deleting it from the info cache
Nov 17 03:08:03 user nova-compute[74898]: DEBUG nova.network.neutron [req-57d2afa7-2d84-485b-868a-e3127aeaee30 req-9432e698-76c2-4ec7-90db-4e557b3b3d36 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:08:03 user nova-compute[74898]: DEBUG nova.compute.manager [req-df9facc6-33d4-4a88-9afb-32e110304155 req-b14d2659-91b6-4f5b-a9cf-1bf08cc11810 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received event network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:08:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-df9facc6-33d4-4a88-9afb-32e110304155 req-b14d2659-91b6-4f5b-a9cf-1bf08cc11810 service nova] Acquiring lock "11704034-7afe-475c-ae43-1324b40f0d92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:08:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-df9facc6-33d4-4a88-9afb-32e110304155 req-b14d2659-91b6-4f5b-a9cf-1bf08cc11810 service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:08:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-df9facc6-33d4-4a88-9afb-32e110304155 req-b14d2659-91b6-4f5b-a9cf-1bf08cc11810 service nova] Lock "11704034-7afe-475c-ae43-1324b40f0d92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:08:03 user nova-compute[74898]: DEBUG nova.compute.manager [req-df9facc6-33d4-4a88-9afb-32e110304155 req-b14d2659-91b6-4f5b-a9cf-1bf08cc11810 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] No waiting events found dispatching network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:08:03 user nova-compute[74898]: WARNING nova.compute.manager [req-df9facc6-33d4-4a88-9afb-32e110304155 req-b14d2659-91b6-4f5b-a9cf-1bf08cc11810 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Received unexpected event network-vif-plugged-7f2d1282-0400-4c1e-890d-46a51040a8b5 for instance with vm_state active and task_state deleting.
Nov 17 03:08:03 user nova-compute[74898]: DEBUG nova.compute.manager [req-57d2afa7-2d84-485b-868a-e3127aeaee30 req-9432e698-76c2-4ec7-90db-4e557b3b3d36 service nova] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Detach interface failed, port_id=7f2d1282-0400-4c1e-890d-46a51040a8b5, reason: Instance 11704034-7afe-475c-ae43-1324b40f0d92 could not be found. {{(pid=74898) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 03:08:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "refresh_cache-dbaabab0-92f0-480d-8f81-0db980c8f333" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:08:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquired lock "refresh_cache-dbaabab0-92f0-480d-8f81-0db980c8f333" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:08:04 user nova-compute[74898]: DEBUG nova.network.neutron [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:08:04 user nova-compute[74898]: DEBUG nova.compute.manager [req-fea13503-4b81-48c9-8a48-bbd2c0ef4b02 req-a2d484aa-fecd-4168-8135-fa8ee786bdb3 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Received event network-changed-8e38fd27-07cd-40c1-bef7-67d150932e57 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:08:04 user nova-compute[74898]: DEBUG nova.compute.manager [req-fea13503-4b81-48c9-8a48-bbd2c0ef4b02 req-a2d484aa-fecd-4168-8135-fa8ee786bdb3 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Refreshing instance network info cache due to event network-changed-8e38fd27-07cd-40c1-bef7-67d150932e57. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:08:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fea13503-4b81-48c9-8a48-bbd2c0ef4b02 req-a2d484aa-fecd-4168-8135-fa8ee786bdb3 service nova] Acquiring lock "refresh_cache-dbaabab0-92f0-480d-8f81-0db980c8f333" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:08:04 user nova-compute[74898]: INFO nova.compute.manager [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] [instance: 11704034-7afe-475c-ae43-1324b40f0d92] Took 1.19 seconds to detach 1 volumes for instance.
Nov 17 03:08:04 user nova-compute[74898]: DEBUG nova.network.neutron [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Updating instance_info_cache with network_info: [{"id": "8e38fd27-07cd-40c1-bef7-67d150932e57", "address": "fa:16:3e:8b:5d:76", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e38fd27-07", "ovs_interfaceid": "8e38fd27-07cd-40c1-bef7-67d150932e57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:08:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Releasing lock "refresh_cache-dbaabab0-92f0-480d-8f81-0db980c8f333" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:08:04 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:08:04 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Creating image(s)
Nov 17 03:08:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "/opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:08:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "/opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:08:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "/opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:08:04 user nova-compute[74898]: DEBUG nova.objects.instance [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lazy-loading 'trusted_certs' on Instance uuid dbaabab0-92f0-480d-8f81-0db980c8f333 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:08:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fea13503-4b81-48c9-8a48-bbd2c0ef4b02 req-a2d484aa-fecd-4168-8135-fa8ee786bdb3 service nova] Acquired lock "refresh_cache-dbaabab0-92f0-480d-8f81-0db980c8f333" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:08:05 user nova-compute[74898]: DEBUG nova.network.neutron [req-fea13503-4b81-48c9-8a48-bbd2c0ef4b02 req-a2d484aa-fecd-4168-8135-fa8ee786bdb3 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Refreshing network info cache for port 8e38fd27-07cd-40c1-bef7-67d150932e57 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:08:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:08:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:08:05 user nova-compute[74898]: DEBUG nova.objects.base [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Object Instance<dbaabab0-92f0-480d-8f81-0db980c8f333> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:08:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "19ae0e720cea3918b90ae5ab4b7807321716fede" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:08:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "19ae0e720cea3918b90ae5ab4b7807321716fede" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:08:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19ae0e720cea3918b90ae5ab4b7807321716fede.part --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19ae0e720cea3918b90ae5ab4b7807321716fede.part --force-share --output=json" returned: 0 in 0.224s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:06 user nova-compute[74898]: DEBUG nova.virt.images [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] 618ece13-88de-461f-87c1-cbcc69b161a6 was qcow2, converting to raw {{(pid=74898) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 17 03:08:06 user nova-compute[74898]: DEBUG nova.privsep.utils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74898) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 03:08:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/19ae0e720cea3918b90ae5ab4b7807321716fede.part /opt/stack/data/nova/instances/_base/19ae0e720cea3918b90ae5ab4b7807321716fede.converted {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:06 user nova-compute[74898]: DEBUG nova.network.neutron [req-fea13503-4b81-48c9-8a48-bbd2c0ef4b02 req-a2d484aa-fecd-4168-8135-fa8ee786bdb3 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Updated VIF entry in instance network info cache for port 8e38fd27-07cd-40c1-bef7-67d150932e57. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:08:06 user nova-compute[74898]: DEBUG nova.network.neutron [req-fea13503-4b81-48c9-8a48-bbd2c0ef4b02 req-a2d484aa-fecd-4168-8135-fa8ee786bdb3 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Updating instance_info_cache with network_info: [{"id": "8e38fd27-07cd-40c1-bef7-67d150932e57", "address": "fa:16:3e:8b:5d:76", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e38fd27-07", "ovs_interfaceid": "8e38fd27-07cd-40c1-bef7-67d150932e57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:08:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fea13503-4b81-48c9-8a48-bbd2c0ef4b02 req-a2d484aa-fecd-4168-8135-fa8ee786bdb3 service nova] Releasing lock "refresh_cache-dbaabab0-92f0-480d-8f81-0db980c8f333" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:08:06 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:08:06 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:08:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:08:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:08:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:08:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:08:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:08:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/19ae0e720cea3918b90ae5ab4b7807321716fede.part /opt/stack/data/nova/instances/_base/19ae0e720cea3918b90ae5ab4b7807321716fede.converted" returned: 0 in 0.709s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19ae0e720cea3918b90ae5ab4b7807321716fede.converted --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.293s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:08:07 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Deleted allocations for instance 11704034-7afe-475c-ae43-1324b40f0d92
Nov 17 03:08:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-edc870f4-4fa7-4dd7-8c4f-0a21bfd97ed0 tempest-ServerActionsTestOtherB-1831504115 tempest-ServerActionsTestOtherB-1831504115-project-member] Lock "11704034-7afe-475c-ae43-1324b40f0d92" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.234s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:08:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19ae0e720cea3918b90ae5ab4b7807321716fede.converted --force-share --output=json" returned: 0 in 0.206s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "19ae0e720cea3918b90ae5ab4b7807321716fede" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.444s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:08:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19ae0e720cea3918b90ae5ab4b7807321716fede --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19ae0e720cea3918b90ae5ab4b7807321716fede --force-share --output=json" returned: 0 in 0.195s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "19ae0e720cea3918b90ae5ab4b7807321716fede" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:08:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "19ae0e720cea3918b90ae5ab4b7807321716fede" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:08:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19ae0e720cea3918b90ae5ab4b7807321716fede --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19ae0e720cea3918b90ae5ab4b7807321716fede --force-share --output=json" returned: 0 in 0.249s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19ae0e720cea3918b90ae5ab4b7807321716fede,backing_fmt=raw /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19ae0e720cea3918b90ae5ab4b7807321716fede,backing_fmt=raw /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk 1073741824" returned: 0 in 0.114s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "19ae0e720cea3918b90ae5ab4b7807321716fede" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.371s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:08:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19ae0e720cea3918b90ae5ab4b7807321716fede --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19ae0e720cea3918b90ae5ab4b7807321716fede --force-share --output=json" returned: 0 in 0.218s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:08 user nova-compute[74898]: DEBUG nova.objects.instance [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lazy-loading 'migration_context' on Instance uuid dbaabab0-92f0-480d-8f81-0db980c8f333 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:08:08 user nova-compute[74898]: DEBUG nova.objects.base [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Object Instance<dbaabab0-92f0-480d-8f81-0db980c8f333> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:08:08 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Rebasing disk image.
Nov 17 03:08:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.205s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:08 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 -F raw /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 -F raw /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk" returned: 0 in 2.591s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Ensure instance console log exists: /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Start _get_guest_xml network_info=[{"id": "8e38fd27-07cd-40c1-bef7-67d150932e57", "address": "fa:16:3e:8b:5d:76", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e38fd27-07", "ovs_interfaceid": "8e38fd27-07cd-40c1-bef7-67d150932e57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='11f2155b7730dfce1c879c7a8647f5b4',container_format='bare',created_at=2023-11-17T03:06:03Z,direct_url=<?>,disk_format='qcow2',id=618ece13-88de-461f-87c1-cbcc69b161a6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-702287873-shelved',owner='3de7d05d475c49f0805f5aab5853a0b2',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-17T03:06:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GsjSPqHB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'dbaabab0-92f0-480d-8f81-0db980c8f333', 'attached_at': '', 'detached_at': '', 'volume_id': '8d24908f-8f15-470a-9a16-bbb3ab658329', 'serial': '8d24908f-8f15-470a-9a16-bbb3ab658329'}, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '49fb14ff-0fee-48d8-a454-f9cb7a0d07e6', 'volume_type': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:08:11 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:08:11 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:08:11 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='11f2155b7730dfce1c879c7a8647f5b4',container_format='bare',created_at=2023-11-17T03:06:03Z,direct_url=<?>,disk_format='qcow2',id=618ece13-88de-461f-87c1-cbcc69b161a6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-702287873-shelved',owner='3de7d05d475c49f0805f5aab5853a0b2',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-17T03:06:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG nova.objects.instance [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lazy-loading 'vcpu_model' on Instance uuid dbaabab0-92f0-480d-8f81-0db980c8f333 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG nova.objects.base [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Object Instance<dbaabab0-92f0-480d-8f81-0db980c8f333> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GsjSPqHB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:08:11 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:08:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:08:11 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:08:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:08:11 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 -p 172.16.0.220:3260" returned: 21 in 0.089s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a301c491-d157-4468-b37d-64905019259b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:08:11 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fbb28f-6f69-4cb0-9fea-599d347b6d76]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329] added
Nov 17 03:08:11 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe802ef-c5f7-41ce-9d81-f1bff1dafe7a]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.047s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f18a8c-51f7-4493-bcfd-89616ce0babd]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GsjSPqHB {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GsjSPqHB" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebaf0fb7-f3d1-4730-9d56-87b9854f805b]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GsjSPqHB'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f95669-31c2-4245-9f51-50c96e72a911]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c044edb9-8a68-4120-9157-650d9cdeb15c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:08:11 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:08:11 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56ea9ab-5470-4157-a1b5-c5302d88e34d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329, portal: 172.16.0.220,3260]
Nov 17 03:08:11 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329, portal: 172.16.0.220,3260] successful.
Nov 17 03:08:11 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bc3337-0ea1-4308-bdf1-a5ef260da264]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce92336-df8a-47eb-8a13-1f3858deba83]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:08:11 user nova-compute[74898]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)
Nov 17 03:08:11 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:08:11 user nova-compute[74898]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)
Nov 17 03:08:11 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.030s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[31534ec5-8178-4dd5-bb4b-7b4a1ba637d2]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:08:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GsjSPqHB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:08:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.452s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:08:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] <== connect_volume: return (1453ms) {'type': 'block', 'scsi_wwn': '26665653034323732', 'path': '/dev/sdc'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:08:12 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665653034323732', 'path': '/dev/sdc'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:08:12 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-17T03:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-702287873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-702287873',id=17,image_ref='618ece13-88de-461f-87c1-cbcc69b161a6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-742675604',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:04:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3de7d05d475c49f0805f5aab5853a0b2',ramdisk_id='',reservation_id='r-1c58hjg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-940982522',owner_user_name='tempest-AttachVolumeShelveTestJSON-940982522-project-member',shelved_at='2023-11-17T03:06:08.330245',shelved_host='user',shelved_image_id='618ece13-88de-461f-87c1-cbcc69b161a6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:07:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='926d8bd27eb24824a71cb9f1969f9c45',uuid=dbaabab0-92f0-480d-8f81-0db980c8f333,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8e38fd27-07cd-40c1-bef7-67d150932e57", "address": "fa:16:3e:8b:5d:76", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e38fd27-07", "ovs_interfaceid": "8e38fd27-07cd-40c1-bef7-67d150932e57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:08:12 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Converting VIF {"id": "8e38fd27-07cd-40c1-bef7-67d150932e57", "address": "fa:16:3e:8b:5d:76", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e38fd27-07", "ovs_interfaceid": "8e38fd27-07cd-40c1-bef7-67d150932e57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:08:12 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:5d:76,bridge_name='br-int',has_traffic_filtering=True,id=8e38fd27-07cd-40c1-bef7-67d150932e57,network=Network(c92bc72d-7b33-49a8-96e5-ca2ed117fa48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e38fd27-07') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:08:12 user nova-compute[74898]: DEBUG nova.objects.instance [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lazy-loading 'pci_devices' on Instance uuid dbaabab0-92f0-480d-8f81-0db980c8f333 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:08:12 user nova-compute[74898]: DEBUG nova.objects.base [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Object Instance<dbaabab0-92f0-480d-8f81-0db980c8f333> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:08:12 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:08:12 user nova-compute[74898]:   <uuid>dbaabab0-92f0-480d-8f81-0db980c8f333</uuid>
Nov 17 03:08:12 user nova-compute[74898]:   <name>instance-00000011</name>
Nov 17 03:08:12 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:08:12 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:08:12 user nova-compute[74898]:   <metadata>
Nov 17 03:08:12 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:08:12 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:08:12 user nova-compute[74898]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-702287873</nova:name>
Nov 17 03:08:12 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:08:11</nova:creationTime>
Nov 17 03:08:12 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:08:12 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:08:12 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:08:12 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:08:12 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:08:12 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:08:12 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:08:12 user nova-compute[74898]:       <nova:owner>
Nov 17 03:08:12 user nova-compute[74898]:         <nova:user uuid="926d8bd27eb24824a71cb9f1969f9c45">tempest-AttachVolumeShelveTestJSON-940982522-project-member</nova:user>
Nov 17 03:08:12 user nova-compute[74898]:         <nova:project uuid="3de7d05d475c49f0805f5aab5853a0b2">tempest-AttachVolumeShelveTestJSON-940982522</nova:project>
Nov 17 03:08:12 user nova-compute[74898]:       </nova:owner>
Nov 17 03:08:12 user nova-compute[74898]:       <nova:root type="image" uuid="618ece13-88de-461f-87c1-cbcc69b161a6"/>
Nov 17 03:08:12 user nova-compute[74898]:       <nova:ports>
Nov 17 03:08:12 user nova-compute[74898]:         <nova:port uuid="8e38fd27-07cd-40c1-bef7-67d150932e57">
Nov 17 03:08:12 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 17 03:08:12 user nova-compute[74898]:         </nova:port>
Nov 17 03:08:12 user nova-compute[74898]:       </nova:ports>
Nov 17 03:08:12 user nova-compute[74898]:     </nova:instance>
Nov 17 03:08:12 user nova-compute[74898]:   </metadata>
Nov 17 03:08:12 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:08:12 user nova-compute[74898]:     <system>
Nov 17 03:08:12 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:08:12 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:08:12 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:08:12 user nova-compute[74898]:       <entry name="serial">dbaabab0-92f0-480d-8f81-0db980c8f333</entry>
Nov 17 03:08:12 user nova-compute[74898]:       <entry name="uuid">dbaabab0-92f0-480d-8f81-0db980c8f333</entry>
Nov 17 03:08:12 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:08:12 user nova-compute[74898]:     </system>
Nov 17 03:08:12 user nova-compute[74898]:   </sysinfo>
Nov 17 03:08:12 user nova-compute[74898]:   <os>
Nov 17 03:08:12 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:08:12 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:08:12 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:08:12 user nova-compute[74898]:   </os>
Nov 17 03:08:12 user nova-compute[74898]:   <features>
Nov 17 03:08:12 user nova-compute[74898]:     <acpi/>
Nov 17 03:08:12 user nova-compute[74898]:     <apic/>
Nov 17 03:08:12 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:08:12 user nova-compute[74898]:   </features>
Nov 17 03:08:12 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:08:12 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:08:12 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:08:12 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:08:12 user nova-compute[74898]:   </clock>
Nov 17 03:08:12 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:08:12 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:08:12 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:08:12 user nova-compute[74898]:   </cpu>
Nov 17 03:08:12 user nova-compute[74898]:   <devices>
Nov 17 03:08:12 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:08:12 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:08:12 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk"/>
Nov 17 03:08:12 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:08:12 user nova-compute[74898]:     </disk>
Nov 17 03:08:12 user nova-compute[74898]:     <disk type="block" device="disk">
Nov 17 03:08:12 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:08:12 user nova-compute[74898]:       <source dev="/dev/sdc"/>
Nov 17 03:08:12 user nova-compute[74898]:       <target dev="vdc" bus="virtio"/>
Nov 17 03:08:12 user nova-compute[74898]:       <serial>8d24908f-8f15-470a-9a16-bbb3ab658329</serial>
Nov 17 03:08:12 user nova-compute[74898]:     </disk>
Nov 17 03:08:12 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:08:12 user nova-compute[74898]:       <mac address="fa:16:3e:8b:5d:76"/>
Nov 17 03:08:12 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:08:12 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:08:12 user nova-compute[74898]:       <target dev="tap8e38fd27-07"/>
Nov 17 03:08:12 user nova-compute[74898]:     </interface>
Nov 17 03:08:12 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:08:12 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/console.log" append="off"/>
Nov 17 03:08:12 user nova-compute[74898]:     </serial>
Nov 17 03:08:12 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:08:12 user nova-compute[74898]:     <video>
Nov 17 03:08:12 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:08:12 user nova-compute[74898]:     </video>
Nov 17 03:08:12 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:08:12 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:08:12 user nova-compute[74898]:     </rng>
Nov 17 03:08:12 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:08:12 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:08:12 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:08:12 user nova-compute[74898]:     </memballoon>
Nov 17 03:08:12 user nova-compute[74898]:   </devices>
Nov 17 03:08:12 user nova-compute[74898]: </domain>
Nov 17 03:08:12 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:08:12 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-17T03:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-702287873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-702287873',id=17,image_ref='618ece13-88de-461f-87c1-cbcc69b161a6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-742675604',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:04:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3de7d05d475c49f0805f5aab5853a0b2',ramdisk_id='',reservation_id='r-1c58hjg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-940982522',owner_user_name='tempest-AttachVolumeShelveTestJSON-940982522-project-member',shelved_at='2023-11-17T03:06:08.330245',shelved_host='user',shelved_image_id='618ece13-88de-461f-87c1-cbcc69b161a6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:07:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='926d8bd27eb24824a71cb9f1969f9c45',uuid=dbaabab0-92f0-480d-8f81-0db980c8f333,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8e38fd27-07cd-40c1-bef7-67d150932e57", "address": "fa:16:3e:8b:5d:76", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e38fd27-07", "ovs_interfaceid": "8e38fd27-07cd-40c1-bef7-67d150932e57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:08:12 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Converting VIF {"id": "8e38fd27-07cd-40c1-bef7-67d150932e57", "address": "fa:16:3e:8b:5d:76", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e38fd27-07", "ovs_interfaceid": "8e38fd27-07cd-40c1-bef7-67d150932e57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:08:12 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:5d:76,bridge_name='br-int',has_traffic_filtering=True,id=8e38fd27-07cd-40c1-bef7-67d150932e57,network=Network(c92bc72d-7b33-49a8-96e5-ca2ed117fa48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e38fd27-07') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:08:12 user nova-compute[74898]: DEBUG os_vif [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:5d:76,bridge_name='br-int',has_traffic_filtering=True,id=8e38fd27-07cd-40c1-bef7-67d150932e57,network=Network(c92bc72d-7b33-49a8-96e5-ca2ed117fa48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e38fd27-07') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:08:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:08:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:08:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '72ebc98e-75bd-5e0f-be8f-eff997acd27e', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:08:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:08:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e38fd27-07, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:08:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e38fd27-07, col_values=(('qos', UUID('af6700ff-4bc7-4f34-af64-4caae0ee7fc7')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:08:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e38fd27-07, col_values=(('external_ids', {'iface-id': '8e38fd27-07cd-40c1-bef7-67d150932e57', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:5d:76', 'vm-uuid': 'dbaabab0-92f0-480d-8f81-0db980c8f333'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:08:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:08:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:12 user nova-compute[74898]: INFO os_vif [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:5d:76,bridge_name='br-int',has_traffic_filtering=True,id=8e38fd27-07cd-40c1-bef7-67d150932e57,network=Network(c92bc72d-7b33-49a8-96e5-ca2ed117fa48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e38fd27-07')
Nov 17 03:08:12 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:08:12 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:08:12 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] No VIF found with MAC fa:16:3e:8b:5d:76, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:08:14 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:14 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:14 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:14 user nova-compute[74898]: DEBUG nova.compute.manager [req-e994fc8d-60ed-4393-99ae-99826c2fb7f7 req-43d34abc-dddb-40fe-a26c-34531ced0808 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Received event network-vif-plugged-8e38fd27-07cd-40c1-bef7-67d150932e57 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:08:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e994fc8d-60ed-4393-99ae-99826c2fb7f7 req-43d34abc-dddb-40fe-a26c-34531ced0808 service nova] Acquiring lock "dbaabab0-92f0-480d-8f81-0db980c8f333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:08:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e994fc8d-60ed-4393-99ae-99826c2fb7f7 req-43d34abc-dddb-40fe-a26c-34531ced0808 service nova] Lock "dbaabab0-92f0-480d-8f81-0db980c8f333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:08:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e994fc8d-60ed-4393-99ae-99826c2fb7f7 req-43d34abc-dddb-40fe-a26c-34531ced0808 service nova] Lock "dbaabab0-92f0-480d-8f81-0db980c8f333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:08:14 user nova-compute[74898]: DEBUG nova.compute.manager [req-e994fc8d-60ed-4393-99ae-99826c2fb7f7 req-43d34abc-dddb-40fe-a26c-34531ced0808 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] No waiting events found dispatching network-vif-plugged-8e38fd27-07cd-40c1-bef7-67d150932e57 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:08:14 user nova-compute[74898]: WARNING nova.compute.manager [req-e994fc8d-60ed-4393-99ae-99826c2fb7f7 req-43d34abc-dddb-40fe-a26c-34531ced0808 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Received unexpected event network-vif-plugged-8e38fd27-07cd-40c1-bef7-67d150932e57 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 17 03:08:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:16 user nova-compute[74898]: DEBUG nova.compute.manager [req-2ee03cb9-ef6f-404d-884d-8fa5043f63de req-415e1030-8301-4c43-974b-68f3612aa353 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Received event network-vif-plugged-8e38fd27-07cd-40c1-bef7-67d150932e57 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:08:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-2ee03cb9-ef6f-404d-884d-8fa5043f63de req-415e1030-8301-4c43-974b-68f3612aa353 service nova] Acquiring lock "dbaabab0-92f0-480d-8f81-0db980c8f333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:08:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-2ee03cb9-ef6f-404d-884d-8fa5043f63de req-415e1030-8301-4c43-974b-68f3612aa353 service nova] Lock "dbaabab0-92f0-480d-8f81-0db980c8f333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:08:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-2ee03cb9-ef6f-404d-884d-8fa5043f63de req-415e1030-8301-4c43-974b-68f3612aa353 service nova] Lock "dbaabab0-92f0-480d-8f81-0db980c8f333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:08:16 user nova-compute[74898]: DEBUG nova.compute.manager [req-2ee03cb9-ef6f-404d-884d-8fa5043f63de req-415e1030-8301-4c43-974b-68f3612aa353 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] No waiting events found dispatching network-vif-plugged-8e38fd27-07cd-40c1-bef7-67d150932e57 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:08:16 user nova-compute[74898]: WARNING nova.compute.manager [req-2ee03cb9-ef6f-404d-884d-8fa5043f63de req-415e1030-8301-4c43-974b-68f3612aa353 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Received unexpected event network-vif-plugged-8e38fd27-07cd-40c1-bef7-67d150932e57 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 17 03:08:16 user nova-compute[74898]: DEBUG nova.compute.manager [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:08:16 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:08:16 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Instance spawned successfully.
Nov 17 03:08:17 user nova-compute[74898]: DEBUG nova.compute.manager [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:08:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b01b1e05-59d7-4fe5-a84d-623365ec1ada tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "dbaabab0-92f0-480d-8f81-0db980c8f333" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 22.039s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:08:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:17 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:08:18 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:08:18 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:08:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-e733574a-56ba-4e24-babd-855bcb5bda61" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:08:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-e733574a-56ba-4e24-babd-855bcb5bda61" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:08:18 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:08:19 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Updating instance_info_cache with network_info: [{"id": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "address": "fa:16:3e:8c:c0:06", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8bd92de-8e", "ovs_interfaceid": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:08:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-e733574a-56ba-4e24-babd-855bcb5bda61" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:08:19 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:08:19 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:08:19 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:08:19 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:08:19 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:08:19 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:08:19 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:08:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:21 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:08:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:08:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:08:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:08:21 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:08:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:08:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:24 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:08:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:26 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:08:26 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:08:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=7449MB free_disk=25.383403778076172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:08:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:08:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:08:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:08:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance e733574a-56ba-4e24-babd-855bcb5bda61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:08:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 42994e39-187a-4fb6-a293-24a4eb57177b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:08:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance f25ef6a9-d007-419d-8478-2a9e79d5f03a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:08:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance f457f5c7-58e3-4f7f-b495-6cfd3440d7dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:08:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 13449e5c-809b-4db2-af0b-53f5865eb3a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:08:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance e188cb77-4a1d-4cab-9b32-9e3d442bb64d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:08:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance c49f4ec3-6f9b-4e14-ba29-208aa026301e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:08:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance a92bce56-1038-4762-9c1e-19b5a7ff8cef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:08:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance dbaabab0-92f0-480d-8f81-0db980c8f333 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:08:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:08:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:08:27 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:08:27 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:08:27 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:08:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.486s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:08:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:28 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:08:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-9fef9efb-5bd4-4955-bf59-b48e88c0db3e req-2a4d55e3-3d3c-4604-b71b-56f377b3a757 service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Received event network-changed-f819d75d-a65d-4342-9912-944d2fb13dd3 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:08:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-9fef9efb-5bd4-4955-bf59-b48e88c0db3e req-2a4d55e3-3d3c-4604-b71b-56f377b3a757 service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Refreshing instance network info cache due to event network-changed-f819d75d-a65d-4342-9912-944d2fb13dd3. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:08:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9fef9efb-5bd4-4955-bf59-b48e88c0db3e req-2a4d55e3-3d3c-4604-b71b-56f377b3a757 service nova] Acquiring lock "refresh_cache-f25ef6a9-d007-419d-8478-2a9e79d5f03a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:08:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9fef9efb-5bd4-4955-bf59-b48e88c0db3e req-2a4d55e3-3d3c-4604-b71b-56f377b3a757 service nova] Acquired lock "refresh_cache-f25ef6a9-d007-419d-8478-2a9e79d5f03a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:08:34 user nova-compute[74898]: DEBUG nova.network.neutron [req-9fef9efb-5bd4-4955-bf59-b48e88c0db3e req-2a4d55e3-3d3c-4604-b71b-56f377b3a757 service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Refreshing network info cache for port f819d75d-a65d-4342-9912-944d2fb13dd3 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:08:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:08:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:08:35 user nova-compute[74898]: DEBUG nova.objects.instance [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lazy-loading 'flavor' on Instance uuid f25ef6a9-d007-419d-8478-2a9e79d5f03a {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:08:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:08:35 user nova-compute[74898]: DEBUG nova.network.neutron [req-9fef9efb-5bd4-4955-bf59-b48e88c0db3e req-2a4d55e3-3d3c-4604-b71b-56f377b3a757 service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Updated VIF entry in instance network info cache for port f819d75d-a65d-4342-9912-944d2fb13dd3. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:08:35 user nova-compute[74898]: DEBUG nova.network.neutron [req-9fef9efb-5bd4-4955-bf59-b48e88c0db3e req-2a4d55e3-3d3c-4604-b71b-56f377b3a757 service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Updating instance_info_cache with network_info: [{"id": "f819d75d-a65d-4342-9912-944d2fb13dd3", "address": "fa:16:3e:89:06:c8", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf819d75d-a6", "ovs_interfaceid": "f819d75d-a65d-4342-9912-944d2fb13dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:08:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9fef9efb-5bd4-4955-bf59-b48e88c0db3e req-2a4d55e3-3d3c-4604-b71b-56f377b3a757 service nova] Releasing lock "refresh_cache-f25ef6a9-d007-419d-8478-2a9e79d5f03a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:08:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:08:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:08:35 user nova-compute[74898]: INFO nova.compute.manager [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Attaching volume c48f4c9e-2c05-41b5-b2f8-236a81a837c2 to /dev/vdb
Nov 17 03:08:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:35 user nova-compute[74898]: DEBUG os_brick.utils [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:08:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23155bd-cbdd-408f-b135-47029486d751]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[684a6f63-8bc2-4a32-a601-a06ad21e0f04]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f85103-0ec3-46eb-ad26-51a21d9cc4c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b96502-04a1-429c-9472-a57dc5ef1b87]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:08:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:08:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:08:35 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:08:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[209b7025-7007-4b20-891e-777bf43aef3b]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:08:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:08:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:08:35 user nova-compute[74898]: DEBUG os_brick.utils [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:08:35 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Updating existing volume attachment record: a4479928-f6e0-420e-bfbe-029139f61ed5 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:08:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjxCVeFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:08:41 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:08:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:08:41 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:08:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:08:41 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cce18a-1583-4e7d-b030-ff98f8bd8c4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:08:41 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde2ee50-e016-441f-a7bf-41ceb0baa5c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2] added
Nov 17 03:08:41 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[48461c37-b49f-45bb-b462-5415d6b7feb7]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecc190b-dbb6-46de-bfd8-9607c1d975ee]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TjxCVeFd {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TjxCVeFd" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[171d4400-a621-464f-9bfc-db346c4ad376]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TjxCVeFd'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[784f34a6-6cfb-4f2b-b515-b4e7a01ee100]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3deec530-4612-4018-ac90-60fba525ab88 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "f457f5c7-58e3-4f7f-b495-6cfd3440d7dd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3deec530-4612-4018-ac90-60fba525ab88 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "f457f5c7-58e3-4f7f-b495-6cfd3440d7dd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f598d519-2276-4a98-9dd7-4049020cca37]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:08:41 user nova-compute[74898]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)
Nov 17 03:08:41 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:08:41 user nova-compute[74898]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)
Nov 17 03:08:41 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG nova.objects.instance [None req-3deec530-4612-4018-ac90-60fba525ab88 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lazy-loading 'flavor' on Instance uuid f457f5c7-58e3-4f7f-b495-6cfd3440d7dd {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4989789d-0308-49d4-923e-6f6b51ea116b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3deec530-4612-4018-ac90-60fba525ab88 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "f457f5c7-58e3-4f7f-b495-6cfd3440d7dd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.222s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2, portal: 172.16.0.220,3260]
Nov 17 03:08:41 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2, portal: 172.16.0.220,3260] successful.
Nov 17 03:08:41 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.091s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[57260a71-ce19-4846-ac16-d493cdc22e98]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:08:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccfcae7-9c97-4785-bce5-fb2cdbc2f1e3]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:08:42 user nova-compute[74898]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)
Nov 17 03:08:42 user nova-compute[74898]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:08:42 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:08:42 user nova-compute[74898]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)
Nov 17 03:08:42 user nova-compute[74898]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:08:42 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.499s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f8ff3d-fae6-448e-940c-63590e07620c]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjxCVeFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3deec530-4612-4018-ac90-60fba525ab88 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "f457f5c7-58e3-4f7f-b495-6cfd3440d7dd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3deec530-4612-4018-ac90-60fba525ab88 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "f457f5c7-58e3-4f7f-b495-6cfd3440d7dd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:08:42 user nova-compute[74898]: INFO nova.compute.manager [None req-3deec530-4612-4018-ac90-60fba525ab88 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Attaching volume 5ba7f9f2-668a-4a91-9631-bc7b8a8cc71d to /dev/vdb
Nov 17 03:08:42 user nova-compute[74898]: DEBUG os_brick.utils [None req-3deec530-4612-4018-ac90-60fba525ab88 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[05957e17-e3f3-4454-adf3-fe3f1f2223a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bccab7-0217-482f-a006-2e22cf6977cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0572165-561b-457c-bc19-8082385b2ed3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[73465003-22a0-4f87-8c81-d2b3b1238249]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3deec530-4612-4018-ac90-60fba525ab88 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3deec530-4612-4018-ac90-60fba525ab88 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3deec530-4612-4018-ac90-60fba525ab88 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:08:42 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:08:42 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdef8c4-dc90-4de3-8119-9419ecec486d]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-3deec530-4612-4018-ac90-60fba525ab88 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-3deec530-4612-4018-ac90-60fba525ab88 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-3deec530-4612-4018-ac90-60fba525ab88 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG os_brick.utils [None req-3deec530-4612-4018-ac90-60fba525ab88 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-3deec530-4612-4018-ac90-60fba525ab88 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Updating existing volume attachment record: 65f58d73-b4b7-42d0-be04-9be0ebdf0c32 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:08:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:43 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.546s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:08:43 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] <== connect_volume: return (1548ms) {'type': 'block', 'scsi_wwn': '23735646462336436', 'path': '/dev/sdd'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:08:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735646462336436', 'path': '/dev/sdd'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:08:43 user nova-compute[74898]: DEBUG nova.objects.instance [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lazy-loading 'flavor' on Instance uuid f25ef6a9-d007-419d-8478-2a9e79d5f03a {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:08:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 03:08:43 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:08:43 user nova-compute[74898]:   <source dev="/dev/sdd"/>
Nov 17 03:08:43 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:08:43 user nova-compute[74898]:   <serial>c48f4c9e-2c05-41b5-b2f8-236a81a837c2</serial>
Nov 17 03:08:43 user nova-compute[74898]: </disk>
Nov 17 03:08:43 user nova-compute[74898]:  {{(pid=74898) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 03:08:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:08:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:08:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] No VIF found with MAC fa:16:3e:89:06:c8, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:08:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4d47fddc-cf03-4398-a56f-b06999d0701e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.998s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:08:45 user nova-compute[74898]: INFO nova.compute.manager [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Rebuilding instance
Nov 17 03:08:45 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:08:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:45 user nova-compute[74898]: DEBUG nova.compute.manager [req-df94bdfa-fcd2-4f77-a877-ab47395ff627 req-b5541772-b1d6-410c-aec0-b3333903aa0b service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Received event network-vif-unplugged-f819d75d-a65d-4342-9912-944d2fb13dd3 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:08:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-df94bdfa-fcd2-4f77-a877-ab47395ff627 req-b5541772-b1d6-410c-aec0-b3333903aa0b service nova] Acquiring lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:08:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-df94bdfa-fcd2-4f77-a877-ab47395ff627 req-b5541772-b1d6-410c-aec0-b3333903aa0b service nova] Lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:08:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-df94bdfa-fcd2-4f77-a877-ab47395ff627 req-b5541772-b1d6-410c-aec0-b3333903aa0b service nova] Lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:08:45 user nova-compute[74898]: DEBUG nova.compute.manager [req-df94bdfa-fcd2-4f77-a877-ab47395ff627 req-b5541772-b1d6-410c-aec0-b3333903aa0b service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] No waiting events found dispatching network-vif-unplugged-f819d75d-a65d-4342-9912-944d2fb13dd3 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:08:45 user nova-compute[74898]: WARNING nova.compute.manager [req-df94bdfa-fcd2-4f77-a877-ab47395ff627 req-b5541772-b1d6-410c-aec0-b3333903aa0b service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Received unexpected event network-vif-unplugged-f819d75d-a65d-4342-9912-944d2fb13dd3 for instance with vm_state active and task_state rebuilding.
Nov 17 03:08:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:46 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Instance destroyed successfully.
Nov 17 03:08:46 user nova-compute[74898]: INFO nova.compute.manager [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Detaching volume c48f4c9e-2c05-41b5-b2f8-236a81a837c2
Nov 17 03:08:46 user nova-compute[74898]: INFO nova.virt.block_device [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Attempting to driver detach volume c48f4c9e-2c05-41b5-b2f8-236a81a837c2 from mountpoint /dev/vdb
Nov 17 03:08:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Attempting to detach device vdb from instance f25ef6a9-d007-419d-8478-2a9e79d5f03a from the persistent domain config. {{(pid=74898) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:08:46 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:08:46 user nova-compute[74898]:   <source dev="/dev/sdd"/>
Nov 17 03:08:46 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:08:46 user nova-compute[74898]:   <serial>c48f4c9e-2c05-41b5-b2f8-236a81a837c2</serial>
Nov 17 03:08:46 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:08:46 user nova-compute[74898]: </disk>
Nov 17 03:08:46 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:08:46 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Successfully detached device vdb from instance f25ef6a9-d007-419d-8478-2a9e79d5f03a from the persistent domain config.
Nov 17 03:08:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjxCVeFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:08:46 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 17 03:08:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac73196-40b2-4c0f-b1c3-c2ad3423ea4c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:08:46 user nova-compute[74898]: No targets found.
Nov 17 03:08:46 user nova-compute[74898]: iSNS:
Nov 17 03:08:46 user nova-compute[74898]: No targets found.
Nov 17 03:08:46 user nova-compute[74898]: STATIC:
Nov 17 03:08:46 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7
Nov 17 03:08:46 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:08:46 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:08:46 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329
Nov 17 03:08:46 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:08:46 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:08:46 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2
Nov 17 03:08:46 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:08:46 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:08:46 user nova-compute[74898]: FIRMWARE:
Nov 17 03:08:46 user nova-compute[74898]: No targets found.
Nov 17 03:08:46 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:08:46 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:08:46 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d45a0b-dee4-41e4-87dd-f6355a57820a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adc186f-caa5-478d-bcee-1d43837d9404]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:08:46 user nova-compute[74898]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)
Nov 17 03:08:46 user nova-compute[74898]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:08:46 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:08:46 user nova-compute[74898]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)
Nov 17 03:08:46 user nova-compute[74898]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:08:46 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf86c8430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2'): ({'sdd'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Removing single pathed devices sdd {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3400f9-e9ac-4b87-ac20-5f8a1a245858]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a738bfe2-f972-43cc-a079-d094044fafc1]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Flushing IO for device /dev/sdd {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f4582e-641a-4d56-8dc6-94eee7c692a8]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7f18ef-5adc-462e-a5e3-042baeb7e31e]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] SCSI volumes sdd have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a51139-b03d-4c1d-9eb6-90c458942714]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7a4625-76a1-4261-ab2a-f0b0e984b122]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2, portal: 172.16.0.220,3260]
Nov 17 03:08:46 user nova-compute[74898]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2, portal: 172.16.0.220,3260] successful.
Nov 17 03:08:46 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d8b48f-62ef-4311-bce9-2c54bc40967c]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] <== disconnect_volume: return (353ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:08:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:08:47 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Instance destroyed successfully.
Nov 17 03:08:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:06:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-300218009',display_name='tempest-ServerActionsTestOtherA-server-1915932620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-300218009',id=19,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHj48AyfPGEuTYyaaXRPfUux/t0c9DvnKU2/5+czxQ0LiT4+FXnkFmRFT1qWvFotFB4OLCF7MZEn857VDvvqJISIgLBUP+o+9WiZvKEG2wWiBy731G5vP6ol8yd3WhW9MQ==',key_name='tempest-keypair-278072850',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:06:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4ff82629b7d7486a86574994974fabda',ramdisk_id='',reservation_id='r-orvyz1o1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-214359699',owner_user_name='tempest-ServerActionsTestOtherA-214359699-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:08:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28445b2b2360414bac2607ec94166369',uuid=f25ef6a9-d007-419d-8478-2a9e79d5f03a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f819d75d-a65d-4342-9912-944d2fb13dd3", "address": "fa:16:3e:89:06:c8", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf819d75d-a6", "ovs_interfaceid": "f819d75d-a65d-4342-9912-944d2fb13dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Converting VIF {"id": "f819d75d-a65d-4342-9912-944d2fb13dd3", "address": "fa:16:3e:89:06:c8", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf819d75d-a6", "ovs_interfaceid": "f819d75d-a65d-4342-9912-944d2fb13dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:06:c8,bridge_name='br-int',has_traffic_filtering=True,id=f819d75d-a65d-4342-9912-944d2fb13dd3,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf819d75d-a6') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG os_vif [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:06:c8,bridge_name='br-int',has_traffic_filtering=True,id=f819d75d-a65d-4342-9912-944d2fb13dd3,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf819d75d-a6') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf819d75d-a6, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a7e3c99-741f-4b43-ac8a-c5a36d2de7cd) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:08:47 user nova-compute[74898]: INFO os_vif [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:06:c8,bridge_name='br-int',has_traffic_filtering=True,id=f819d75d-a65d-4342-9912-944d2fb13dd3,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf819d75d-a6')
Nov 17 03:08:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjxCVeFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:08:47 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 17 03:08:47 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3fedb5-9ee3-42b6-be1b-8a79a4f5794e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:08:47 user nova-compute[74898]: No targets found.
Nov 17 03:08:47 user nova-compute[74898]: iSNS:
Nov 17 03:08:47 user nova-compute[74898]: No targets found.
Nov 17 03:08:47 user nova-compute[74898]: STATIC:
Nov 17 03:08:47 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7
Nov 17 03:08:47 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:08:47 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:08:47 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329
Nov 17 03:08:47 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:08:47 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:08:47 user nova-compute[74898]: FIRMWARE:
Nov 17 03:08:47 user nova-compute[74898]: No targets found.
Nov 17 03:08:47 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:08:47 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:08:47 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ce271a-0edc-4e70-a4b9-c969bf64b5fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6957b9c5-2570-4a1a-8fb3-356705ec6036]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:08:47 user nova-compute[74898]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)
Nov 17 03:08:47 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:08:47 user nova-compute[74898]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)
Nov 17 03:08:47 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf859ff40>, {}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Disconnecting from: [] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.079s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] <== disconnect_volume: return (80ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:08:47 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Deleting instance files /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a_del
Nov 17 03:08:47 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Deletion of /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a_del complete
Nov 17 03:08:47 user nova-compute[74898]: DEBUG nova.compute.manager [req-16e52683-ab2d-47b4-a022-60b69f842c07 req-30106a7b-b832-4bbd-804f-bea65bc2da6f service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Received event network-vif-plugged-f819d75d-a65d-4342-9912-944d2fb13dd3 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-16e52683-ab2d-47b4-a022-60b69f842c07 req-30106a7b-b832-4bbd-804f-bea65bc2da6f service nova] Acquiring lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-16e52683-ab2d-47b4-a022-60b69f842c07 req-30106a7b-b832-4bbd-804f-bea65bc2da6f service nova] Lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-16e52683-ab2d-47b4-a022-60b69f842c07 req-30106a7b-b832-4bbd-804f-bea65bc2da6f service nova] Lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG nova.compute.manager [req-16e52683-ab2d-47b4-a022-60b69f842c07 req-30106a7b-b832-4bbd-804f-bea65bc2da6f service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] No waiting events found dispatching network-vif-plugged-f819d75d-a65d-4342-9912-944d2fb13dd3 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:08:47 user nova-compute[74898]: WARNING nova.compute.manager [req-16e52683-ab2d-47b4-a022-60b69f842c07 req-30106a7b-b832-4bbd-804f-bea65bc2da6f service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Received unexpected event network-vif-plugged-f819d75d-a65d-4342-9912-944d2fb13dd3 for instance with vm_state active and task_state rebuilding.
Nov 17 03:08:47 user nova-compute[74898]: INFO nova.virt.block_device [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Booting with volume c48f4c9e-2c05-41b5-b2f8-236a81a837c2 at /dev/vdb
Nov 17 03:08:47 user nova-compute[74898]: DEBUG os_brick.utils [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:47 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca7c499-7c86-4827-ad80-c9740d91d17b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.volume.cinder [None req-3deec530-4612-4018-ac90-60fba525ab88 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Update attachment failed for attachment 65f58d73-b4b7-42d0-be04-9be0ebdf0c32. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-85ce9be7-7276-4683-a07f-c8d93a50f4ba) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-85ce9be7-7276-4683-a07f-c8d93a50f4ba)
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [None req-3deec530-4612-4018-ac90-60fba525ab88 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Failed to attach 5ba7f9f2-668a-4a91-9631-bc7b8a8cc71d at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-85ce9be7-7276-4683-a07f-c8d93a50f4ba)
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Traceback (most recent call last):
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]     ret_val = method(obj, context, *args, **kwargs)
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]     self._do_attach(context, instance, volume, volume_api,
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]     self._volume_attach(context, volume, connector, instance,
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]     connection_info = volume_api.attachment_update(
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]     res = method(self, ctx, *args, **kwargs)
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]     with excutils.save_and_reraise_exception():
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]     self.force_reraise()
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]     raise self.value
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]     context, '3.44', skip_version_check=True).attachments.update(
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]     return method.func(obj, *args, **kwargs)
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]     resp = self._update('/attachments/%s' % id, body)
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]     return self._cs_request(url, 'PUT', **kwargs)
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]     return self.request(url, method, **kwargs)
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd]     raise exceptions.from_response(resp, body)
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-85ce9be7-7276-4683-a07f-c8d93a50f4ba)
Nov 17 03:08:48 user nova-compute[74898]: ERROR nova.compute.manager [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] 
Nov 17 03:08:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[50167344-45e4-4940-b822-114099749013]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ed4847-a695-456c-9f92-2b6ee4cc4356]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[050c49b0-9246-4cea-8aca-e40a3d17eb2a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:08:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:08:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:08:48 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:08:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9f96b5-b56b-4141-9a8e-e11cfe6b4d7e]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:08:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:08:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:08:48 user nova-compute[74898]: DEBUG os_brick.utils [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:08:48 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Updating existing volume attachment record: b68620a6-7be3-413d-b053-6fdf6d045278 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:08:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3deec530-4612-4018-ac90-60fba525ab88 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "f457f5c7-58e3-4f7f-b495-6cfd3440d7dd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.953s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server [None req-3deec530-4612-4018-ac90-60fba525ab88 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-85ce9be7-7276-4683-a07f-c8d93a50f4ba)
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-85ce9be7-7276-4683-a07f-c8d93a50f4ba)
Nov 17 03:08:48 user nova-compute[74898]: ERROR oslo_messaging.rpc.server 
Nov 17 03:08:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:08:57 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Creating image(s)
Nov 17 03:08:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "/opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "/opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "/opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.179s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.205s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk 1073741824" returned: 0 in 0.049s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.172s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Cannot resize image /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Ensure instance console log exists: /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Start _get_guest_xml network_info=[{"id": "f819d75d-a65d-4342-9912-944d2fb13dd3", "address": "fa:16:3e:89:06:c8", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf819d75d-a6", "ovs_interfaceid": "f819d75d-a65d-4342-9912-944d2fb13dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjxCVeFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f25ef6a9-d007-419d-8478-2a9e79d5f03a', 'attached_at': '', 'detached_at': '', 'volume_id': 'c48f4c9e-2c05-41b5-b2f8-236a81a837c2', 'serial': 'c48f4c9e-2c05-41b5-b2f8-236a81a837c2'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'b68620a6-7be3-413d-b053-6fdf6d045278', 'volume_type': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:08:57 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 17 03:08:57 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 17 03:08:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:08:57 user nova-compute[74898]: DEBUG nova.objects.instance [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lazy-loading 'vcpu_model' on Instance uuid f25ef6a9-d007-419d-8478-2a9e79d5f03a {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjxCVeFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:08:58 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 17 03:08:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:08:58 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 17 03:08:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:08:58 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f6f3e6-8ec1-43e0-abdc-aacb6b386afa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:08:58 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee4d644-3970-4786-b021-6ec2ca690f4c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2] added
Nov 17 03:08:58 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9883dd-7bb2-45b0-95a3-efc47845bc4f]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.112s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[65682160-8a90-4b87-957c-654b02615264]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TjxCVeFd {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TjxCVeFd" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6ab786-22cd-49bb-82a5-8cd3ec47f641]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TjxCVeFd'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1983ed0-3e1b-4253-ad4f-8471a5b1ff67]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[64936750-82fb-42fe-851a-f6799e774aa5]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:08:58 user nova-compute[74898]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)
Nov 17 03:08:58 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:08:58 user nova-compute[74898]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)
Nov 17 03:08:58 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d43f74a-d6da-4bc7-86ca-59e6630d635e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2, portal: 172.16.0.220,3260]
Nov 17 03:08:58 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2, portal: 172.16.0.220,3260] successful.
Nov 17 03:08:58 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b857faa6-196c-432f-a2ca-c1e91de63694]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[83411941-65bf-4284-916e-ccf48e89d5d9]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:08:58 user nova-compute[74898]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)
Nov 17 03:08:58 user nova-compute[74898]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:08:58 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:08:58 user nova-compute[74898]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)
Nov 17 03:08:58 user nova-compute[74898]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:08:58 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3f4f27-8e8e-4a0c-8c09-d9c77fabb9fa]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: None {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:08:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:59 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:08:59 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjxCVeFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:08:59 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:08:59 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '23735646462336436', 'path': '/dev/sdd'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:08:59 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735646462336436', 'path': '/dev/sdd'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:08:59 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-17T03:06:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-300218009',display_name='tempest-ServerActionsTestOtherA-server-1915932620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-300218009',id=19,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHj48AyfPGEuTYyaaXRPfUux/t0c9DvnKU2/5+czxQ0LiT4+FXnkFmRFT1qWvFotFB4OLCF7MZEn857VDvvqJISIgLBUP+o+9WiZvKEG2wWiBy731G5vP6ol8yd3WhW9MQ==',key_name='tempest-keypair-278072850',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:06:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4ff82629b7d7486a86574994974fabda',ramdisk_id='',reservation_id='r-orvyz1o1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-214359699',owner_user_name='tempest-ServerActionsTestOtherA-214359699-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:08:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28445b2b2360414bac2607ec94166369',uuid=f25ef6a9-d007-419d-8478-2a9e79d5f03a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f819d75d-a65d-4342-9912-944d2fb13dd3", "address": "fa:16:3e:89:06:c8", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf819d75d-a6", "ovs_interfaceid": "f819d75d-a65d-4342-9912-944d2fb13dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:08:59 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Converting VIF {"id": "f819d75d-a65d-4342-9912-944d2fb13dd3", "address": "fa:16:3e:89:06:c8", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf819d75d-a6", "ovs_interfaceid": "f819d75d-a65d-4342-9912-944d2fb13dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:08:59 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:06:c8,bridge_name='br-int',has_traffic_filtering=True,id=f819d75d-a65d-4342-9912-944d2fb13dd3,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf819d75d-a6') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:08:59 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:08:59 user nova-compute[74898]:   <uuid>f25ef6a9-d007-419d-8478-2a9e79d5f03a</uuid>
Nov 17 03:08:59 user nova-compute[74898]:   <name>instance-00000013</name>
Nov 17 03:08:59 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:08:59 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:08:59 user nova-compute[74898]:   <metadata>
Nov 17 03:08:59 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:08:59 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:08:59 user nova-compute[74898]:       <nova:name>tempest-ServerActionsTestOtherA-server-1915932620</nova:name>
Nov 17 03:08:59 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:08:57</nova:creationTime>
Nov 17 03:08:59 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:08:59 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:08:59 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:08:59 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:08:59 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:08:59 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:08:59 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:08:59 user nova-compute[74898]:       <nova:owner>
Nov 17 03:08:59 user nova-compute[74898]:         <nova:user uuid="28445b2b2360414bac2607ec94166369">tempest-ServerActionsTestOtherA-214359699-project-member</nova:user>
Nov 17 03:08:59 user nova-compute[74898]:         <nova:project uuid="4ff82629b7d7486a86574994974fabda">tempest-ServerActionsTestOtherA-214359699</nova:project>
Nov 17 03:08:59 user nova-compute[74898]:       </nova:owner>
Nov 17 03:08:59 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:08:59 user nova-compute[74898]:       <nova:ports>
Nov 17 03:08:59 user nova-compute[74898]:         <nova:port uuid="f819d75d-a65d-4342-9912-944d2fb13dd3">
Nov 17 03:08:59 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 17 03:08:59 user nova-compute[74898]:         </nova:port>
Nov 17 03:08:59 user nova-compute[74898]:       </nova:ports>
Nov 17 03:08:59 user nova-compute[74898]:     </nova:instance>
Nov 17 03:08:59 user nova-compute[74898]:   </metadata>
Nov 17 03:08:59 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:08:59 user nova-compute[74898]:     <system>
Nov 17 03:08:59 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:08:59 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:08:59 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:08:59 user nova-compute[74898]:       <entry name="serial">f25ef6a9-d007-419d-8478-2a9e79d5f03a</entry>
Nov 17 03:08:59 user nova-compute[74898]:       <entry name="uuid">f25ef6a9-d007-419d-8478-2a9e79d5f03a</entry>
Nov 17 03:08:59 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:08:59 user nova-compute[74898]:     </system>
Nov 17 03:08:59 user nova-compute[74898]:   </sysinfo>
Nov 17 03:08:59 user nova-compute[74898]:   <os>
Nov 17 03:08:59 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:08:59 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:08:59 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:08:59 user nova-compute[74898]:   </os>
Nov 17 03:08:59 user nova-compute[74898]:   <features>
Nov 17 03:08:59 user nova-compute[74898]:     <acpi/>
Nov 17 03:08:59 user nova-compute[74898]:     <apic/>
Nov 17 03:08:59 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:08:59 user nova-compute[74898]:   </features>
Nov 17 03:08:59 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:08:59 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:08:59 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:08:59 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:08:59 user nova-compute[74898]:   </clock>
Nov 17 03:08:59 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:08:59 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:08:59 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:08:59 user nova-compute[74898]:   </cpu>
Nov 17 03:08:59 user nova-compute[74898]:   <devices>
Nov 17 03:08:59 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:08:59 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:08:59 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk"/>
Nov 17 03:08:59 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:08:59 user nova-compute[74898]:     </disk>
Nov 17 03:08:59 user nova-compute[74898]:     <disk type="block" device="disk">
Nov 17 03:08:59 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:08:59 user nova-compute[74898]:       <source dev="/dev/sdd"/>
Nov 17 03:08:59 user nova-compute[74898]:       <target dev="vdb" bus="virtio"/>
Nov 17 03:08:59 user nova-compute[74898]:       <serial>c48f4c9e-2c05-41b5-b2f8-236a81a837c2</serial>
Nov 17 03:08:59 user nova-compute[74898]:     </disk>
Nov 17 03:08:59 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:08:59 user nova-compute[74898]:       <mac address="fa:16:3e:89:06:c8"/>
Nov 17 03:08:59 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:08:59 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:08:59 user nova-compute[74898]:       <target dev="tapf819d75d-a6"/>
Nov 17 03:08:59 user nova-compute[74898]:     </interface>
Nov 17 03:08:59 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:08:59 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/console.log" append="off"/>
Nov 17 03:08:59 user nova-compute[74898]:     </serial>
Nov 17 03:08:59 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:08:59 user nova-compute[74898]:     <video>
Nov 17 03:08:59 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:08:59 user nova-compute[74898]:     </video>
Nov 17 03:08:59 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:08:59 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:08:59 user nova-compute[74898]:     </rng>
Nov 17 03:08:59 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:08:59 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:08:59 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:08:59 user nova-compute[74898]:     </memballoon>
Nov 17 03:08:59 user nova-compute[74898]:   </devices>
Nov 17 03:08:59 user nova-compute[74898]: </domain>
Nov 17 03:08:59 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:08:59 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-17T03:06:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-300218009',display_name='tempest-ServerActionsTestOtherA-server-1915932620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-300218009',id=19,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHj48AyfPGEuTYyaaXRPfUux/t0c9DvnKU2/5+czxQ0LiT4+FXnkFmRFT1qWvFotFB4OLCF7MZEn857VDvvqJISIgLBUP+o+9WiZvKEG2wWiBy731G5vP6ol8yd3WhW9MQ==',key_name='tempest-keypair-278072850',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:06:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4ff82629b7d7486a86574994974fabda',ramdisk_id='',reservation_id='r-orvyz1o1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-214359699',owner_user_name='tempest-ServerActionsTestOtherA-214359699-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:08:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28445b2b2360414bac2607ec94166369',uuid=f25ef6a9-d007-419d-8478-2a9e79d5f03a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f819d75d-a65d-4342-9912-944d2fb13dd3", "address": "fa:16:3e:89:06:c8", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf819d75d-a6", "ovs_interfaceid": "f819d75d-a65d-4342-9912-944d2fb13dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:08:59 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Converting VIF {"id": "f819d75d-a65d-4342-9912-944d2fb13dd3", "address": "fa:16:3e:89:06:c8", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf819d75d-a6", "ovs_interfaceid": "f819d75d-a65d-4342-9912-944d2fb13dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:08:59 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:06:c8,bridge_name='br-int',has_traffic_filtering=True,id=f819d75d-a65d-4342-9912-944d2fb13dd3,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf819d75d-a6') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:08:59 user nova-compute[74898]: DEBUG os_vif [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:06:c8,bridge_name='br-int',has_traffic_filtering=True,id=f819d75d-a65d-4342-9912-944d2fb13dd3,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf819d75d-a6') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:08:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:08:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:08:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8167e7f7-6ada-5ff5-a732-6170eb4d4d23', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:08:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf819d75d-a6, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:08:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf819d75d-a6, col_values=(('qos', UUID('eb15fd11-4841-4e53-adaa-7a65145c4952')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:08:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf819d75d-a6, col_values=(('external_ids', {'iface-id': 'f819d75d-a65d-4342-9912-944d2fb13dd3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:06:c8', 'vm-uuid': 'f25ef6a9-d007-419d-8478-2a9e79d5f03a'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:08:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:08:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:08:59 user nova-compute[74898]: INFO os_vif [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:06:c8,bridge_name='br-int',has_traffic_filtering=True,id=f819d75d-a65d-4342-9912-944d2fb13dd3,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf819d75d-a6')
Nov 17 03:08:59 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:08:59 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:08:59 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] No VIF found with MAC fa:16:3e:89:06:c8, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:09:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:01 user nova-compute[74898]: DEBUG nova.compute.manager [req-aa649b89-9e29-453c-ac8d-9f843c6af251 req-20845e6d-b489-4c81-8321-de3323a1d0cc service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Received event network-vif-plugged-f819d75d-a65d-4342-9912-944d2fb13dd3 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:09:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-aa649b89-9e29-453c-ac8d-9f843c6af251 req-20845e6d-b489-4c81-8321-de3323a1d0cc service nova] Acquiring lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:09:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-aa649b89-9e29-453c-ac8d-9f843c6af251 req-20845e6d-b489-4c81-8321-de3323a1d0cc service nova] Lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:09:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-aa649b89-9e29-453c-ac8d-9f843c6af251 req-20845e6d-b489-4c81-8321-de3323a1d0cc service nova] Lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:09:01 user nova-compute[74898]: DEBUG nova.compute.manager [req-aa649b89-9e29-453c-ac8d-9f843c6af251 req-20845e6d-b489-4c81-8321-de3323a1d0cc service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] No waiting events found dispatching network-vif-plugged-f819d75d-a65d-4342-9912-944d2fb13dd3 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:09:01 user nova-compute[74898]: WARNING nova.compute.manager [req-aa649b89-9e29-453c-ac8d-9f843c6af251 req-20845e6d-b489-4c81-8321-de3323a1d0cc service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Received unexpected event network-vif-plugged-f819d75d-a65d-4342-9912-944d2fb13dd3 for instance with vm_state active and task_state rebuild_spawning.
Nov 17 03:09:03 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:09:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:09:03 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Instance spawned successfully.
Nov 17 03:09:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:09:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:09:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:09:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:09:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:09:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:09:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:09:03 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:09:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:09:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:09:03 user nova-compute[74898]: DEBUG nova.objects.instance [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74898) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 17 03:09:03 user nova-compute[74898]: DEBUG nova.compute.manager [req-c4928e37-a4a8-4b4b-8906-57784234a548 req-ad7c11e2-13b5-4168-8713-e5329ce7fdc5 service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Received event network-vif-plugged-f819d75d-a65d-4342-9912-944d2fb13dd3 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:09:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c4928e37-a4a8-4b4b-8906-57784234a548 req-ad7c11e2-13b5-4168-8713-e5329ce7fdc5 service nova] Acquiring lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:09:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c4928e37-a4a8-4b4b-8906-57784234a548 req-ad7c11e2-13b5-4168-8713-e5329ce7fdc5 service nova] Lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:09:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c4928e37-a4a8-4b4b-8906-57784234a548 req-ad7c11e2-13b5-4168-8713-e5329ce7fdc5 service nova] Lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:09:03 user nova-compute[74898]: DEBUG nova.compute.manager [req-c4928e37-a4a8-4b4b-8906-57784234a548 req-ad7c11e2-13b5-4168-8713-e5329ce7fdc5 service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] No waiting events found dispatching network-vif-plugged-f819d75d-a65d-4342-9912-944d2fb13dd3 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:09:03 user nova-compute[74898]: WARNING nova.compute.manager [req-c4928e37-a4a8-4b4b-8906-57784234a548 req-ad7c11e2-13b5-4168-8713-e5329ce7fdc5 service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Received unexpected event network-vif-plugged-f819d75d-a65d-4342-9912-944d2fb13dd3 for instance with vm_state active and task_state None.
Nov 17 03:09:03 user nova-compute[74898]: DEBUG nova.compute.manager [None req-25474349-382a-44fe-8936-bc0d5b9fefa6 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:09:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a046cc7f-7bab-40b7-9fa2-3c057b98df80 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.091s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:09:03 user nova-compute[74898]: INFO nova.compute.manager [None req-25474349-382a-44fe-8936-bc0d5b9fefa6 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] instance snapshotting
Nov 17 03:09:03 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-25474349-382a-44fe-8936-bc0d5b9fefa6 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Beginning live snapshot process
Nov 17 03:09:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-25474349-382a-44fe-8936-bc0d5b9fefa6 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json -f qcow2 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-25474349-382a-44fe-8936-bc0d5b9fefa6 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-25474349-382a-44fe-8936-bc0d5b9fefa6 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json -f qcow2 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:04 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-25474349-382a-44fe-8936-bc0d5b9fefa6 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json -f qcow2" returned: 0 in 0.205s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:04 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-25474349-382a-44fe-8936-bc0d5b9fefa6 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:04 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-25474349-382a-44fe-8936-bc0d5b9fefa6 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.296s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:04 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-25474349-382a-44fe-8936-bc0d5b9fefa6 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpb1q9rr4u/9b43a1f3061d4abfb134382c6cfa9336.delta 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:04 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-25474349-382a-44fe-8936-bc0d5b9fefa6 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpb1q9rr4u/9b43a1f3061d4abfb134382c6cfa9336.delta 1073741824" returned: 0 in 0.077s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:04 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-25474349-382a-44fe-8936-bc0d5b9fefa6 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 17 03:09:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:05 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-25474349-382a-44fe-8936-bc0d5b9fefa6 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74898) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 03:09:05 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-25474349-382a-44fe-8936-bc0d5b9fefa6 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] COPY block job progress, current cursor: 75300864 final cursor: 75497472 {{(pid=74898) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 03:09:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:06 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-25474349-382a-44fe-8936-bc0d5b9fefa6 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74898) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 03:09:06 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-25474349-382a-44fe-8936-bc0d5b9fefa6 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 17 03:09:06 user nova-compute[74898]: DEBUG nova.privsep.utils [None req-25474349-382a-44fe-8936-bc0d5b9fefa6 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74898) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 03:09:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-25474349-382a-44fe-8936-bc0d5b9fefa6 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpb1q9rr4u/9b43a1f3061d4abfb134382c6cfa9336.delta /opt/stack/data/nova/instances/snapshots/tmpb1q9rr4u/9b43a1f3061d4abfb134382c6cfa9336 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-25474349-382a-44fe-8936-bc0d5b9fefa6 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpb1q9rr4u/9b43a1f3061d4abfb134382c6cfa9336.delta /opt/stack/data/nova/instances/snapshots/tmpb1q9rr4u/9b43a1f3061d4abfb134382c6cfa9336" returned: 0 in 0.806s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:07 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-25474349-382a-44fe-8936-bc0d5b9fefa6 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Snapshot extracted, beginning image upload
Nov 17 03:09:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Acquiring lock "ff69d6dd-bce4-400b-8f03-429068cf32eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:09:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "ff69d6dd-bce4-400b-8f03-429068cf32eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:09:10 user nova-compute[74898]: DEBUG nova.compute.manager [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:09:10 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-25474349-382a-44fe-8936-bc0d5b9fefa6 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Snapshot image upload complete
Nov 17 03:09:10 user nova-compute[74898]: INFO nova.compute.manager [None req-25474349-382a-44fe-8936-bc0d5b9fefa6 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Took 6.99 seconds to snapshot the instance on the hypervisor.
Nov 17 03:09:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:09:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:09:10 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:09:10 user nova-compute[74898]: INFO nova.compute.claims [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Claim successful on node user
Nov 17 03:09:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:10 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:09:10 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:09:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:09:10 user nova-compute[74898]: DEBUG nova.compute.manager [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:09:11 user nova-compute[74898]: DEBUG nova.compute.manager [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:09:11 user nova-compute[74898]: DEBUG nova.network.neutron [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:09:11 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:09:11 user nova-compute[74898]: DEBUG nova.compute.manager [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:09:11 user nova-compute[74898]: DEBUG nova.policy [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ebb3c9e75a2d4e858116fb214b411d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f68ad714a1e48a4aac171700c25db18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:09:11 user nova-compute[74898]: DEBUG nova.compute.manager [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:09:11 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:09:11 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Creating image(s)
Nov 17 03:09:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:09:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "/opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:09:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "/opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:09:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.189s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:09:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:09:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.175s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk 1073741824" returned: 0 in 0.049s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:09:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.187s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:11 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:09:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:12 user nova-compute[74898]: DEBUG nova.network.neutron [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Successfully created port: 4416778f-d8de-4b5e-bf50-fd2ccb987f26 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:09:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:12 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Cannot resize image /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:09:12 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:09:12 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Ensure instance console log exists: /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:09:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:09:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:09:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:09:12 user nova-compute[74898]: DEBUG nova.network.neutron [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Successfully updated port: 4416778f-d8de-4b5e-bf50-fd2ccb987f26 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:09:12 user nova-compute[74898]: DEBUG nova.compute.manager [req-13f9aea7-fd77-4e97-803c-c9017b7058d2 req-dec5c468-4a81-4a76-a63c-aa767bcbff6a service nova] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Received event network-changed-4416778f-d8de-4b5e-bf50-fd2ccb987f26 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:09:12 user nova-compute[74898]: DEBUG nova.compute.manager [req-13f9aea7-fd77-4e97-803c-c9017b7058d2 req-dec5c468-4a81-4a76-a63c-aa767bcbff6a service nova] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Refreshing instance network info cache due to event network-changed-4416778f-d8de-4b5e-bf50-fd2ccb987f26. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:09:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-13f9aea7-fd77-4e97-803c-c9017b7058d2 req-dec5c468-4a81-4a76-a63c-aa767bcbff6a service nova] Acquiring lock "refresh_cache-ff69d6dd-bce4-400b-8f03-429068cf32eb" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:09:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-13f9aea7-fd77-4e97-803c-c9017b7058d2 req-dec5c468-4a81-4a76-a63c-aa767bcbff6a service nova] Acquired lock "refresh_cache-ff69d6dd-bce4-400b-8f03-429068cf32eb" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:09:12 user nova-compute[74898]: DEBUG nova.network.neutron [req-13f9aea7-fd77-4e97-803c-c9017b7058d2 req-dec5c468-4a81-4a76-a63c-aa767bcbff6a service nova] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Refreshing network info cache for port 4416778f-d8de-4b5e-bf50-fd2ccb987f26 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:09:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Acquiring lock "refresh_cache-ff69d6dd-bce4-400b-8f03-429068cf32eb" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:09:12 user nova-compute[74898]: DEBUG nova.network.neutron [req-13f9aea7-fd77-4e97-803c-c9017b7058d2 req-dec5c468-4a81-4a76-a63c-aa767bcbff6a service nova] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.network.neutron [req-13f9aea7-fd77-4e97-803c-c9017b7058d2 req-dec5c468-4a81-4a76-a63c-aa767bcbff6a service nova] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-13f9aea7-fd77-4e97-803c-c9017b7058d2 req-dec5c468-4a81-4a76-a63c-aa767bcbff6a service nova] Releasing lock "refresh_cache-ff69d6dd-bce4-400b-8f03-429068cf32eb" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Acquired lock "refresh_cache-ff69d6dd-bce4-400b-8f03-429068cf32eb" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.network.neutron [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.network.neutron [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.network.neutron [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Updating instance_info_cache with network_info: [{"id": "4416778f-d8de-4b5e-bf50-fd2ccb987f26", "address": "fa:16:3e:38:65:e3", "network": {"id": "9a342d69-a890-4e6d-af91-66e71d4a1ea8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1591686450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f68ad714a1e48a4aac171700c25db18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4416778f-d8", "ovs_interfaceid": "4416778f-d8de-4b5e-bf50-fd2ccb987f26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Releasing lock "refresh_cache-ff69d6dd-bce4-400b-8f03-429068cf32eb" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.compute.manager [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Instance network_info: |[{"id": "4416778f-d8de-4b5e-bf50-fd2ccb987f26", "address": "fa:16:3e:38:65:e3", "network": {"id": "9a342d69-a890-4e6d-af91-66e71d4a1ea8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1591686450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f68ad714a1e48a4aac171700c25db18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4416778f-d8", "ovs_interfaceid": "4416778f-d8de-4b5e-bf50-fd2ccb987f26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Start _get_guest_xml network_info=[{"id": "4416778f-d8de-4b5e-bf50-fd2ccb987f26", "address": "fa:16:3e:38:65:e3", "network": {"id": "9a342d69-a890-4e6d-af91-66e71d4a1ea8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1591686450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f68ad714a1e48a4aac171700c25db18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4416778f-d8", "ovs_interfaceid": "4416778f-d8de-4b5e-bf50-fd2ccb987f26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:09:13 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:09:13 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:09:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1501098137',display_name='tempest-ServersNegativeTestJSON-server-1501098137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1501098137',id=25,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f68ad714a1e48a4aac171700c25db18',ramdisk_id='',reservation_id='r-evmkpn1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-945120285',owner_user_name='tempest-ServersNegativeTestJSON-945120285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:09:11Z,user_data=None,user_id='ebb3c9e75a2d4e858116fb214b411d8d',uuid=ff69d6dd-bce4-400b-8f03-429068cf32eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4416778f-d8de-4b5e-bf50-fd2ccb987f26", "address": "fa:16:3e:38:65:e3", "network": {"id": "9a342d69-a890-4e6d-af91-66e71d4a1ea8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1591686450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f68ad714a1e48a4aac171700c25db18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4416778f-d8", "ovs_interfaceid": "4416778f-d8de-4b5e-bf50-fd2ccb987f26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Converting VIF {"id": "4416778f-d8de-4b5e-bf50-fd2ccb987f26", "address": "fa:16:3e:38:65:e3", "network": {"id": "9a342d69-a890-4e6d-af91-66e71d4a1ea8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1591686450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f68ad714a1e48a4aac171700c25db18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4416778f-d8", "ovs_interfaceid": "4416778f-d8de-4b5e-bf50-fd2ccb987f26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:65:e3,bridge_name='br-int',has_traffic_filtering=True,id=4416778f-d8de-4b5e-bf50-fd2ccb987f26,network=Network(9a342d69-a890-4e6d-af91-66e71d4a1ea8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4416778f-d8') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.objects.instance [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lazy-loading 'pci_devices' on Instance uuid ff69d6dd-bce4-400b-8f03-429068cf32eb {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:09:13 user nova-compute[74898]:   <uuid>ff69d6dd-bce4-400b-8f03-429068cf32eb</uuid>
Nov 17 03:09:13 user nova-compute[74898]:   <name>instance-00000019</name>
Nov 17 03:09:13 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:09:13 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:09:13 user nova-compute[74898]:   <metadata>
Nov 17 03:09:13 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:09:13 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:09:13 user nova-compute[74898]:       <nova:name>tempest-ServersNegativeTestJSON-server-1501098137</nova:name>
Nov 17 03:09:13 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:09:13</nova:creationTime>
Nov 17 03:09:13 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:09:13 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:09:13 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:09:13 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:09:13 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:09:13 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:09:13 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:09:13 user nova-compute[74898]:       <nova:owner>
Nov 17 03:09:13 user nova-compute[74898]:         <nova:user uuid="ebb3c9e75a2d4e858116fb214b411d8d">tempest-ServersNegativeTestJSON-945120285-project-member</nova:user>
Nov 17 03:09:13 user nova-compute[74898]:         <nova:project uuid="9f68ad714a1e48a4aac171700c25db18">tempest-ServersNegativeTestJSON-945120285</nova:project>
Nov 17 03:09:13 user nova-compute[74898]:       </nova:owner>
Nov 17 03:09:13 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:09:13 user nova-compute[74898]:       <nova:ports>
Nov 17 03:09:13 user nova-compute[74898]:         <nova:port uuid="4416778f-d8de-4b5e-bf50-fd2ccb987f26">
Nov 17 03:09:13 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 17 03:09:13 user nova-compute[74898]:         </nova:port>
Nov 17 03:09:13 user nova-compute[74898]:       </nova:ports>
Nov 17 03:09:13 user nova-compute[74898]:     </nova:instance>
Nov 17 03:09:13 user nova-compute[74898]:   </metadata>
Nov 17 03:09:13 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:09:13 user nova-compute[74898]:     <system>
Nov 17 03:09:13 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:09:13 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:09:13 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:09:13 user nova-compute[74898]:       <entry name="serial">ff69d6dd-bce4-400b-8f03-429068cf32eb</entry>
Nov 17 03:09:13 user nova-compute[74898]:       <entry name="uuid">ff69d6dd-bce4-400b-8f03-429068cf32eb</entry>
Nov 17 03:09:13 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:09:13 user nova-compute[74898]:     </system>
Nov 17 03:09:13 user nova-compute[74898]:   </sysinfo>
Nov 17 03:09:13 user nova-compute[74898]:   <os>
Nov 17 03:09:13 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:09:13 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:09:13 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:09:13 user nova-compute[74898]:   </os>
Nov 17 03:09:13 user nova-compute[74898]:   <features>
Nov 17 03:09:13 user nova-compute[74898]:     <acpi/>
Nov 17 03:09:13 user nova-compute[74898]:     <apic/>
Nov 17 03:09:13 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:09:13 user nova-compute[74898]:   </features>
Nov 17 03:09:13 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:09:13 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:09:13 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:09:13 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:09:13 user nova-compute[74898]:   </clock>
Nov 17 03:09:13 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:09:13 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:09:13 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:09:13 user nova-compute[74898]:   </cpu>
Nov 17 03:09:13 user nova-compute[74898]:   <devices>
Nov 17 03:09:13 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:09:13 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:09:13 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk"/>
Nov 17 03:09:13 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:09:13 user nova-compute[74898]:     </disk>
Nov 17 03:09:13 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:09:13 user nova-compute[74898]:       <mac address="fa:16:3e:38:65:e3"/>
Nov 17 03:09:13 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:09:13 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:09:13 user nova-compute[74898]:       <target dev="tap4416778f-d8"/>
Nov 17 03:09:13 user nova-compute[74898]:     </interface>
Nov 17 03:09:13 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:09:13 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/console.log" append="off"/>
Nov 17 03:09:13 user nova-compute[74898]:     </serial>
Nov 17 03:09:13 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:09:13 user nova-compute[74898]:     <video>
Nov 17 03:09:13 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:09:13 user nova-compute[74898]:     </video>
Nov 17 03:09:13 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:09:13 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:09:13 user nova-compute[74898]:     </rng>
Nov 17 03:09:13 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:09:13 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:09:13 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:09:13 user nova-compute[74898]:     </memballoon>
Nov 17 03:09:13 user nova-compute[74898]:   </devices>
Nov 17 03:09:13 user nova-compute[74898]: </domain>
Nov 17 03:09:13 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:09:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1501098137',display_name='tempest-ServersNegativeTestJSON-server-1501098137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1501098137',id=25,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f68ad714a1e48a4aac171700c25db18',ramdisk_id='',reservation_id='r-evmkpn1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-945120285',owner_user_name='tempest-ServersNegativeTestJSON-945120285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:09:11Z,user_data=None,user_id='ebb3c9e75a2d4e858116fb214b411d8d',uuid=ff69d6dd-bce4-400b-8f03-429068cf32eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4416778f-d8de-4b5e-bf50-fd2ccb987f26", "address": "fa:16:3e:38:65:e3", "network": {"id": "9a342d69-a890-4e6d-af91-66e71d4a1ea8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1591686450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f68ad714a1e48a4aac171700c25db18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4416778f-d8", "ovs_interfaceid": "4416778f-d8de-4b5e-bf50-fd2ccb987f26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Converting VIF {"id": "4416778f-d8de-4b5e-bf50-fd2ccb987f26", "address": "fa:16:3e:38:65:e3", "network": {"id": "9a342d69-a890-4e6d-af91-66e71d4a1ea8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1591686450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f68ad714a1e48a4aac171700c25db18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4416778f-d8", "ovs_interfaceid": "4416778f-d8de-4b5e-bf50-fd2ccb987f26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:65:e3,bridge_name='br-int',has_traffic_filtering=True,id=4416778f-d8de-4b5e-bf50-fd2ccb987f26,network=Network(9a342d69-a890-4e6d-af91-66e71d4a1ea8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4416778f-d8') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG os_vif [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:65:e3,bridge_name='br-int',has_traffic_filtering=True,id=4416778f-d8de-4b5e-bf50-fd2ccb987f26,network=Network(9a342d69-a890-4e6d-af91-66e71d4a1ea8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4416778f-d8') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b8a61ee-8c0c-5cb8-90e7-ec426b3fe0b8', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4416778f-d8, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4416778f-d8, col_values=(('qos', UUID('1567fc70-e1ac-4fce-a7dd-17e5c3e93f23')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4416778f-d8, col_values=(('external_ids', {'iface-id': '4416778f-d8de-4b5e-bf50-fd2ccb987f26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:65:e3', 'vm-uuid': 'ff69d6dd-bce4-400b-8f03-429068cf32eb'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:13 user nova-compute[74898]: INFO os_vif [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:65:e3,bridge_name='br-int',has_traffic_filtering=True,id=4416778f-d8de-4b5e-bf50-fd2ccb987f26,network=Network(9a342d69-a890-4e6d-af91-66e71d4a1ea8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4416778f-d8')
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:09:13 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] No VIF found with MAC fa:16:3e:38:65:e3, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:09:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:15 user nova-compute[74898]: DEBUG nova.compute.manager [req-fd5e1901-a2aa-4836-9640-3013bf6318dc req-1b5983fe-915d-4a7e-9ddb-09a65d406ac8 service nova] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Received event network-vif-plugged-4416778f-d8de-4b5e-bf50-fd2ccb987f26 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:09:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fd5e1901-a2aa-4836-9640-3013bf6318dc req-1b5983fe-915d-4a7e-9ddb-09a65d406ac8 service nova] Acquiring lock "ff69d6dd-bce4-400b-8f03-429068cf32eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:09:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fd5e1901-a2aa-4836-9640-3013bf6318dc req-1b5983fe-915d-4a7e-9ddb-09a65d406ac8 service nova] Lock "ff69d6dd-bce4-400b-8f03-429068cf32eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:09:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fd5e1901-a2aa-4836-9640-3013bf6318dc req-1b5983fe-915d-4a7e-9ddb-09a65d406ac8 service nova] Lock "ff69d6dd-bce4-400b-8f03-429068cf32eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:09:15 user nova-compute[74898]: DEBUG nova.compute.manager [req-fd5e1901-a2aa-4836-9640-3013bf6318dc req-1b5983fe-915d-4a7e-9ddb-09a65d406ac8 service nova] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] No waiting events found dispatching network-vif-plugged-4416778f-d8de-4b5e-bf50-fd2ccb987f26 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:09:15 user nova-compute[74898]: WARNING nova.compute.manager [req-fd5e1901-a2aa-4836-9640-3013bf6318dc req-1b5983fe-915d-4a7e-9ddb-09a65d406ac8 service nova] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Received unexpected event network-vif-plugged-4416778f-d8de-4b5e-bf50-fd2ccb987f26 for instance with vm_state building and task_state spawning.
Nov 17 03:09:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:17 user nova-compute[74898]: DEBUG nova.compute.manager [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:09:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:09:17 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Instance spawned successfully.
Nov 17 03:09:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:09:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:09:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:09:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:09:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:09:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:09:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:09:17 user nova-compute[74898]: INFO nova.compute.manager [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Took 6.00 seconds to spawn the instance on the hypervisor.
Nov 17 03:09:17 user nova-compute[74898]: DEBUG nova.compute.manager [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:09:17 user nova-compute[74898]: DEBUG nova.compute.manager [req-06cc125f-8c57-4904-ad73-663a005a3b9a req-fb456c58-f80a-4a6d-9fa2-e61d6d91f22f service nova] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Received event network-vif-plugged-4416778f-d8de-4b5e-bf50-fd2ccb987f26 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:09:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-06cc125f-8c57-4904-ad73-663a005a3b9a req-fb456c58-f80a-4a6d-9fa2-e61d6d91f22f service nova] Acquiring lock "ff69d6dd-bce4-400b-8f03-429068cf32eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:09:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-06cc125f-8c57-4904-ad73-663a005a3b9a req-fb456c58-f80a-4a6d-9fa2-e61d6d91f22f service nova] Lock "ff69d6dd-bce4-400b-8f03-429068cf32eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:09:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-06cc125f-8c57-4904-ad73-663a005a3b9a req-fb456c58-f80a-4a6d-9fa2-e61d6d91f22f service nova] Lock "ff69d6dd-bce4-400b-8f03-429068cf32eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:09:17 user nova-compute[74898]: DEBUG nova.compute.manager [req-06cc125f-8c57-4904-ad73-663a005a3b9a req-fb456c58-f80a-4a6d-9fa2-e61d6d91f22f service nova] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] No waiting events found dispatching network-vif-plugged-4416778f-d8de-4b5e-bf50-fd2ccb987f26 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:09:17 user nova-compute[74898]: WARNING nova.compute.manager [req-06cc125f-8c57-4904-ad73-663a005a3b9a req-fb456c58-f80a-4a6d-9fa2-e61d6d91f22f service nova] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Received unexpected event network-vif-plugged-4416778f-d8de-4b5e-bf50-fd2ccb987f26 for instance with vm_state building and task_state spawning.
Nov 17 03:09:17 user nova-compute[74898]: INFO nova.compute.manager [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Took 6.99 seconds to build instance.
Nov 17 03:09:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-9a8c865b-1408-42c7-9fd4-315c8b8d9754 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "ff69d6dd-bce4-400b-8f03-429068cf32eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.094s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:09:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:18 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:09:18 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:09:19 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:09:19 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:09:19 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:09:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-42994e39-187a-4fb6-a293-24a4eb57177b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:09:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-42994e39-187a-4fb6-a293-24a4eb57177b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:09:20 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:09:20 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Updating instance_info_cache with network_info: [{"id": "92a5885a-8cb1-43f8-906a-97d7fa08eb62", "address": "fa:16:3e:ab:28:fe", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a5885a-8c", "ovs_interfaceid": "92a5885a-8cb1-43f8-906a-97d7fa08eb62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:09:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-42994e39-187a-4fb6-a293-24a4eb57177b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:09:20 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:09:20 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:09:20 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:09:20 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:09:20 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:09:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:21 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:09:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:09:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:09:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:09:21 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:09:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:23 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:09:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:24 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:09:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:25 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:09:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:26 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:09:26 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:09:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=7381MB free_disk=25.318523406982422GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:09:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:09:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:09:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:09:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance e733574a-56ba-4e24-babd-855bcb5bda61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:09:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 42994e39-187a-4fb6-a293-24a4eb57177b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:09:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance f25ef6a9-d007-419d-8478-2a9e79d5f03a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:09:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance f457f5c7-58e3-4f7f-b495-6cfd3440d7dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:09:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 13449e5c-809b-4db2-af0b-53f5865eb3a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:09:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance e188cb77-4a1d-4cab-9b32-9e3d442bb64d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:09:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance c49f4ec3-6f9b-4e14-ba29-208aa026301e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:09:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance a92bce56-1038-4762-9c1e-19b5a7ff8cef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:09:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance dbaabab0-92f0-480d-8f81-0db980c8f333 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:09:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance ff69d6dd-bce4-400b-8f03-429068cf32eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:09:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:09:26 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:09:27 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:09:27 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:09:27 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:09:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.558s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:09:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:29 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:09:29 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:09:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:37 user nova-compute[74898]: DEBUG nova.compute.manager [req-4de1adf9-c518-4d3f-9e8e-b85d28a5e8b1 req-75163149-498f-4d93-b514-919ada0bdf57 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Received event network-changed-1ab100dc-5533-4676-9814-2c9ce077e75e {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:09:37 user nova-compute[74898]: DEBUG nova.compute.manager [req-4de1adf9-c518-4d3f-9e8e-b85d28a5e8b1 req-75163149-498f-4d93-b514-919ada0bdf57 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Refreshing instance network info cache due to event network-changed-1ab100dc-5533-4676-9814-2c9ce077e75e. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:09:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4de1adf9-c518-4d3f-9e8e-b85d28a5e8b1 req-75163149-498f-4d93-b514-919ada0bdf57 service nova] Acquiring lock "refresh_cache-e188cb77-4a1d-4cab-9b32-9e3d442bb64d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:09:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4de1adf9-c518-4d3f-9e8e-b85d28a5e8b1 req-75163149-498f-4d93-b514-919ada0bdf57 service nova] Acquired lock "refresh_cache-e188cb77-4a1d-4cab-9b32-9e3d442bb64d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:09:37 user nova-compute[74898]: DEBUG nova.network.neutron [req-4de1adf9-c518-4d3f-9e8e-b85d28a5e8b1 req-75163149-498f-4d93-b514-919ada0bdf57 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Refreshing network info cache for port 1ab100dc-5533-4676-9814-2c9ce077e75e {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:09:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Acquiring lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:09:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:09:37 user nova-compute[74898]: INFO nova.compute.manager [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Shelve offloading
Nov 17 03:09:37 user nova-compute[74898]: DEBUG nova.network.neutron [req-4de1adf9-c518-4d3f-9e8e-b85d28a5e8b1 req-75163149-498f-4d93-b514-919ada0bdf57 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Updated VIF entry in instance network info cache for port 1ab100dc-5533-4676-9814-2c9ce077e75e. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:09:37 user nova-compute[74898]: DEBUG nova.network.neutron [req-4de1adf9-c518-4d3f-9e8e-b85d28a5e8b1 req-75163149-498f-4d93-b514-919ada0bdf57 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Updating instance_info_cache with network_info: [{"id": "1ab100dc-5533-4676-9814-2c9ce077e75e", "address": "fa:16:3e:15:59:1e", "network": {"id": "52b2b9ce-ab0e-4516-b46f-04f1670a5859", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349717026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e17e2cb304d88832baac8d20b6ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab100dc-55", "ovs_interfaceid": "1ab100dc-5533-4676-9814-2c9ce077e75e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:09:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4de1adf9-c518-4d3f-9e8e-b85d28a5e8b1 req-75163149-498f-4d93-b514-919ada0bdf57 service nova] Releasing lock "refresh_cache-e188cb77-4a1d-4cab-9b32-9e3d442bb64d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:09:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:38 user nova-compute[74898]: DEBUG nova.compute.manager [req-47a4db62-c478-4ca5-ae50-56cb492fd297 req-c9f12a73-130f-4df0-a57d-cdd0a847f6ff service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Received event network-vif-unplugged-1ab100dc-5533-4676-9814-2c9ce077e75e {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:09:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-47a4db62-c478-4ca5-ae50-56cb492fd297 req-c9f12a73-130f-4df0-a57d-cdd0a847f6ff service nova] Acquiring lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:09:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-47a4db62-c478-4ca5-ae50-56cb492fd297 req-c9f12a73-130f-4df0-a57d-cdd0a847f6ff service nova] Lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:09:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-47a4db62-c478-4ca5-ae50-56cb492fd297 req-c9f12a73-130f-4df0-a57d-cdd0a847f6ff service nova] Lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:09:38 user nova-compute[74898]: DEBUG nova.compute.manager [req-47a4db62-c478-4ca5-ae50-56cb492fd297 req-c9f12a73-130f-4df0-a57d-cdd0a847f6ff service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] No waiting events found dispatching network-vif-unplugged-1ab100dc-5533-4676-9814-2c9ce077e75e {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:09:38 user nova-compute[74898]: WARNING nova.compute.manager [req-47a4db62-c478-4ca5-ae50-56cb492fd297 req-c9f12a73-130f-4df0-a57d-cdd0a847f6ff service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Received unexpected event network-vif-unplugged-1ab100dc-5533-4676-9814-2c9ce077e75e for instance with vm_state active and task_state shelving.
Nov 17 03:09:38 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Instance destroyed successfully.
Nov 17 03:09:38 user nova-compute[74898]: DEBUG nova.compute.manager [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:09:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Acquiring lock "refresh_cache-e188cb77-4a1d-4cab-9b32-9e3d442bb64d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:09:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Acquired lock "refresh_cache-e188cb77-4a1d-4cab-9b32-9e3d442bb64d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:09:38 user nova-compute[74898]: DEBUG nova.network.neutron [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:09:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:38 user nova-compute[74898]: DEBUG nova.network.neutron [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Updating instance_info_cache with network_info: [{"id": "1ab100dc-5533-4676-9814-2c9ce077e75e", "address": "fa:16:3e:15:59:1e", "network": {"id": "52b2b9ce-ab0e-4516-b46f-04f1670a5859", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349717026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e17e2cb304d88832baac8d20b6ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab100dc-55", "ovs_interfaceid": "1ab100dc-5533-4676-9814-2c9ce077e75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:09:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Releasing lock "refresh_cache-e188cb77-4a1d-4cab-9b32-9e3d442bb64d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-b53d8f46-3714-41cc-9fc8-f8418110691a req-63ee65c2-bd89-4896-95e8-f7b304864312 service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Received event network-changed-89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-b53d8f46-3714-41cc-9fc8-f8418110691a req-63ee65c2-bd89-4896-95e8-f7b304864312 service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Refreshing instance network info cache due to event network-changed-89cfa577-9add-4c3b-81be-59ddb7e34d59. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b53d8f46-3714-41cc-9fc8-f8418110691a req-63ee65c2-bd89-4896-95e8-f7b304864312 service nova] Acquiring lock "refresh_cache-c49f4ec3-6f9b-4e14-ba29-208aa026301e" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b53d8f46-3714-41cc-9fc8-f8418110691a req-63ee65c2-bd89-4896-95e8-f7b304864312 service nova] Acquired lock "refresh_cache-c49f4ec3-6f9b-4e14-ba29-208aa026301e" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG nova.network.neutron [req-b53d8f46-3714-41cc-9fc8-f8418110691a req-63ee65c2-bd89-4896-95e8-f7b304864312 service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Refreshing network info cache for port 89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG nova.network.neutron [req-b53d8f46-3714-41cc-9fc8-f8418110691a req-63ee65c2-bd89-4896-95e8-f7b304864312 service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Updated VIF entry in instance network info cache for port 89cfa577-9add-4c3b-81be-59ddb7e34d59. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG nova.network.neutron [req-b53d8f46-3714-41cc-9fc8-f8418110691a req-63ee65c2-bd89-4896-95e8-f7b304864312 service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Updating instance_info_cache with network_info: [{"id": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "address": "fa:16:3e:7d:3c:56", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89cfa577-9a", "ovs_interfaceid": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b53d8f46-3714-41cc-9fc8-f8418110691a req-63ee65c2-bd89-4896-95e8-f7b304864312 service nova] Releasing lock "refresh_cache-c49f4ec3-6f9b-4e14-ba29-208aa026301e" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:09:39 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Instance destroyed successfully.
Nov 17 03:09:39 user nova-compute[74898]: DEBUG nova.objects.instance [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lazy-loading 'resources' on Instance uuid e188cb77-4a1d-4cab-9b32-9e3d442bb64d {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:07:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-438225612',display_name='tempest-TestShelveInstance-server-438225612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-438225612',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDmSd2NGubOcYAcKcy9vf9FFiaZ53lvPXbeSEL0PYEMFkGQuwJsRdb52jAzPICFCNpjRnvRgeRQ61dhOkF/dPmPwKEFLeDVySR2pJ9NtHk/FzrMRYBMjdFKARvsHGoSKg==',key_name='tempest-TestShelveInstance-1240625614',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:07:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c9e17e2cb304d88832baac8d20b6ae8',ramdisk_id='',reservation_id='r-6x3ptz5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-440551976',owner_user_name='tempest-TestShelveInstance-440551976-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:07:58Z,user_data=None,user_id='633094c28d414c1fac599af2a16bc1f6',uuid=e188cb77-4a1d-4cab-9b32-9e3d442bb64d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ab100dc-5533-4676-9814-2c9ce077e75e", "address": "fa:16:3e:15:59:1e", "network": {"id": "52b2b9ce-ab0e-4516-b46f-04f1670a5859", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349717026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e17e2cb304d88832baac8d20b6ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab100dc-55", "ovs_interfaceid": "1ab100dc-5533-4676-9814-2c9ce077e75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Converting VIF {"id": "1ab100dc-5533-4676-9814-2c9ce077e75e", "address": "fa:16:3e:15:59:1e", "network": {"id": "52b2b9ce-ab0e-4516-b46f-04f1670a5859", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349717026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e17e2cb304d88832baac8d20b6ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab100dc-55", "ovs_interfaceid": "1ab100dc-5533-4676-9814-2c9ce077e75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:59:1e,bridge_name='br-int',has_traffic_filtering=True,id=1ab100dc-5533-4676-9814-2c9ce077e75e,network=Network(52b2b9ce-ab0e-4516-b46f-04f1670a5859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ab100dc-55') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG os_vif [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:59:1e,bridge_name='br-int',has_traffic_filtering=True,id=1ab100dc-5533-4676-9814-2c9ce077e75e,network=Network(52b2b9ce-ab0e-4516-b46f-04f1670a5859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ab100dc-55') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ab100dc-55, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=67ba565f-2f90-4cff-a3c3-3694c7e820cc) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:39 user nova-compute[74898]: INFO os_vif [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:59:1e,bridge_name='br-int',has_traffic_filtering=True,id=1ab100dc-5533-4676-9814-2c9ce077e75e,network=Network(52b2b9ce-ab0e-4516-b46f-04f1670a5859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ab100dc-55')
Nov 17 03:09:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgCfIaPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:09:39 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:09:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adc3544-0166-4667-924a-d47b2290f779]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:09:39 user nova-compute[74898]: No targets found.
Nov 17 03:09:39 user nova-compute[74898]: iSNS:
Nov 17 03:09:39 user nova-compute[74898]: No targets found.
Nov 17 03:09:39 user nova-compute[74898]: STATIC:
Nov 17 03:09:39 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7
Nov 17 03:09:39 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:09:39 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:09:39 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329
Nov 17 03:09:39 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:09:39 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:09:39 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2
Nov 17 03:09:39 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:09:39 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:09:39 user nova-compute[74898]: FIRMWARE:
Nov 17 03:09:39 user nova-compute[74898]: No targets found.
Nov 17 03:09:39 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:09:39 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:09:39 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9f07d4-73ac-49c6-afad-36a37ecbd979]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd21e328-b638-423d-94ed-f46624e75088]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:09:39 user nova-compute[74898]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)
Nov 17 03:09:39 user nova-compute[74898]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:09:39 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:09:39 user nova-compute[74898]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)
Nov 17 03:09:39 user nova-compute[74898]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:09:39 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9c184f4550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7'): ({'sdb'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Removing single pathed devices sdb {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[78140ab8-aa1e-4fa1-b0de-217601b46e30]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cbad88-af00-4919-8bbf-db9d2bc114a5]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Flushing IO for device /dev/sdb {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcf0b45-11b4-4793-ac91-dcd60afe1325]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[806260e2-eba7-4cb2-8eb7-860ba13d0e25]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba8adc1-13a2-4a2b-a3ff-3497416c5f85]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[16283b89-fb8a-4f55-85f2-fa0870d969df]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7, portal: 172.16.0.220,3260]
Nov 17 03:09:39 user nova-compute[74898]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7, portal: 172.16.0.220,3260] successful.
Nov 17 03:09:39 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aba523c-f546-49ec-9a9b-1306bcd0b842]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] <== disconnect_volume: return (317ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:09:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:09:39 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Deleting instance files /opt/stack/data/nova/instances/e188cb77-4a1d-4cab-9b32-9e3d442bb64d_del
Nov 17 03:09:39 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Deletion of /opt/stack/data/nova/instances/e188cb77-4a1d-4cab-9b32-9e3d442bb64d_del complete
Nov 17 03:09:40 user nova-compute[74898]: DEBUG nova.compute.manager [req-c15301a5-f462-42b5-86b0-cc4acb344090 req-74ffab33-5556-4160-b3d8-4d78daa09ef4 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Received event network-vif-plugged-1ab100dc-5533-4676-9814-2c9ce077e75e {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:09:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c15301a5-f462-42b5-86b0-cc4acb344090 req-74ffab33-5556-4160-b3d8-4d78daa09ef4 service nova] Acquiring lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:09:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c15301a5-f462-42b5-86b0-cc4acb344090 req-74ffab33-5556-4160-b3d8-4d78daa09ef4 service nova] Lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:09:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c15301a5-f462-42b5-86b0-cc4acb344090 req-74ffab33-5556-4160-b3d8-4d78daa09ef4 service nova] Lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:09:40 user nova-compute[74898]: DEBUG nova.compute.manager [req-c15301a5-f462-42b5-86b0-cc4acb344090 req-74ffab33-5556-4160-b3d8-4d78daa09ef4 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] No waiting events found dispatching network-vif-plugged-1ab100dc-5533-4676-9814-2c9ce077e75e {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:09:40 user nova-compute[74898]: WARNING nova.compute.manager [req-c15301a5-f462-42b5-86b0-cc4acb344090 req-74ffab33-5556-4160-b3d8-4d78daa09ef4 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Received unexpected event network-vif-plugged-1ab100dc-5533-4676-9814-2c9ce077e75e for instance with vm_state active and task_state shelving.
Nov 17 03:09:40 user nova-compute[74898]: DEBUG nova.compute.manager [req-c15301a5-f462-42b5-86b0-cc4acb344090 req-74ffab33-5556-4160-b3d8-4d78daa09ef4 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Received event network-changed-1ab100dc-5533-4676-9814-2c9ce077e75e {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:09:40 user nova-compute[74898]: DEBUG nova.compute.manager [req-c15301a5-f462-42b5-86b0-cc4acb344090 req-74ffab33-5556-4160-b3d8-4d78daa09ef4 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Refreshing instance network info cache due to event network-changed-1ab100dc-5533-4676-9814-2c9ce077e75e. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:09:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c15301a5-f462-42b5-86b0-cc4acb344090 req-74ffab33-5556-4160-b3d8-4d78daa09ef4 service nova] Acquiring lock "refresh_cache-e188cb77-4a1d-4cab-9b32-9e3d442bb64d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:09:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c15301a5-f462-42b5-86b0-cc4acb344090 req-74ffab33-5556-4160-b3d8-4d78daa09ef4 service nova] Acquired lock "refresh_cache-e188cb77-4a1d-4cab-9b32-9e3d442bb64d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:09:40 user nova-compute[74898]: DEBUG nova.network.neutron [req-c15301a5-f462-42b5-86b0-cc4acb344090 req-74ffab33-5556-4160-b3d8-4d78daa09ef4 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Refreshing network info cache for port 1ab100dc-5533-4676-9814-2c9ce077e75e {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:09:40 user nova-compute[74898]: DEBUG nova.network.neutron [req-c15301a5-f462-42b5-86b0-cc4acb344090 req-74ffab33-5556-4160-b3d8-4d78daa09ef4 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Updated VIF entry in instance network info cache for port 1ab100dc-5533-4676-9814-2c9ce077e75e. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:09:40 user nova-compute[74898]: DEBUG nova.network.neutron [req-c15301a5-f462-42b5-86b0-cc4acb344090 req-74ffab33-5556-4160-b3d8-4d78daa09ef4 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Updating instance_info_cache with network_info: [{"id": "1ab100dc-5533-4676-9814-2c9ce077e75e", "address": "fa:16:3e:15:59:1e", "network": {"id": "52b2b9ce-ab0e-4516-b46f-04f1670a5859", "bridge": null, "label": "tempest-TestShelveInstance-1349717026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e17e2cb304d88832baac8d20b6ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1ab100dc-55", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:09:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c15301a5-f462-42b5-86b0-cc4acb344090 req-74ffab33-5556-4160-b3d8-4d78daa09ef4 service nova] Releasing lock "refresh_cache-e188cb77-4a1d-4cab-9b32-9e3d442bb64d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:09:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:09:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:09:40 user nova-compute[74898]: DEBUG nova.objects.instance [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'flavor' on Instance uuid c49f4ec3-6f9b-4e14-ba29-208aa026301e {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:09:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:09:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:09:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:09:40 user nova-compute[74898]: INFO nova.compute.manager [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Attaching volume 77b8d623-ac48-40a4-8abe-85631824fc19 to /dev/vdb
Nov 17 03:09:41 user nova-compute[74898]: DEBUG os_brick.utils [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:09:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:41 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Deleted allocations for instance e188cb77-4a1d-4cab-9b32-9e3d442bb64d
Nov 17 03:09:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:41 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e6dd98-028c-4f97-a933-c57c10e7d1fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:41 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1746c2d3-7fb2-42b0-b69b-48dad8fde820]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:41 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee4620c-ed4b-48fc-a29a-59ab59938af9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:41 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e217ea70-b0fb-43ad-ad80-068530d016c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:09:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:09:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:09:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:09:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:41 user nova-compute[74898]: DEBUG nova.objects.instance [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lazy-loading 'numa_topology' on Instance uuid e188cb77-4a1d-4cab-9b32-9e3d442bb64d {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:09:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:09:41 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:09:41 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae96d86a-2b83-4d3d-a6c1-4933a05b6ca9]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:09:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:09:41 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:09:41 user nova-compute[74898]: DEBUG os_brick.utils [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:09:41 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Updating existing volume attachment record: 77794db8-6b61-464b-86b2-7f1bb3b5e53d {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:09:41 user nova-compute[74898]: DEBUG nova.objects.base [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Object Instance<e188cb77-4a1d-4cab-9b32-9e3d442bb64d> lazy-loaded attributes: resources,numa_topology {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:09:41 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:09:41 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:09:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:09:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f7e68d04-bd08-413c-81f9-0e555eb1f81c tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.054s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:09:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:44 user nova-compute[74898]: DEBUG nova.compute.manager [req-4339c410-f098-4f7d-b619-dc47e44c1fb9 req-39557cda-2923-4e54-a19b-a80680afb375 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Received event network-changed-423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:09:44 user nova-compute[74898]: DEBUG nova.compute.manager [req-4339c410-f098-4f7d-b619-dc47e44c1fb9 req-39557cda-2923-4e54-a19b-a80680afb375 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Refreshing instance network info cache due to event network-changed-423e9165-99d6-4938-a3dc-3406806ce781. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:09:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4339c410-f098-4f7d-b619-dc47e44c1fb9 req-39557cda-2923-4e54-a19b-a80680afb375 service nova] Acquiring lock "refresh_cache-a92bce56-1038-4762-9c1e-19b5a7ff8cef" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:09:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4339c410-f098-4f7d-b619-dc47e44c1fb9 req-39557cda-2923-4e54-a19b-a80680afb375 service nova] Acquired lock "refresh_cache-a92bce56-1038-4762-9c1e-19b5a7ff8cef" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:09:44 user nova-compute[74898]: DEBUG nova.network.neutron [req-4339c410-f098-4f7d-b619-dc47e44c1fb9 req-39557cda-2923-4e54-a19b-a80680afb375 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Refreshing network info cache for port 423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG nova.objects.instance [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lazy-loading 'flavor' on Instance uuid a92bce56-1038-4762-9c1e-19b5a7ff8cef {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG nova.network.neutron [req-4339c410-f098-4f7d-b619-dc47e44c1fb9 req-39557cda-2923-4e54-a19b-a80680afb375 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Updated VIF entry in instance network info cache for port 423e9165-99d6-4938-a3dc-3406806ce781. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG nova.network.neutron [req-4339c410-f098-4f7d-b619-dc47e44c1fb9 req-39557cda-2923-4e54-a19b-a80680afb375 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Updating instance_info_cache with network_info: [{"id": "423e9165-99d6-4938-a3dc-3406806ce781", "address": "fa:16:3e:4a:ec:b4", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423e9165-99", "ovs_interfaceid": "423e9165-99d6-4938-a3dc-3406806ce781", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:09:45 user nova-compute[74898]: INFO nova.compute.manager [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Attaching volume 8f14d664-36ab-40bb-9008-00165c5d60f1 to /dev/vdb
Nov 17 03:09:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4339c410-f098-4f7d-b619-dc47e44c1fb9 req-39557cda-2923-4e54-a19b-a80680afb375 service nova] Releasing lock "refresh_cache-a92bce56-1038-4762-9c1e-19b5a7ff8cef" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG os_brick.utils [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[62813f1e-08c1-4bd4-8976-69f8da621758]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4218bfb9-b2d2-446e-ac8f-e0cc1b73b411]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a573d7-f541-4104-81c3-7175a1c38e64]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[840f7f14-e0b0-4a8c-9900-afca1a6cccdb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:09:45 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:09:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1165e2b6-0fca-48a4-ad4b-65ddb423eb06]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG os_brick.utils [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Updating existing volume attachment record: a1f4aa26-e78e-4af8-8479-0539eecbda9d {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "dbaabab0-92f0-480d-8f81-0db980c8f333" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "dbaabab0-92f0-480d-8f81-0db980c8f333" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:09:45 user nova-compute[74898]: INFO nova.compute.manager [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Detaching volume 8d24908f-8f15-470a-9a16-bbb3ab658329
Nov 17 03:09:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:45 user nova-compute[74898]: INFO nova.virt.block_device [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Attempting to driver detach volume 8d24908f-8f15-470a-9a16-bbb3ab658329 from mountpoint /dev/vdc
Nov 17 03:09:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Attempting to detach device vdc from instance dbaabab0-92f0-480d-8f81-0db980c8f333 from the persistent domain config. {{(pid=74898) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:09:45 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:09:45 user nova-compute[74898]:   <source dev="/dev/sdc"/>
Nov 17 03:09:45 user nova-compute[74898]:   <target dev="vdc" bus="virtio"/>
Nov 17 03:09:45 user nova-compute[74898]:   <serial>8d24908f-8f15-470a-9a16-bbb3ab658329</serial>
Nov 17 03:09:45 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 17 03:09:45 user nova-compute[74898]: </disk>
Nov 17 03:09:45 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:09:45 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Successfully detached device vdc from instance dbaabab0-92f0-480d-8f81-0db980c8f333 from the persistent domain config.
Nov 17 03:09:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance dbaabab0-92f0-480d-8f81-0db980c8f333 from the live domain config. {{(pid=74898) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 03:09:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:09:45 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:09:45 user nova-compute[74898]:   <source dev="/dev/sdc"/>
Nov 17 03:09:45 user nova-compute[74898]:   <target dev="vdc" bus="virtio"/>
Nov 17 03:09:45 user nova-compute[74898]:   <serial>8d24908f-8f15-470a-9a16-bbb3ab658329</serial>
Nov 17 03:09:45 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 17 03:09:45 user nova-compute[74898]: </disk>
Nov 17 03:09:45 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:09:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance dbaabab0-92f0-480d-8f81-0db980c8f333 {{(pid=74898) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 03:09:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:09:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSFYaLqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:09:51 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:09:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:09:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:09:51 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:09:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:09:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:09:51 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0057c24-89a9-46c3-984d-571d62005eed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:09:52 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[562231fd-a2fa-440c-9284-bd12899129ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19] added
Nov 17 03:09:52 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kiDJjypO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:09:52 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:09:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1741d567-a448-4ea7-8781-484b24c8f002]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbef7b4-c836-49ee-8335-a1e7f9a4af66]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PSFYaLqT {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PSFYaLqT" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9efff2a-0cfe-4f46-ac55-0a5024177741]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PSFYaLqT'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15948ff-cd6e-4200-be98-7be15c25538b]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5f6a77-02f6-4108-a815-afb3418a250c]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)
Nov 17 03:09:52 user nova-compute[74898]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:09:52 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)
Nov 17 03:09:52 user nova-compute[74898]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:09:52 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a68e5e-102c-4db7-94ba-a3e02a10ed53]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19, portal: 172.16.0.220,3260]
Nov 17 03:09:52 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19, portal: 172.16.0.220,3260] successful.
Nov 17 03:09:52 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f941da-9c07-4ee6-a290-d53b6d33c362]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7ca36b-e7d9-4575-acd2-05ba67777fe3]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)
Nov 17 03:09:52 user nova-compute[74898]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:09:52 user nova-compute[74898]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)
Nov 17 03:09:52 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)
Nov 17 03:09:52 user nova-compute[74898]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:09:52 user nova-compute[74898]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)
Nov 17 03:09:52 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee418503-6656-4bb8-a9a0-11baf78dd9d9]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:52 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: None {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSFYaLqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23964666566666661', 'path': '/dev/sdb'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964666566666661', 'path': '/dev/sdb'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.245s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:09:53 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:09:53 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:09:53 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG nova.objects.instance [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'flavor' on Instance uuid c49f4ec3-6f9b-4e14-ba29-208aa026301e {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f1e194-5d33-4f73-bbc9-348a8d68949d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:09:53 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 03:09:53 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:09:53 user nova-compute[74898]:   <source dev="/dev/sdb"/>
Nov 17 03:09:53 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:09:53 user nova-compute[74898]:   <serial>77b8d623-ac48-40a4-8abe-85631824fc19</serial>
Nov 17 03:09:53 user nova-compute[74898]: </disk>
Nov 17 03:09:53 user nova-compute[74898]:  {{(pid=74898) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb73fd28-20cd-46bd-8a2b-5099b3601895]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1] added
Nov 17 03:09:53 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df055b4-0f4f-443f-a695-d785f239a7a6]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5bbc37-23c3-478a-b50e-132c1a2ed1e4]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kiDJjypO {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kiDJjypO" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb16993-05e1-4ad7-9b13-326934ead8c4]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kiDJjypO'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9d162a-a822-4003-a173-a288e9f0209b]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0e5861-98ad-4603-834f-35147ad2e3fc]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)
Nov 17 03:09:53 user nova-compute[74898]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:09:53 user nova-compute[74898]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)
Nov 17 03:09:53 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)
Nov 17 03:09:53 user nova-compute[74898]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:09:53 user nova-compute[74898]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)
Nov 17 03:09:53 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[306deee5-5ce0-4684-8e32-dc08c1755934]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1, portal: 172.16.0.220,3260]
Nov 17 03:09:53 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1, portal: 172.16.0.220,3260] successful.
Nov 17 03:09:53 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92b0cac-5465-4af8-a990-3525a34be405]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ce1c95-b052-40da-b4d2-db8daa6d43d4]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)
Nov 17 03:09:53 user nova-compute[74898]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:09:53 user nova-compute[74898]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)
Nov 17 03:09:53 user nova-compute[74898]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)
Nov 17 03:09:53 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)
Nov 17 03:09:53 user nova-compute[74898]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:09:53 user nova-compute[74898]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)
Nov 17 03:09:53 user nova-compute[74898]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)
Nov 17 03:09:53 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[017cc253-a445-4f11-aaae-0cc918f96b0b]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kiDJjypO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] No VIF found with MAC fa:16:3e:7d:3c:56, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:09:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-691dad87-9de6-4db2-8964-5a71115ed6a0 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.962s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:09:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:09:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] <== connect_volume: return (2571ms) {'type': 'block', 'scsi_wwn': '26363343332616430', 'path': '/dev/sde'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:09:54 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363343332616430', 'path': '/dev/sde'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:09:54 user nova-compute[74898]: DEBUG nova.objects.instance [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lazy-loading 'flavor' on Instance uuid a92bce56-1038-4762-9c1e-19b5a7ff8cef {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:09:54 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 03:09:54 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:09:54 user nova-compute[74898]:   <source dev="/dev/sde"/>
Nov 17 03:09:54 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:09:54 user nova-compute[74898]:   <serial>8f14d664-36ab-40bb-9008-00165c5d60f1</serial>
Nov 17 03:09:54 user nova-compute[74898]: </disk>
Nov 17 03:09:54 user nova-compute[74898]:  {{(pid=74898) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 03:09:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:09:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:09:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] No VIF found with MAC fa:16:3e:4a:ec:b4, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:09:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-dc52cd2b-75ab-47fb-87a8-985015964ca4 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:09:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-dc52cd2b-75ab-47fb-87a8-985015964ca4 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:09:55 user nova-compute[74898]: DEBUG nova.compute.manager [None req-dc52cd2b-75ab-47fb-87a8-985015964ca4 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:09:55 user nova-compute[74898]: DEBUG nova.compute.manager [None req-dc52cd2b-75ab-47fb-87a8-985015964ca4 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74898) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 17 03:09:55 user nova-compute[74898]: DEBUG nova.objects.instance [None req-dc52cd2b-75ab-47fb-87a8-985015964ca4 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'flavor' on Instance uuid c49f4ec3-6f9b-4e14-ba29-208aa026301e {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:09:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e461459-9620-4443-848b-0bc5d17440c1 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.868s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:09:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:55 user nova-compute[74898]: DEBUG nova.compute.manager [req-a394c195-45cc-4f3a-86db-f1b7b8bb81e9 req-9eb27a8d-2948-4049-8ddf-89f6ddee5f46 service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Received event network-vif-unplugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:09:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a394c195-45cc-4f3a-86db-f1b7b8bb81e9 req-9eb27a8d-2948-4049-8ddf-89f6ddee5f46 service nova] Acquiring lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:09:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a394c195-45cc-4f3a-86db-f1b7b8bb81e9 req-9eb27a8d-2948-4049-8ddf-89f6ddee5f46 service nova] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:09:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a394c195-45cc-4f3a-86db-f1b7b8bb81e9 req-9eb27a8d-2948-4049-8ddf-89f6ddee5f46 service nova] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:09:55 user nova-compute[74898]: DEBUG nova.compute.manager [req-a394c195-45cc-4f3a-86db-f1b7b8bb81e9 req-9eb27a8d-2948-4049-8ddf-89f6ddee5f46 service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] No waiting events found dispatching network-vif-unplugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:09:55 user nova-compute[74898]: WARNING nova.compute.manager [req-a394c195-45cc-4f3a-86db-f1b7b8bb81e9 req-9eb27a8d-2948-4049-8ddf-89f6ddee5f46 service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Received unexpected event network-vif-unplugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 for instance with vm_state active and task_state powering-off.
Nov 17 03:09:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:55 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Instance destroyed successfully.
Nov 17 03:09:55 user nova-compute[74898]: DEBUG nova.compute.manager [None req-dc52cd2b-75ab-47fb-87a8-985015964ca4 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:09:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-dc52cd2b-75ab-47fb-87a8-985015964ca4 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.874s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:09:56 user nova-compute[74898]: INFO nova.compute.manager [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Rescuing
Nov 17 03:09:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "refresh_cache-a92bce56-1038-4762-9c1e-19b5a7ff8cef" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:09:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquired lock "refresh_cache-a92bce56-1038-4762-9c1e-19b5a7ff8cef" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:09:56 user nova-compute[74898]: DEBUG nova.network.neutron [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:09:57 user nova-compute[74898]: DEBUG nova.network.neutron [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Updating instance_info_cache with network_info: [{"id": "423e9165-99d6-4938-a3dc-3406806ce781", "address": "fa:16:3e:4a:ec:b4", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423e9165-99", "ovs_interfaceid": "423e9165-99d6-4938-a3dc-3406806ce781", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:09:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Releasing lock "refresh_cache-a92bce56-1038-4762-9c1e-19b5a7ff8cef" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:09:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:57 user nova-compute[74898]: DEBUG nova.compute.manager [req-3b539b0d-3c1d-49a8-947e-95f5f513b7d6 req-8d88cee1-7261-46aa-8315-56abc7e83f5b service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Received event network-vif-plugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:09:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3b539b0d-3c1d-49a8-947e-95f5f513b7d6 req-8d88cee1-7261-46aa-8315-56abc7e83f5b service nova] Acquiring lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:09:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3b539b0d-3c1d-49a8-947e-95f5f513b7d6 req-8d88cee1-7261-46aa-8315-56abc7e83f5b service nova] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:09:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3b539b0d-3c1d-49a8-947e-95f5f513b7d6 req-8d88cee1-7261-46aa-8315-56abc7e83f5b service nova] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:09:57 user nova-compute[74898]: DEBUG nova.compute.manager [req-3b539b0d-3c1d-49a8-947e-95f5f513b7d6 req-8d88cee1-7261-46aa-8315-56abc7e83f5b service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] No waiting events found dispatching network-vif-plugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:09:57 user nova-compute[74898]: WARNING nova.compute.manager [req-3b539b0d-3c1d-49a8-947e-95f5f513b7d6 req-8d88cee1-7261-46aa-8315-56abc7e83f5b service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Received unexpected event network-vif-plugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 for instance with vm_state stopped and task_state None.
Nov 17 03:09:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:57 user nova-compute[74898]: DEBUG nova.compute.manager [req-d629c6e6-9ff2-4eb2-b1c4-2210050b41aa req-7a911ae4-d696-4a05-a437-a5ab050a04ce service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Received event network-vif-unplugged-423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:09:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d629c6e6-9ff2-4eb2-b1c4-2210050b41aa req-7a911ae4-d696-4a05-a437-a5ab050a04ce service nova] Acquiring lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:09:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d629c6e6-9ff2-4eb2-b1c4-2210050b41aa req-7a911ae4-d696-4a05-a437-a5ab050a04ce service nova] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:09:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d629c6e6-9ff2-4eb2-b1c4-2210050b41aa req-7a911ae4-d696-4a05-a437-a5ab050a04ce service nova] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:09:57 user nova-compute[74898]: DEBUG nova.compute.manager [req-d629c6e6-9ff2-4eb2-b1c4-2210050b41aa req-7a911ae4-d696-4a05-a437-a5ab050a04ce service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] No waiting events found dispatching network-vif-unplugged-423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:09:57 user nova-compute[74898]: WARNING nova.compute.manager [req-d629c6e6-9ff2-4eb2-b1c4-2210050b41aa req-7a911ae4-d696-4a05-a437-a5ab050a04ce service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Received unexpected event network-vif-unplugged-423e9165-99d6-4938-a3dc-3406806ce781 for instance with vm_state active and task_state rescuing.
Nov 17 03:09:57 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Instance destroyed successfully.
Nov 17 03:09:58 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Attempting rescue
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74898) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Instance directory exists: not creating {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 17 03:09:58 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Creating image(s)
Nov 17 03:09:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "/opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "/opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "/opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.objects.instance [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lazy-loading 'trusted_certs' on Instance uuid a92bce56-1038-4762-9c1e-19b5a7ff8cef {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk.rescue {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk.rescue" returned: 0 in 0.062s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.objects.instance [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lazy-loading 'migration_context' on Instance uuid a92bce56-1038-4762-9c1e-19b5a7ff8cef {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.objects.base [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Object Instance<a92bce56-1038-4762-9c1e-19b5a7ff8cef> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Start _get_guest_xml network_info=[{"id": "423e9165-99d6-4938-a3dc-3406806ce781", "address": "fa:16:3e:4a:ec:b4", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "vif_mac": "fa:16:3e:4a:ec:b4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423e9165-99", "ovs_interfaceid": "423e9165-99d6-4938-a3dc-3406806ce781", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.objects.instance [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lazy-loading 'resources' on Instance uuid a92bce56-1038-4762-9c1e-19b5a7ff8cef {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.objects.base [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Object Instance<a92bce56-1038-4762-9c1e-19b5a7ff8cef> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.objects.instance [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lazy-loading 'numa_topology' on Instance uuid a92bce56-1038-4762-9c1e-19b5a7ff8cef {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.objects.base [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Object Instance<a92bce56-1038-4762-9c1e-19b5a7ff8cef> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:09:58 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:09:58 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.objects.instance [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lazy-loading 'vcpu_model' on Instance uuid a92bce56-1038-4762-9c1e-19b5a7ff8cef {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.objects.base [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Object Instance<a92bce56-1038-4762-9c1e-19b5a7ff8cef> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:07:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-436984245',display_name='tempest-ServerRescueNegativeTestJSON-server-436984245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-436984245',id=24,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECdizGtive531FjE2lZPMidnS/5ohxOOHxeXR9JjL6+VkYLAxgcvmUVOdOq4w6BoU/42JviUPgFmvEUcflkqWaC438sZsa2QOwDlY96HCWN/5Qo9TFTt9fnEk6JUrhY6A==',key_name='tempest-keypair-56723668',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:08:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9ccd434df9e458f80e5524c5c4c7a1f',ramdisk_id='',reservation_id='r-k8x0ez55',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1788589536',owner_user_name='tempest-ServerRescueNegativeTestJSON-1788589536-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:08:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='303dca207b5f4da297e8ab1fc41ff466',uuid=a92bce56-1038-4762-9c1e-19b5a7ff8cef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "423e9165-99d6-4938-a3dc-3406806ce781", "address": "fa:16:3e:4a:ec:b4", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "vif_mac": "fa:16:3e:4a:ec:b4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423e9165-99", "ovs_interfaceid": "423e9165-99d6-4938-a3dc-3406806ce781", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Converting VIF {"id": "423e9165-99d6-4938-a3dc-3406806ce781", "address": "fa:16:3e:4a:ec:b4", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "vif_mac": "fa:16:3e:4a:ec:b4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423e9165-99", "ovs_interfaceid": "423e9165-99d6-4938-a3dc-3406806ce781", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:ec:b4,bridge_name='br-int',has_traffic_filtering=True,id=423e9165-99d6-4938-a3dc-3406806ce781,network=Network(c153042b-16a0-4676-b024-f4583be62f74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap423e9165-99') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.objects.instance [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lazy-loading 'pci_devices' on Instance uuid a92bce56-1038-4762-9c1e-19b5a7ff8cef {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.objects.base [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Object Instance<a92bce56-1038-4762-9c1e-19b5a7ff8cef> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:09:58 user nova-compute[74898]:   <uuid>a92bce56-1038-4762-9c1e-19b5a7ff8cef</uuid>
Nov 17 03:09:58 user nova-compute[74898]:   <name>instance-00000018</name>
Nov 17 03:09:58 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:09:58 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:09:58 user nova-compute[74898]:   <metadata>
Nov 17 03:09:58 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:09:58 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:09:58 user nova-compute[74898]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-436984245</nova:name>
Nov 17 03:09:58 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:09:58</nova:creationTime>
Nov 17 03:09:58 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:09:58 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:09:58 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:09:58 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:09:58 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:09:58 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:09:58 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:09:58 user nova-compute[74898]:       <nova:owner>
Nov 17 03:09:58 user nova-compute[74898]:         <nova:user uuid="303dca207b5f4da297e8ab1fc41ff466">tempest-ServerRescueNegativeTestJSON-1788589536-project-member</nova:user>
Nov 17 03:09:58 user nova-compute[74898]:         <nova:project uuid="f9ccd434df9e458f80e5524c5c4c7a1f">tempest-ServerRescueNegativeTestJSON-1788589536</nova:project>
Nov 17 03:09:58 user nova-compute[74898]:       </nova:owner>
Nov 17 03:09:58 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:09:58 user nova-compute[74898]:       <nova:ports>
Nov 17 03:09:58 user nova-compute[74898]:         <nova:port uuid="423e9165-99d6-4938-a3dc-3406806ce781">
Nov 17 03:09:58 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 17 03:09:58 user nova-compute[74898]:         </nova:port>
Nov 17 03:09:58 user nova-compute[74898]:       </nova:ports>
Nov 17 03:09:58 user nova-compute[74898]:     </nova:instance>
Nov 17 03:09:58 user nova-compute[74898]:   </metadata>
Nov 17 03:09:58 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:09:58 user nova-compute[74898]:     <system>
Nov 17 03:09:58 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:09:58 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:09:58 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:09:58 user nova-compute[74898]:       <entry name="serial">a92bce56-1038-4762-9c1e-19b5a7ff8cef</entry>
Nov 17 03:09:58 user nova-compute[74898]:       <entry name="uuid">a92bce56-1038-4762-9c1e-19b5a7ff8cef</entry>
Nov 17 03:09:58 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:09:58 user nova-compute[74898]:     </system>
Nov 17 03:09:58 user nova-compute[74898]:   </sysinfo>
Nov 17 03:09:58 user nova-compute[74898]:   <os>
Nov 17 03:09:58 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:09:58 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:09:58 user nova-compute[74898]:   </os>
Nov 17 03:09:58 user nova-compute[74898]:   <features>
Nov 17 03:09:58 user nova-compute[74898]:     <acpi/>
Nov 17 03:09:58 user nova-compute[74898]:     <apic/>
Nov 17 03:09:58 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:09:58 user nova-compute[74898]:   </features>
Nov 17 03:09:58 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:09:58 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:09:58 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:09:58 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:09:58 user nova-compute[74898]:   </clock>
Nov 17 03:09:58 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:09:58 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:09:58 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:09:58 user nova-compute[74898]:   </cpu>
Nov 17 03:09:58 user nova-compute[74898]:   <devices>
Nov 17 03:09:58 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:09:58 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:09:58 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk.rescue"/>
Nov 17 03:09:58 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:09:58 user nova-compute[74898]:     </disk>
Nov 17 03:09:58 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:09:58 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:09:58 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk"/>
Nov 17 03:09:58 user nova-compute[74898]:       <target dev="vdb" bus="virtio"/>
Nov 17 03:09:58 user nova-compute[74898]:     </disk>
Nov 17 03:09:58 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:09:58 user nova-compute[74898]:       <mac address="fa:16:3e:4a:ec:b4"/>
Nov 17 03:09:58 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:09:58 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:09:58 user nova-compute[74898]:       <target dev="tap423e9165-99"/>
Nov 17 03:09:58 user nova-compute[74898]:     </interface>
Nov 17 03:09:58 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:09:58 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/console.log" append="off"/>
Nov 17 03:09:58 user nova-compute[74898]:     </serial>
Nov 17 03:09:58 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:09:58 user nova-compute[74898]:     <video>
Nov 17 03:09:58 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:09:58 user nova-compute[74898]:     </video>
Nov 17 03:09:58 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:09:58 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:09:58 user nova-compute[74898]:     </rng>
Nov 17 03:09:58 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:09:58 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:09:58 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:09:58 user nova-compute[74898]:     </memballoon>
Nov 17 03:09:58 user nova-compute[74898]:   </devices>
Nov 17 03:09:58 user nova-compute[74898]: </domain>
Nov 17 03:09:58 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:09:58 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Instance destroyed successfully.
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:09:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] No VIF found with MAC fa:16:3e:4a:ec:b4, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:09:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:09:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-015051ba-9bdd-4546-a3c2-6561ff574cdb req-21a0338f-c148-48c1-b8a9-90566d026933 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Received event network-vif-plugged-423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:09:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-015051ba-9bdd-4546-a3c2-6561ff574cdb req-21a0338f-c148-48c1-b8a9-90566d026933 service nova] Acquiring lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:09:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-015051ba-9bdd-4546-a3c2-6561ff574cdb req-21a0338f-c148-48c1-b8a9-90566d026933 service nova] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:09:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-015051ba-9bdd-4546-a3c2-6561ff574cdb req-21a0338f-c148-48c1-b8a9-90566d026933 service nova] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:09:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-015051ba-9bdd-4546-a3c2-6561ff574cdb req-21a0338f-c148-48c1-b8a9-90566d026933 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] No waiting events found dispatching network-vif-plugged-423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:09:59 user nova-compute[74898]: WARNING nova.compute.manager [req-015051ba-9bdd-4546-a3c2-6561ff574cdb req-21a0338f-c148-48c1-b8a9-90566d026933 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Received unexpected event network-vif-plugged-423e9165-99d6-4938-a3dc-3406806ce781 for instance with vm_state active and task_state rescuing.
Nov 17 03:09:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:02 user nova-compute[74898]: DEBUG nova.compute.manager [req-8db42b65-8257-4c6a-99bb-8fc82a58d6a1 req-8157b8ab-4b66-41b8-8eae-0bb77f036d49 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Received event network-vif-plugged-423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:10:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8db42b65-8257-4c6a-99bb-8fc82a58d6a1 req-8157b8ab-4b66-41b8-8eae-0bb77f036d49 service nova] Acquiring lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:10:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8db42b65-8257-4c6a-99bb-8fc82a58d6a1 req-8157b8ab-4b66-41b8-8eae-0bb77f036d49 service nova] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:10:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8db42b65-8257-4c6a-99bb-8fc82a58d6a1 req-8157b8ab-4b66-41b8-8eae-0bb77f036d49 service nova] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:10:02 user nova-compute[74898]: DEBUG nova.compute.manager [req-8db42b65-8257-4c6a-99bb-8fc82a58d6a1 req-8157b8ab-4b66-41b8-8eae-0bb77f036d49 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] No waiting events found dispatching network-vif-plugged-423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:10:02 user nova-compute[74898]: WARNING nova.compute.manager [req-8db42b65-8257-4c6a-99bb-8fc82a58d6a1 req-8157b8ab-4b66-41b8-8eae-0bb77f036d49 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Received unexpected event network-vif-plugged-423e9165-99d6-4938-a3dc-3406806ce781 for instance with vm_state active and task_state rescuing.
Nov 17 03:10:02 user nova-compute[74898]: DEBUG nova.compute.manager [req-8db42b65-8257-4c6a-99bb-8fc82a58d6a1 req-8157b8ab-4b66-41b8-8eae-0bb77f036d49 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Received event network-vif-plugged-423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:10:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8db42b65-8257-4c6a-99bb-8fc82a58d6a1 req-8157b8ab-4b66-41b8-8eae-0bb77f036d49 service nova] Acquiring lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:10:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8db42b65-8257-4c6a-99bb-8fc82a58d6a1 req-8157b8ab-4b66-41b8-8eae-0bb77f036d49 service nova] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:10:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8db42b65-8257-4c6a-99bb-8fc82a58d6a1 req-8157b8ab-4b66-41b8-8eae-0bb77f036d49 service nova] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:10:02 user nova-compute[74898]: DEBUG nova.compute.manager [req-8db42b65-8257-4c6a-99bb-8fc82a58d6a1 req-8157b8ab-4b66-41b8-8eae-0bb77f036d49 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] No waiting events found dispatching network-vif-plugged-423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:10:02 user nova-compute[74898]: WARNING nova.compute.manager [req-8db42b65-8257-4c6a-99bb-8fc82a58d6a1 req-8157b8ab-4b66-41b8-8eae-0bb77f036d49 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Received unexpected event network-vif-plugged-423e9165-99d6-4938-a3dc-3406806ce781 for instance with vm_state active and task_state rescuing.
Nov 17 03:10:02 user nova-compute[74898]: DEBUG nova.compute.manager [None req-36804a78-7488-401e-a3e6-3ae9aae64a8c tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:10:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:06 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance dbaabab0-92f0-480d-8f81-0db980c8f333 is timed out.
Nov 17 03:10:06 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Successfully detached device vdc from instance dbaabab0-92f0-480d-8f81-0db980c8f333 from the live domain config.
Nov 17 03:10:06 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GsjSPqHB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:10:06 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:10:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[14479037-4fcd-4da3-bd38-3ea50cfea9b2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:10:06 user nova-compute[74898]: No targets found.
Nov 17 03:10:06 user nova-compute[74898]: iSNS:
Nov 17 03:10:06 user nova-compute[74898]: No targets found.
Nov 17 03:10:06 user nova-compute[74898]: STATIC:
Nov 17 03:10:06 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1
Nov 17 03:10:06 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:10:06 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:10:06 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329
Nov 17 03:10:06 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:10:06 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:10:06 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2
Nov 17 03:10:06 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:10:06 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:10:06 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19
Nov 17 03:10:06 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:10:06 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:10:06 user nova-compute[74898]: FIRMWARE:
Nov 17 03:10:06 user nova-compute[74898]: No targets found.
Nov 17 03:10:06 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:10:06 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:10:06 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c9860f-c340-487c-a497-a0671e3a54a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d950b24-14c2-4e61-acc3-0a8b26409230]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)
Nov 17 03:10:06 user nova-compute[74898]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:10:06 user nova-compute[74898]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)
Nov 17 03:10:06 user nova-compute[74898]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)
Nov 17 03:10:06 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 (non-flash)
Nov 17 03:10:06 user nova-compute[74898]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:10:06 user nova-compute[74898]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)
Nov 17 03:10:06 user nova-compute[74898]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)
Nov 17 03:10:06 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf85052d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329'): ({'sdc'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Removing single pathed devices sdc {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ec6f8f-ba49-4973-8c40-a196f413298b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[733ce05a-fd5b-45b4-bff4-449686ba00eb]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Flushing IO for device /dev/sdc {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7b3f28-f9f1-491d-b155-b98cd46eace9]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c150261-238d-49a2-ab1f-f8046481bf75]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] SCSI volumes sdc have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b0be61-7715-40ad-b781-019dcad2f09b]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e4c840-0193-4846-a39f-387c931af873]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329, portal: 172.16.0.220,3260]
Nov 17 03:10:06 user nova-compute[74898]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329, portal: 172.16.0.220,3260] successful.
Nov 17 03:10:06 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d24908f-8f15-470a-9a16-bbb3ab658329 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ca8eb1-2833-4532-aefa-26c54f075f9b]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] <== disconnect_volume: return (327ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:10:06 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:10:07 user nova-compute[74898]: DEBUG nova.objects.instance [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lazy-loading 'flavor' on Instance uuid dbaabab0-92f0-480d-8f81-0db980c8f333 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:10:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-fd3d53af-b805-4558-96c4-85dca245eda3 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "dbaabab0-92f0-480d-8f81-0db980c8f333" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.815s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:10:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "24cd7ac4-3724-4189-82a7-ba61ba46097a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:10:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:10:12 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:10:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:10:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:10:13 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:10:13 user nova-compute[74898]: INFO nova.compute.claims [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Claim successful on node user
Nov 17 03:10:13 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:10:13 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:10:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:10:13 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:10:13 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:10:13 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:10:13 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:10:13 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:10:13 user nova-compute[74898]: DEBUG nova.policy [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05397a6b586843338aafbc8a17c6e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cd941de23248d8ac93b03f930f565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:10:13 user nova-compute[74898]: INFO nova.virt.block_device [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Booting with blank volume at /dev/vda
Nov 17 03:10:14 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:14 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Successfully created port: b7880813-a5fe-4eb7-b6aa-f91832114171 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:10:14 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:15 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Successfully updated port: b7880813-a5fe-4eb7-b6aa-f91832114171 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:10:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "refresh_cache-24cd7ac4-3724-4189-82a7-ba61ba46097a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:10:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquired lock "refresh_cache-24cd7ac4-3724-4189-82a7-ba61ba46097a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:10:15 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:10:15 user nova-compute[74898]: DEBUG nova.compute.manager [req-bd861027-c02e-4cf1-8ce1-56e1db4bc0ca req-11fac252-5581-41b9-9d6f-74a2f9456453 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Received event network-changed-b7880813-a5fe-4eb7-b6aa-f91832114171 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:10:15 user nova-compute[74898]: DEBUG nova.compute.manager [req-bd861027-c02e-4cf1-8ce1-56e1db4bc0ca req-11fac252-5581-41b9-9d6f-74a2f9456453 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Refreshing instance network info cache due to event network-changed-b7880813-a5fe-4eb7-b6aa-f91832114171. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:10:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-bd861027-c02e-4cf1-8ce1-56e1db4bc0ca req-11fac252-5581-41b9-9d6f-74a2f9456453 service nova] Acquiring lock "refresh_cache-24cd7ac4-3724-4189-82a7-ba61ba46097a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:10:15 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:10:15 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Updating instance_info_cache with network_info: [{"id": "b7880813-a5fe-4eb7-b6aa-f91832114171", "address": "fa:16:3e:da:6b:da", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7880813-a5", "ovs_interfaceid": "b7880813-a5fe-4eb7-b6aa-f91832114171", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:10:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Releasing lock "refresh_cache-24cd7ac4-3724-4189-82a7-ba61ba46097a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:10:15 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Instance network_info: |[{"id": "b7880813-a5fe-4eb7-b6aa-f91832114171", "address": "fa:16:3e:da:6b:da", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7880813-a5", "ovs_interfaceid": "b7880813-a5fe-4eb7-b6aa-f91832114171", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:10:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-bd861027-c02e-4cf1-8ce1-56e1db4bc0ca req-11fac252-5581-41b9-9d6f-74a2f9456453 service nova] Acquired lock "refresh_cache-24cd7ac4-3724-4189-82a7-ba61ba46097a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:10:15 user nova-compute[74898]: DEBUG nova.network.neutron [req-bd861027-c02e-4cf1-8ce1-56e1db4bc0ca req-11fac252-5581-41b9-9d6f-74a2f9456453 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Refreshing network info cache for port b7880813-a5fe-4eb7-b6aa-f91832114171 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:10:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:16 user nova-compute[74898]: DEBUG nova.network.neutron [req-bd861027-c02e-4cf1-8ce1-56e1db4bc0ca req-11fac252-5581-41b9-9d6f-74a2f9456453 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Updated VIF entry in instance network info cache for port b7880813-a5fe-4eb7-b6aa-f91832114171. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:10:16 user nova-compute[74898]: DEBUG nova.network.neutron [req-bd861027-c02e-4cf1-8ce1-56e1db4bc0ca req-11fac252-5581-41b9-9d6f-74a2f9456453 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Updating instance_info_cache with network_info: [{"id": "b7880813-a5fe-4eb7-b6aa-f91832114171", "address": "fa:16:3e:da:6b:da", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7880813-a5", "ovs_interfaceid": "b7880813-a5fe-4eb7-b6aa-f91832114171", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:10:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-bd861027-c02e-4cf1-8ce1-56e1db4bc0ca req-11fac252-5581-41b9-9d6f-74a2f9456453 service nova] Releasing lock "refresh_cache-24cd7ac4-3724-4189-82a7-ba61ba46097a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:10:17 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:10:17 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Cleaning up deleted instances {{(pid=74898) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 17 03:10:17 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] There are 0 instances to clean {{(pid=74898) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 17 03:10:18 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:10:18 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:10:19 user nova-compute[74898]: DEBUG os_brick.utils [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:10:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:19 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1badac-c23e-4daf-baff-2b7a464b81a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:10:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:19 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b070f7-40c8-43ba-84ee-3ec311b08d9a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:10:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:19 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd70fb8-67ef-43a6-8b02-8c20338dfd2d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:10:19 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef481738-9108-4c8a-b5a7-0c3f2e40a105]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:10:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:10:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:10:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:10:19 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:10:19 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec506c1-8d00-47ea-8324-3d587a39c1c0]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:10:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:10:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:10:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:10:19 user nova-compute[74898]: DEBUG os_brick.utils [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:10:19 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Updating existing volume attachment record: 02ee7966-7a29-434c-9f66-743b5ab18d61 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:10:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:19 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:10:20 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:10:20 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:10:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-f25ef6a9-d007-419d-8478-2a9e79d5f03a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:10:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-f25ef6a9-d007-419d-8478-2a9e79d5f03a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:10:20 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:10:21 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Updating instance_info_cache with network_info: [{"id": "f819d75d-a65d-4342-9912-944d2fb13dd3", "address": "fa:16:3e:89:06:c8", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf819d75d-a6", "ovs_interfaceid": "f819d75d-a65d-4342-9912-944d2fb13dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:10:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-f25ef6a9-d007-419d-8478-2a9e79d5f03a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:10:21 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:10:21 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:10:21 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:10:21 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:10:22 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:10:22 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:10:23 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:10:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:10:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:10:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:10:23 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:10:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:24 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:10:24 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:10:24 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Creating image(s)
Nov 17 03:10:24 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Did not create local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 03:10:24 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Ensure instance console log exists: /opt/stack/data/nova/instances/24cd7ac4-3724-4189-82a7-ba61ba46097a/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:10:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:10:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:10:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:10:24 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Start _get_guest_xml network_info=[{"id": "b7880813-a5fe-4eb7-b6aa-f91832114171", "address": "fa:16:3e:da:6b:da", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7880813-a5", "ovs_interfaceid": "b7880813-a5fe-4eb7-b6aa-f91832114171", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBNRsapG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '24cd7ac4-3724-4189-82a7-ba61ba46097a', 'attached_at': '', 'detached_at': '', 'volume_id': '9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4', 'serial': '9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '02ee7966-7a29-434c-9f66-743b5ab18d61', 'volume_type': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:10:25 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:10:25 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk --force-share --output=json" returned: 0 in 0.438s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBNRsapG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:10:25 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:10:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:10:25 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:10:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:10:25 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad5d53e-c3c2-41d7-b3d9-87475b0ba4bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:10:25 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f814027-eb38-4cb8-829c-f3fde1699b42]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4] added
Nov 17 03:10:25 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5b8b2a-10ce-40dc-b649-5ab2c32c3875]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dc4915-da22-4133-b64a-1f7bf7a54fcf]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DBNRsapG {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DBNRsapG" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6d72b9-ac2e-463d-a894-44628f8eb960]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DBNRsapG'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[802de6e4-31e8-4893-a946-08e33967e6f9]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05c8d12-d281-4470-a18b-bceac2109357]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:10:25 user nova-compute[74898]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)
Nov 17 03:10:25 user nova-compute[74898]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)
Nov 17 03:10:25 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:10:25 user nova-compute[74898]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)
Nov 17 03:10:25 user nova-compute[74898]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)
Nov 17 03:10:25 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8470948-2776-4340-973f-955ca28561da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4, portal: 172.16.0.220,3260]
Nov 17 03:10:25 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4, portal: 172.16.0.220,3260] successful.
Nov 17 03:10:25 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2652973-e42c-4d6c-957a-4bd9e0c7508f]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2168df-fc4b-4a1b-9dfa-06fafee87a4d]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:10:25 user nova-compute[74898]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)
Nov 17 03:10:25 user nova-compute[74898]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)
Nov 17 03:10:25 user nova-compute[74898]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:10:25 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:10:25 user nova-compute[74898]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)
Nov 17 03:10:25 user nova-compute[74898]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)
Nov 17 03:10:25 user nova-compute[74898]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:10:25 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[968813c2-817b-4319-93cc-d4d8c5d17e44]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: None {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBNRsapG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '26639363834643539', 'path': '/dev/sdc'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639363834643539', 'path': '/dev/sdc'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-845758421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-845758421',id=26,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0cd941de23248d8ac93b03f930f565f',ramdisk_id='',reservation_id='r-nwjpn9ta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-507656828',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:10:14Z,user_data=None,user_id='05397a6b586843338aafbc8a17c6e42c',uuid=24cd7ac4-3724-4189-82a7-ba61ba46097a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7880813-a5fe-4eb7-b6aa-f91832114171", "address": "fa:16:3e:da:6b:da", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7880813-a5", "ovs_interfaceid": "b7880813-a5fe-4eb7-b6aa-f91832114171", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Converting VIF {"id": "b7880813-a5fe-4eb7-b6aa-f91832114171", "address": "fa:16:3e:da:6b:da", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7880813-a5", "ovs_interfaceid": "b7880813-a5fe-4eb7-b6aa-f91832114171", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:6b:da,bridge_name='br-int',has_traffic_filtering=True,id=b7880813-a5fe-4eb7-b6aa-f91832114171,network=Network(9302cb9a-12f9-4845-b6cc-905f4bf24b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7880813-a5') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG nova.objects.instance [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lazy-loading 'pci_devices' on Instance uuid 24cd7ac4-3724-4189-82a7-ba61ba46097a {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:10:26 user nova-compute[74898]:   <uuid>24cd7ac4-3724-4189-82a7-ba61ba46097a</uuid>
Nov 17 03:10:26 user nova-compute[74898]:   <name>instance-0000001a</name>
Nov 17 03:10:26 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:10:26 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:10:26 user nova-compute[74898]:   <metadata>
Nov 17 03:10:26 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:10:26 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:10:26 user nova-compute[74898]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-845758421</nova:name>
Nov 17 03:10:26 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:10:25</nova:creationTime>
Nov 17 03:10:26 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:10:26 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:10:26 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:10:26 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:10:26 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:10:26 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:10:26 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:10:26 user nova-compute[74898]:       <nova:owner>
Nov 17 03:10:26 user nova-compute[74898]:         <nova:user uuid="05397a6b586843338aafbc8a17c6e42c">tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member</nova:user>
Nov 17 03:10:26 user nova-compute[74898]:         <nova:project uuid="b0cd941de23248d8ac93b03f930f565f">tempest-ServerBootFromVolumeStableRescueTest-507656828</nova:project>
Nov 17 03:10:26 user nova-compute[74898]:       </nova:owner>
Nov 17 03:10:26 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:10:26 user nova-compute[74898]:       <nova:ports>
Nov 17 03:10:26 user nova-compute[74898]:         <nova:port uuid="b7880813-a5fe-4eb7-b6aa-f91832114171">
Nov 17 03:10:26 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 17 03:10:26 user nova-compute[74898]:         </nova:port>
Nov 17 03:10:26 user nova-compute[74898]:       </nova:ports>
Nov 17 03:10:26 user nova-compute[74898]:     </nova:instance>
Nov 17 03:10:26 user nova-compute[74898]:   </metadata>
Nov 17 03:10:26 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:10:26 user nova-compute[74898]:     <system>
Nov 17 03:10:26 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:10:26 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:10:26 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:10:26 user nova-compute[74898]:       <entry name="serial">24cd7ac4-3724-4189-82a7-ba61ba46097a</entry>
Nov 17 03:10:26 user nova-compute[74898]:       <entry name="uuid">24cd7ac4-3724-4189-82a7-ba61ba46097a</entry>
Nov 17 03:10:26 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:10:26 user nova-compute[74898]:     </system>
Nov 17 03:10:26 user nova-compute[74898]:   </sysinfo>
Nov 17 03:10:26 user nova-compute[74898]:   <os>
Nov 17 03:10:26 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:10:26 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:10:26 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:10:26 user nova-compute[74898]:   </os>
Nov 17 03:10:26 user nova-compute[74898]:   <features>
Nov 17 03:10:26 user nova-compute[74898]:     <acpi/>
Nov 17 03:10:26 user nova-compute[74898]:     <apic/>
Nov 17 03:10:26 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:10:26 user nova-compute[74898]:   </features>
Nov 17 03:10:26 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:10:26 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:10:26 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:10:26 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:10:26 user nova-compute[74898]:   </clock>
Nov 17 03:10:26 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:10:26 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:10:26 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:10:26 user nova-compute[74898]:   </cpu>
Nov 17 03:10:26 user nova-compute[74898]:   <devices>
Nov 17 03:10:26 user nova-compute[74898]:     <disk type="block" device="disk">
Nov 17 03:10:26 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:10:26 user nova-compute[74898]:       <source dev="/dev/sdc"/>
Nov 17 03:10:26 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:10:26 user nova-compute[74898]:       <serial>9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4</serial>
Nov 17 03:10:26 user nova-compute[74898]:     </disk>
Nov 17 03:10:26 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:10:26 user nova-compute[74898]:       <mac address="fa:16:3e:da:6b:da"/>
Nov 17 03:10:26 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:10:26 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:10:26 user nova-compute[74898]:       <target dev="tapb7880813-a5"/>
Nov 17 03:10:26 user nova-compute[74898]:     </interface>
Nov 17 03:10:26 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:10:26 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/24cd7ac4-3724-4189-82a7-ba61ba46097a/console.log" append="off"/>
Nov 17 03:10:26 user nova-compute[74898]:     </serial>
Nov 17 03:10:26 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:10:26 user nova-compute[74898]:     <video>
Nov 17 03:10:26 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:10:26 user nova-compute[74898]:     </video>
Nov 17 03:10:26 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:10:26 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:10:26 user nova-compute[74898]:     </rng>
Nov 17 03:10:26 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:10:26 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:10:26 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:10:26 user nova-compute[74898]:     </memballoon>
Nov 17 03:10:26 user nova-compute[74898]:   </devices>
Nov 17 03:10:26 user nova-compute[74898]: </domain>
Nov 17 03:10:26 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-845758421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-845758421',id=26,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0cd941de23248d8ac93b03f930f565f',ramdisk_id='',reservation_id='r-nwjpn9ta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-507656828',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:10:14Z,user_data=None,user_id='05397a6b586843338aafbc8a17c6e42c',uuid=24cd7ac4-3724-4189-82a7-ba61ba46097a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7880813-a5fe-4eb7-b6aa-f91832114171", "address": "fa:16:3e:da:6b:da", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7880813-a5", "ovs_interfaceid": "b7880813-a5fe-4eb7-b6aa-f91832114171", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Converting VIF {"id": "b7880813-a5fe-4eb7-b6aa-f91832114171", "address": "fa:16:3e:da:6b:da", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7880813-a5", "ovs_interfaceid": "b7880813-a5fe-4eb7-b6aa-f91832114171", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:6b:da,bridge_name='br-int',has_traffic_filtering=True,id=b7880813-a5fe-4eb7-b6aa-f91832114171,network=Network(9302cb9a-12f9-4845-b6cc-905f4bf24b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7880813-a5') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG os_vif [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:6b:da,bridge_name='br-int',has_traffic_filtering=True,id=b7880813-a5fe-4eb7-b6aa-f91832114171,network=Network(9302cb9a-12f9-4845-b6cc-905f4bf24b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7880813-a5') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba4281a6-9226-5001-bb12-36040fd649f5', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7880813-a5, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7880813-a5, col_values=(('qos', UUID('95577dfa-cb49-42a7-b6bd-a686aca048d7')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7880813-a5, col_values=(('external_ids', {'iface-id': 'b7880813-a5fe-4eb7-b6aa-f91832114171', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:6b:da', 'vm-uuid': '24cd7ac4-3724-4189-82a7-ba61ba46097a'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:26 user nova-compute[74898]: INFO os_vif [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:6b:da,bridge_name='br-int',has_traffic_filtering=True,id=b7880813-a5fe-4eb7-b6aa-f91832114171,network=Network(9302cb9a-12f9-4845-b6cc-905f4bf24b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7880813-a5')
Nov 17 03:10:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] No VIF found with MAC fa:16:3e:da:6b:da, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:10:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:27 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:10:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:10:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:28 user nova-compute[74898]: DEBUG nova.compute.manager [req-52238a17-e519-472a-8c67-c8d0db55f790 req-d3d8d7a2-bf5c-406e-9b88-8a393cccb424 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Received event network-vif-plugged-b7880813-a5fe-4eb7-b6aa-f91832114171 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:10:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-52238a17-e519-472a-8c67-c8d0db55f790 req-d3d8d7a2-bf5c-406e-9b88-8a393cccb424 service nova] Acquiring lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:10:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-52238a17-e519-472a-8c67-c8d0db55f790 req-d3d8d7a2-bf5c-406e-9b88-8a393cccb424 service nova] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:10:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-52238a17-e519-472a-8c67-c8d0db55f790 req-d3d8d7a2-bf5c-406e-9b88-8a393cccb424 service nova] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:10:28 user nova-compute[74898]: DEBUG nova.compute.manager [req-52238a17-e519-472a-8c67-c8d0db55f790 req-d3d8d7a2-bf5c-406e-9b88-8a393cccb424 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] No waiting events found dispatching network-vif-plugged-b7880813-a5fe-4eb7-b6aa-f91832114171 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:10:28 user nova-compute[74898]: WARNING nova.compute.manager [req-52238a17-e519-472a-8c67-c8d0db55f790 req-d3d8d7a2-bf5c-406e-9b88-8a393cccb424 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Received unexpected event network-vif-plugged-b7880813-a5fe-4eb7-b6aa-f91832114171 for instance with vm_state building and task_state spawning.
Nov 17 03:10:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG nova.compute.manager [req-5cf1346b-232f-4f77-b3fe-78c8860a355d req-e876c328-dc3e-4625-a7b4-0498bc6204c0 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Received event network-vif-plugged-b7880813-a5fe-4eb7-b6aa-f91832114171 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5cf1346b-232f-4f77-b3fe-78c8860a355d req-e876c328-dc3e-4625-a7b4-0498bc6204c0 service nova] Acquiring lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5cf1346b-232f-4f77-b3fe-78c8860a355d req-e876c328-dc3e-4625-a7b4-0498bc6204c0 service nova] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5cf1346b-232f-4f77-b3fe-78c8860a355d req-e876c328-dc3e-4625-a7b4-0498bc6204c0 service nova] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG nova.compute.manager [req-5cf1346b-232f-4f77-b3fe-78c8860a355d req-e876c328-dc3e-4625-a7b4-0498bc6204c0 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] No waiting events found dispatching network-vif-plugged-b7880813-a5fe-4eb7-b6aa-f91832114171 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:10:30 user nova-compute[74898]: WARNING nova.compute.manager [req-5cf1346b-232f-4f77-b3fe-78c8860a355d req-e876c328-dc3e-4625-a7b4-0498bc6204c0 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Received unexpected event network-vif-plugged-b7880813-a5fe-4eb7-b6aa-f91832114171 for instance with vm_state building and task_state spawning.
Nov 17 03:10:30 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:10:30 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:10:30 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:10:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=7688MB free_disk=25.27621078491211GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:10:30 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Instance spawned successfully.
Nov 17 03:10:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:10:30 user nova-compute[74898]: INFO nova.compute.manager [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Took 5.75 seconds to spawn the instance on the hypervisor.
Nov 17 03:10:30 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:10:30 user nova-compute[74898]: INFO nova.compute.manager [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Took 17.77 seconds to build instance.
Nov 17 03:10:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e7058822-bbe8-4f97-8a0e-cd71bedefc62 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.864s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance e733574a-56ba-4e24-babd-855bcb5bda61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 42994e39-187a-4fb6-a293-24a4eb57177b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance f25ef6a9-d007-419d-8478-2a9e79d5f03a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance f457f5c7-58e3-4f7f-b495-6cfd3440d7dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 13449e5c-809b-4db2-af0b-53f5865eb3a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance c49f4ec3-6f9b-4e14-ba29-208aa026301e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance a92bce56-1038-4762-9c1e-19b5a7ff8cef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance dbaabab0-92f0-480d-8f81-0db980c8f333 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance ff69d6dd-bce4-400b-8f03-429068cf32eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 24cd7ac4-3724-4189-82a7-ba61ba46097a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Refreshing inventories for resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Updating ProviderTree inventory for provider b743bdc9-a8bb-467c-98c8-06f1954f87df from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 17 03:10:30 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Updating inventory in ProviderTree for provider b743bdc9-a8bb-467c-98c8-06f1954f87df with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 17 03:10:31 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Refreshing aggregate associations for resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df, aggregates: None {{(pid=74898) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 17 03:10:31 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Refreshing trait associations for resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=74898) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 17 03:10:31 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:10:31 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:10:31 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:10:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.843s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:10:31 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:10:31 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Cleaning up deleted instances with incomplete migration  {{(pid=74898) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 17 03:10:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:32 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6231a43b-03c6-4791-8a68-67a7731a2a07 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "dbaabab0-92f0-480d-8f81-0db980c8f333" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6231a43b-03c6-4791-8a68-67a7731a2a07 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "dbaabab0-92f0-480d-8f81-0db980c8f333" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6231a43b-03c6-4791-8a68-67a7731a2a07 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "dbaabab0-92f0-480d-8f81-0db980c8f333-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6231a43b-03c6-4791-8a68-67a7731a2a07 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "dbaabab0-92f0-480d-8f81-0db980c8f333-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6231a43b-03c6-4791-8a68-67a7731a2a07 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "dbaabab0-92f0-480d-8f81-0db980c8f333-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:10:36 user nova-compute[74898]: INFO nova.compute.manager [None req-6231a43b-03c6-4791-8a68-67a7731a2a07 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Terminating instance
Nov 17 03:10:36 user nova-compute[74898]: DEBUG nova.compute.manager [None req-6231a43b-03c6-4791-8a68-67a7731a2a07 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG nova.compute.manager [req-4c951df5-90c5-4421-bdb1-67dc02065d82 req-c5ad2a52-6098-40c2-9c9c-dfc71cf3ce9b service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Received event network-vif-unplugged-8e38fd27-07cd-40c1-bef7-67d150932e57 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4c951df5-90c5-4421-bdb1-67dc02065d82 req-c5ad2a52-6098-40c2-9c9c-dfc71cf3ce9b service nova] Acquiring lock "dbaabab0-92f0-480d-8f81-0db980c8f333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4c951df5-90c5-4421-bdb1-67dc02065d82 req-c5ad2a52-6098-40c2-9c9c-dfc71cf3ce9b service nova] Lock "dbaabab0-92f0-480d-8f81-0db980c8f333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4c951df5-90c5-4421-bdb1-67dc02065d82 req-c5ad2a52-6098-40c2-9c9c-dfc71cf3ce9b service nova] Lock "dbaabab0-92f0-480d-8f81-0db980c8f333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG nova.compute.manager [req-4c951df5-90c5-4421-bdb1-67dc02065d82 req-c5ad2a52-6098-40c2-9c9c-dfc71cf3ce9b service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] No waiting events found dispatching network-vif-unplugged-8e38fd27-07cd-40c1-bef7-67d150932e57 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG nova.compute.manager [req-4c951df5-90c5-4421-bdb1-67dc02065d82 req-c5ad2a52-6098-40c2-9c9c-dfc71cf3ce9b service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Received event network-vif-unplugged-8e38fd27-07cd-40c1-bef7-67d150932e57 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:10:36 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Instance destroyed successfully.
Nov 17 03:10:36 user nova-compute[74898]: DEBUG nova.objects.instance [None req-6231a43b-03c6-4791-8a68-67a7731a2a07 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lazy-loading 'resources' on Instance uuid dbaabab0-92f0-480d-8f81-0db980c8f333 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-6231a43b-03c6-4791-8a68-67a7731a2a07 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-17T03:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-702287873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-702287873',id=17,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEl2EjQvjTqov68hcm1AeEL6uEvsYKfdioCWHBY36ZV+F59uTU3I4mzgJuvGNcYThtmuN40EjuxjcwIBe1nJp1ArnA81m6C50PEcotvfJhejuAEZ67UJtWnOWyPgfw3LKw==',key_name='tempest-keypair-742675604',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:08:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3de7d05d475c49f0805f5aab5853a0b2',ramdisk_id='',reservation_id='r-1c58hjg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-940982522',owner_user_name='tempest-AttachVolumeShelveTestJSON-940982522-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:08:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='926d8bd27eb24824a71cb9f1969f9c45',uuid=dbaabab0-92f0-480d-8f81-0db980c8f333,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e38fd27-07cd-40c1-bef7-67d150932e57", "address": "fa:16:3e:8b:5d:76", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e38fd27-07", "ovs_interfaceid": "8e38fd27-07cd-40c1-bef7-67d150932e57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6231a43b-03c6-4791-8a68-67a7731a2a07 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Converting VIF {"id": "8e38fd27-07cd-40c1-bef7-67d150932e57", "address": "fa:16:3e:8b:5d:76", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e38fd27-07", "ovs_interfaceid": "8e38fd27-07cd-40c1-bef7-67d150932e57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6231a43b-03c6-4791-8a68-67a7731a2a07 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:5d:76,bridge_name='br-int',has_traffic_filtering=True,id=8e38fd27-07cd-40c1-bef7-67d150932e57,network=Network(c92bc72d-7b33-49a8-96e5-ca2ed117fa48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e38fd27-07') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG os_vif [None req-6231a43b-03c6-4791-8a68-67a7731a2a07 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:5d:76,bridge_name='br-int',has_traffic_filtering=True,id=8e38fd27-07cd-40c1-bef7-67d150932e57,network=Network(c92bc72d-7b33-49a8-96e5-ca2ed117fa48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e38fd27-07') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e38fd27-07, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af6700ff-4bc7-4f34-af64-4caae0ee7fc7) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:10:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:36 user nova-compute[74898]: INFO os_vif [None req-6231a43b-03c6-4791-8a68-67a7731a2a07 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:5d:76,bridge_name='br-int',has_traffic_filtering=True,id=8e38fd27-07cd-40c1-bef7-67d150932e57,network=Network(c92bc72d-7b33-49a8-96e5-ca2ed117fa48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e38fd27-07')
Nov 17 03:10:36 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-6231a43b-03c6-4791-8a68-67a7731a2a07 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Deleting instance files /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333_del
Nov 17 03:10:36 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-6231a43b-03c6-4791-8a68-67a7731a2a07 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Deletion of /opt/stack/data/nova/instances/dbaabab0-92f0-480d-8f81-0db980c8f333_del complete
Nov 17 03:10:37 user nova-compute[74898]: INFO nova.compute.manager [None req-6231a43b-03c6-4791-8a68-67a7731a2a07 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 17 03:10:37 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-6231a43b-03c6-4791-8a68-67a7731a2a07 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:10:37 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:10:37 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:10:37 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:10:37 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Took 0.76 seconds to deallocate network for instance.
Nov 17 03:10:37 user nova-compute[74898]: DEBUG nova.compute.manager [req-2ad34a27-f0b1-44d4-b06a-1acbb25d59c9 req-d43a997e-9dfe-4ba9-963d-321766eeab66 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Received event network-vif-deleted-8e38fd27-07cd-40c1-bef7-67d150932e57 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:10:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6231a43b-03c6-4791-8a68-67a7731a2a07 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:10:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6231a43b-03c6-4791-8a68-67a7731a2a07 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:10:38 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-6231a43b-03c6-4791-8a68-67a7731a2a07 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:10:38 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-6231a43b-03c6-4791-8a68-67a7731a2a07 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:10:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6231a43b-03c6-4791-8a68-67a7731a2a07 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:10:38 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-6231a43b-03c6-4791-8a68-67a7731a2a07 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Deleted allocations for instance dbaabab0-92f0-480d-8f81-0db980c8f333
Nov 17 03:10:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6231a43b-03c6-4791-8a68-67a7731a2a07 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "dbaabab0-92f0-480d-8f81-0db980c8f333" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.168s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:10:38 user nova-compute[74898]: DEBUG nova.compute.manager [req-31ecdf4f-c412-48f0-bc63-9f442991c8e6 req-5817a4d8-2658-4a73-8223-b11947862aa8 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Received event network-vif-plugged-8e38fd27-07cd-40c1-bef7-67d150932e57 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:10:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-31ecdf4f-c412-48f0-bc63-9f442991c8e6 req-5817a4d8-2658-4a73-8223-b11947862aa8 service nova] Acquiring lock "dbaabab0-92f0-480d-8f81-0db980c8f333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:10:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-31ecdf4f-c412-48f0-bc63-9f442991c8e6 req-5817a4d8-2658-4a73-8223-b11947862aa8 service nova] Lock "dbaabab0-92f0-480d-8f81-0db980c8f333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:10:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-31ecdf4f-c412-48f0-bc63-9f442991c8e6 req-5817a4d8-2658-4a73-8223-b11947862aa8 service nova] Lock "dbaabab0-92f0-480d-8f81-0db980c8f333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:10:38 user nova-compute[74898]: DEBUG nova.compute.manager [req-31ecdf4f-c412-48f0-bc63-9f442991c8e6 req-5817a4d8-2658-4a73-8223-b11947862aa8 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] No waiting events found dispatching network-vif-plugged-8e38fd27-07cd-40c1-bef7-67d150932e57 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:10:38 user nova-compute[74898]: WARNING nova.compute.manager [req-31ecdf4f-c412-48f0-bc63-9f442991c8e6 req-5817a4d8-2658-4a73-8223-b11947862aa8 service nova] [instance: dbaabab0-92f0-480d-8f81-0db980c8f333] Received unexpected event network-vif-plugged-8e38fd27-07cd-40c1-bef7-67d150932e57 for instance with vm_state deleted and task_state None.
Nov 17 03:10:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:10:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:10:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:10:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:10:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:10:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Acquiring lock "9411b570-6aaa-48bb-bf68-5765bf7d7a04" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:11:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "9411b570-6aaa-48bb-bf68-5765bf7d7a04" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:11:01 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:11:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:11:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:11:01 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:11:01 user nova-compute[74898]: INFO nova.compute.claims [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Claim successful on node user
Nov 17 03:11:01 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:11:01 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:11:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:11:01 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:11:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:01 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:11:01 user nova-compute[74898]: DEBUG nova.network.neutron [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:11:02 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:11:02 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:11:02 user nova-compute[74898]: DEBUG nova.policy [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ebb3c9e75a2d4e858116fb214b411d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f68ad714a1e48a4aac171700c25db18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:11:02 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:11:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:11:02 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Creating image(s)
Nov 17 03:11:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Acquiring lock "/opt/stack/data/nova/instances/9411b570-6aaa-48bb-bf68-5765bf7d7a04/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:11:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "/opt/stack/data/nova/instances/9411b570-6aaa-48bb-bf68-5765bf7d7a04/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:11:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "/opt/stack/data/nova/instances/9411b570-6aaa-48bb-bf68-5765bf7d7a04/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:11:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.171s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:11:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:11:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.169s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/9411b570-6aaa-48bb-bf68-5765bf7d7a04/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/9411b570-6aaa-48bb-bf68-5765bf7d7a04/disk 1073741824" returned: 0 in 0.051s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:11:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:02 user nova-compute[74898]: DEBUG nova.network.neutron [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Successfully created port: 4aa34942-15bf-440a-baef-7145d7794c7c {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:11:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.183s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:02 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9411b570-6aaa-48bb-bf68-5765bf7d7a04/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:11:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9411b570-6aaa-48bb-bf68-5765bf7d7a04/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9411b570-6aaa-48bb-bf68-5765bf7d7a04/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:02 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Cannot resize image /opt/stack/data/nova/instances/9411b570-6aaa-48bb-bf68-5765bf7d7a04/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:11:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:11:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Ensure instance console log exists: /opt/stack/data/nova/instances/9411b570-6aaa-48bb-bf68-5765bf7d7a04/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:11:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:11:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:11:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:11:03 user nova-compute[74898]: DEBUG nova.network.neutron [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Successfully updated port: 4aa34942-15bf-440a-baef-7145d7794c7c {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:11:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Acquiring lock "refresh_cache-9411b570-6aaa-48bb-bf68-5765bf7d7a04" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:11:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Acquired lock "refresh_cache-9411b570-6aaa-48bb-bf68-5765bf7d7a04" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:11:03 user nova-compute[74898]: DEBUG nova.network.neutron [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:11:03 user nova-compute[74898]: DEBUG nova.compute.manager [req-30afdccb-6bb3-4ea8-bbcf-7a70671be2c5 req-05aed1ed-17e9-4baa-b481-17327423d3ce service nova] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Received event network-changed-4aa34942-15bf-440a-baef-7145d7794c7c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:11:03 user nova-compute[74898]: DEBUG nova.compute.manager [req-30afdccb-6bb3-4ea8-bbcf-7a70671be2c5 req-05aed1ed-17e9-4baa-b481-17327423d3ce service nova] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Refreshing instance network info cache due to event network-changed-4aa34942-15bf-440a-baef-7145d7794c7c. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:11:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-30afdccb-6bb3-4ea8-bbcf-7a70671be2c5 req-05aed1ed-17e9-4baa-b481-17327423d3ce service nova] Acquiring lock "refresh_cache-9411b570-6aaa-48bb-bf68-5765bf7d7a04" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:11:03 user nova-compute[74898]: DEBUG nova.network.neutron [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:11:03 user nova-compute[74898]: DEBUG nova.network.neutron [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Updating instance_info_cache with network_info: [{"id": "4aa34942-15bf-440a-baef-7145d7794c7c", "address": "fa:16:3e:bc:25:63", "network": {"id": "9a342d69-a890-4e6d-af91-66e71d4a1ea8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1591686450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f68ad714a1e48a4aac171700c25db18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa34942-15", "ovs_interfaceid": "4aa34942-15bf-440a-baef-7145d7794c7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Releasing lock "refresh_cache-9411b570-6aaa-48bb-bf68-5765bf7d7a04" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Instance network_info: |[{"id": "4aa34942-15bf-440a-baef-7145d7794c7c", "address": "fa:16:3e:bc:25:63", "network": {"id": "9a342d69-a890-4e6d-af91-66e71d4a1ea8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1591686450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f68ad714a1e48a4aac171700c25db18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa34942-15", "ovs_interfaceid": "4aa34942-15bf-440a-baef-7145d7794c7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-30afdccb-6bb3-4ea8-bbcf-7a70671be2c5 req-05aed1ed-17e9-4baa-b481-17327423d3ce service nova] Acquired lock "refresh_cache-9411b570-6aaa-48bb-bf68-5765bf7d7a04" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.network.neutron [req-30afdccb-6bb3-4ea8-bbcf-7a70671be2c5 req-05aed1ed-17e9-4baa-b481-17327423d3ce service nova] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Refreshing network info cache for port 4aa34942-15bf-440a-baef-7145d7794c7c {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Start _get_guest_xml network_info=[{"id": "4aa34942-15bf-440a-baef-7145d7794c7c", "address": "fa:16:3e:bc:25:63", "network": {"id": "9a342d69-a890-4e6d-af91-66e71d4a1ea8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1591686450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f68ad714a1e48a4aac171700c25db18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa34942-15", "ovs_interfaceid": "4aa34942-15bf-440a-baef-7145d7794c7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:11:04 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:11:04 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:11:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-605983999',display_name='tempest-ServersNegativeTestJSON-server-605983999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-605983999',id=27,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f68ad714a1e48a4aac171700c25db18',ramdisk_id='',reservation_id='r-gzub57ih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-945120285',owner_user_name='tempest-ServersNegativeTestJSON-945120285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:11:02Z,user_data=None,user_id='ebb3c9e75a2d4e858116fb214b411d8d',uuid=9411b570-6aaa-48bb-bf68-5765bf7d7a04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4aa34942-15bf-440a-baef-7145d7794c7c", "address": "fa:16:3e:bc:25:63", "network": {"id": "9a342d69-a890-4e6d-af91-66e71d4a1ea8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1591686450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f68ad714a1e48a4aac171700c25db18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa34942-15", "ovs_interfaceid": "4aa34942-15bf-440a-baef-7145d7794c7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Converting VIF {"id": "4aa34942-15bf-440a-baef-7145d7794c7c", "address": "fa:16:3e:bc:25:63", "network": {"id": "9a342d69-a890-4e6d-af91-66e71d4a1ea8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1591686450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f68ad714a1e48a4aac171700c25db18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa34942-15", "ovs_interfaceid": "4aa34942-15bf-440a-baef-7145d7794c7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:25:63,bridge_name='br-int',has_traffic_filtering=True,id=4aa34942-15bf-440a-baef-7145d7794c7c,network=Network(9a342d69-a890-4e6d-af91-66e71d4a1ea8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa34942-15') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.objects.instance [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lazy-loading 'pci_devices' on Instance uuid 9411b570-6aaa-48bb-bf68-5765bf7d7a04 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:11:04 user nova-compute[74898]:   <uuid>9411b570-6aaa-48bb-bf68-5765bf7d7a04</uuid>
Nov 17 03:11:04 user nova-compute[74898]:   <name>instance-0000001b</name>
Nov 17 03:11:04 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:11:04 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:11:04 user nova-compute[74898]:   <metadata>
Nov 17 03:11:04 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:11:04 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:11:04 user nova-compute[74898]:       <nova:name>tempest-ServersNegativeTestJSON-server-605983999</nova:name>
Nov 17 03:11:04 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:11:04</nova:creationTime>
Nov 17 03:11:04 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:11:04 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:11:04 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:11:04 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:11:04 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:11:04 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:11:04 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:11:04 user nova-compute[74898]:       <nova:owner>
Nov 17 03:11:04 user nova-compute[74898]:         <nova:user uuid="ebb3c9e75a2d4e858116fb214b411d8d">tempest-ServersNegativeTestJSON-945120285-project-member</nova:user>
Nov 17 03:11:04 user nova-compute[74898]:         <nova:project uuid="9f68ad714a1e48a4aac171700c25db18">tempest-ServersNegativeTestJSON-945120285</nova:project>
Nov 17 03:11:04 user nova-compute[74898]:       </nova:owner>
Nov 17 03:11:04 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:11:04 user nova-compute[74898]:       <nova:ports>
Nov 17 03:11:04 user nova-compute[74898]:         <nova:port uuid="4aa34942-15bf-440a-baef-7145d7794c7c">
Nov 17 03:11:04 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 17 03:11:04 user nova-compute[74898]:         </nova:port>
Nov 17 03:11:04 user nova-compute[74898]:       </nova:ports>
Nov 17 03:11:04 user nova-compute[74898]:     </nova:instance>
Nov 17 03:11:04 user nova-compute[74898]:   </metadata>
Nov 17 03:11:04 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:11:04 user nova-compute[74898]:     <system>
Nov 17 03:11:04 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:11:04 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:11:04 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:11:04 user nova-compute[74898]:       <entry name="serial">9411b570-6aaa-48bb-bf68-5765bf7d7a04</entry>
Nov 17 03:11:04 user nova-compute[74898]:       <entry name="uuid">9411b570-6aaa-48bb-bf68-5765bf7d7a04</entry>
Nov 17 03:11:04 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:11:04 user nova-compute[74898]:     </system>
Nov 17 03:11:04 user nova-compute[74898]:   </sysinfo>
Nov 17 03:11:04 user nova-compute[74898]:   <os>
Nov 17 03:11:04 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:11:04 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:11:04 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:11:04 user nova-compute[74898]:   </os>
Nov 17 03:11:04 user nova-compute[74898]:   <features>
Nov 17 03:11:04 user nova-compute[74898]:     <acpi/>
Nov 17 03:11:04 user nova-compute[74898]:     <apic/>
Nov 17 03:11:04 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:11:04 user nova-compute[74898]:   </features>
Nov 17 03:11:04 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:11:04 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:11:04 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:11:04 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:11:04 user nova-compute[74898]:   </clock>
Nov 17 03:11:04 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:11:04 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:11:04 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:11:04 user nova-compute[74898]:   </cpu>
Nov 17 03:11:04 user nova-compute[74898]:   <devices>
Nov 17 03:11:04 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:11:04 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:11:04 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/9411b570-6aaa-48bb-bf68-5765bf7d7a04/disk"/>
Nov 17 03:11:04 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:11:04 user nova-compute[74898]:     </disk>
Nov 17 03:11:04 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:11:04 user nova-compute[74898]:       <mac address="fa:16:3e:bc:25:63"/>
Nov 17 03:11:04 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:11:04 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:11:04 user nova-compute[74898]:       <target dev="tap4aa34942-15"/>
Nov 17 03:11:04 user nova-compute[74898]:     </interface>
Nov 17 03:11:04 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:11:04 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/9411b570-6aaa-48bb-bf68-5765bf7d7a04/console.log" append="off"/>
Nov 17 03:11:04 user nova-compute[74898]:     </serial>
Nov 17 03:11:04 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:11:04 user nova-compute[74898]:     <video>
Nov 17 03:11:04 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:11:04 user nova-compute[74898]:     </video>
Nov 17 03:11:04 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:11:04 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:11:04 user nova-compute[74898]:     </rng>
Nov 17 03:11:04 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:11:04 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:11:04 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:11:04 user nova-compute[74898]:     </memballoon>
Nov 17 03:11:04 user nova-compute[74898]:   </devices>
Nov 17 03:11:04 user nova-compute[74898]: </domain>
Nov 17 03:11:04 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:11:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-605983999',display_name='tempest-ServersNegativeTestJSON-server-605983999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-605983999',id=27,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f68ad714a1e48a4aac171700c25db18',ramdisk_id='',reservation_id='r-gzub57ih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-945120285',owner_user_name='tempest-ServersNegativeTestJSON-945120285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:11:02Z,user_data=None,user_id='ebb3c9e75a2d4e858116fb214b411d8d',uuid=9411b570-6aaa-48bb-bf68-5765bf7d7a04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4aa34942-15bf-440a-baef-7145d7794c7c", "address": "fa:16:3e:bc:25:63", "network": {"id": "9a342d69-a890-4e6d-af91-66e71d4a1ea8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1591686450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f68ad714a1e48a4aac171700c25db18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa34942-15", "ovs_interfaceid": "4aa34942-15bf-440a-baef-7145d7794c7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Converting VIF {"id": "4aa34942-15bf-440a-baef-7145d7794c7c", "address": "fa:16:3e:bc:25:63", "network": {"id": "9a342d69-a890-4e6d-af91-66e71d4a1ea8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1591686450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f68ad714a1e48a4aac171700c25db18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa34942-15", "ovs_interfaceid": "4aa34942-15bf-440a-baef-7145d7794c7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:25:63,bridge_name='br-int',has_traffic_filtering=True,id=4aa34942-15bf-440a-baef-7145d7794c7c,network=Network(9a342d69-a890-4e6d-af91-66e71d4a1ea8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa34942-15') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG os_vif [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:25:63,bridge_name='br-int',has_traffic_filtering=True,id=4aa34942-15bf-440a-baef-7145d7794c7c,network=Network(9a342d69-a890-4e6d-af91-66e71d4a1ea8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa34942-15') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e6269ec0-07a8-5b58-9fe9-c44767dc7f98', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4aa34942-15, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4aa34942-15, col_values=(('qos', UUID('99741df4-f32e-48de-8083-95471d7a7ceb')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4aa34942-15, col_values=(('external_ids', {'iface-id': '4aa34942-15bf-440a-baef-7145d7794c7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:25:63', 'vm-uuid': '9411b570-6aaa-48bb-bf68-5765bf7d7a04'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:04 user nova-compute[74898]: INFO os_vif [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:25:63,bridge_name='br-int',has_traffic_filtering=True,id=4aa34942-15bf-440a-baef-7145d7794c7c,network=Network(9a342d69-a890-4e6d-af91-66e71d4a1ea8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa34942-15')
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] No VIF found with MAC fa:16:3e:bc:25:63, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.network.neutron [req-30afdccb-6bb3-4ea8-bbcf-7a70671be2c5 req-05aed1ed-17e9-4baa-b481-17327423d3ce service nova] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Updated VIF entry in instance network info cache for port 4aa34942-15bf-440a-baef-7145d7794c7c. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG nova.network.neutron [req-30afdccb-6bb3-4ea8-bbcf-7a70671be2c5 req-05aed1ed-17e9-4baa-b481-17327423d3ce service nova] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Updating instance_info_cache with network_info: [{"id": "4aa34942-15bf-440a-baef-7145d7794c7c", "address": "fa:16:3e:bc:25:63", "network": {"id": "9a342d69-a890-4e6d-af91-66e71d4a1ea8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1591686450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f68ad714a1e48a4aac171700c25db18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa34942-15", "ovs_interfaceid": "4aa34942-15bf-440a-baef-7145d7794c7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:11:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-30afdccb-6bb3-4ea8-bbcf-7a70671be2c5 req-05aed1ed-17e9-4baa-b481-17327423d3ce service nova] Releasing lock "refresh_cache-9411b570-6aaa-48bb-bf68-5765bf7d7a04" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:11:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:05 user nova-compute[74898]: DEBUG nova.compute.manager [req-de8097b1-c81b-4c18-a69e-301cd267b500 req-f4534e10-6fb2-4252-b0fa-f972c67ea7c1 service nova] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Received event network-vif-plugged-4aa34942-15bf-440a-baef-7145d7794c7c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:11:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-de8097b1-c81b-4c18-a69e-301cd267b500 req-f4534e10-6fb2-4252-b0fa-f972c67ea7c1 service nova] Acquiring lock "9411b570-6aaa-48bb-bf68-5765bf7d7a04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:11:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-de8097b1-c81b-4c18-a69e-301cd267b500 req-f4534e10-6fb2-4252-b0fa-f972c67ea7c1 service nova] Lock "9411b570-6aaa-48bb-bf68-5765bf7d7a04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:11:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-de8097b1-c81b-4c18-a69e-301cd267b500 req-f4534e10-6fb2-4252-b0fa-f972c67ea7c1 service nova] Lock "9411b570-6aaa-48bb-bf68-5765bf7d7a04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:11:05 user nova-compute[74898]: DEBUG nova.compute.manager [req-de8097b1-c81b-4c18-a69e-301cd267b500 req-f4534e10-6fb2-4252-b0fa-f972c67ea7c1 service nova] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] No waiting events found dispatching network-vif-plugged-4aa34942-15bf-440a-baef-7145d7794c7c {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:11:05 user nova-compute[74898]: WARNING nova.compute.manager [req-de8097b1-c81b-4c18-a69e-301cd267b500 req-f4534e10-6fb2-4252-b0fa-f972c67ea7c1 service nova] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Received unexpected event network-vif-plugged-4aa34942-15bf-440a-baef-7145d7794c7c for instance with vm_state building and task_state spawning.
Nov 17 03:11:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:07 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:11:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:11:07 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Instance spawned successfully.
Nov 17 03:11:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:11:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:11:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:11:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:11:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:11:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:11:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:11:07 user nova-compute[74898]: INFO nova.compute.manager [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Took 5.52 seconds to spawn the instance on the hypervisor.
Nov 17 03:11:07 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:11:07 user nova-compute[74898]: DEBUG nova.compute.manager [req-1021d631-8ed2-4836-b4cd-9b817ecb146a req-49ad2048-66d8-46f9-9d57-fc5b3e06a26e service nova] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Received event network-vif-plugged-4aa34942-15bf-440a-baef-7145d7794c7c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:11:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1021d631-8ed2-4836-b4cd-9b817ecb146a req-49ad2048-66d8-46f9-9d57-fc5b3e06a26e service nova] Acquiring lock "9411b570-6aaa-48bb-bf68-5765bf7d7a04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:11:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1021d631-8ed2-4836-b4cd-9b817ecb146a req-49ad2048-66d8-46f9-9d57-fc5b3e06a26e service nova] Lock "9411b570-6aaa-48bb-bf68-5765bf7d7a04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:11:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1021d631-8ed2-4836-b4cd-9b817ecb146a req-49ad2048-66d8-46f9-9d57-fc5b3e06a26e service nova] Lock "9411b570-6aaa-48bb-bf68-5765bf7d7a04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:11:07 user nova-compute[74898]: DEBUG nova.compute.manager [req-1021d631-8ed2-4836-b4cd-9b817ecb146a req-49ad2048-66d8-46f9-9d57-fc5b3e06a26e service nova] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] No waiting events found dispatching network-vif-plugged-4aa34942-15bf-440a-baef-7145d7794c7c {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:11:07 user nova-compute[74898]: WARNING nova.compute.manager [req-1021d631-8ed2-4836-b4cd-9b817ecb146a req-49ad2048-66d8-46f9-9d57-fc5b3e06a26e service nova] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Received unexpected event network-vif-plugged-4aa34942-15bf-440a-baef-7145d7794c7c for instance with vm_state building and task_state spawning.
Nov 17 03:11:07 user nova-compute[74898]: INFO nova.compute.manager [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Took 6.29 seconds to build instance.
Nov 17 03:11:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a2b4b614-2f4c-46b5-9220-0d686fecba2e tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "9411b570-6aaa-48bb-bf68-5765bf7d7a04" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.389s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:11:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:14 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:18 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:11:18 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:11:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:11:19 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:11:20 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:11:20 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:11:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:22 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:11:22 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:11:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-f457f5c7-58e3-4f7f-b495-6cfd3440d7dd" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:11:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-f457f5c7-58e3-4f7f-b495-6cfd3440d7dd" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:11:22 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:11:23 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Updating instance_info_cache with network_info: [{"id": "bc696f62-bbd0-40f8-8c83-2622f22ff494", "address": "fa:16:3e:a0:44:e9", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc696f62-bb", "ovs_interfaceid": "bc696f62-bbd0-40f8-8c83-2622f22ff494", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:11:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-f457f5c7-58e3-4f7f-b495-6cfd3440d7dd" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:11:23 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:11:23 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:11:23 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:11:23 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:11:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:11:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:11:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:11:23 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:11:23 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:25 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:11:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:11:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9411b570-6aaa-48bb-bf68-5765bf7d7a04/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9411b570-6aaa-48bb-bf68-5765bf7d7a04/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9411b570-6aaa-48bb-bf68-5765bf7d7a04/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9411b570-6aaa-48bb-bf68-5765bf7d7a04/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:27 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:11:27 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:11:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:28 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:11:28 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:11:28 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=7807MB free_disk=25.275192260742188GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:11:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:11:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:11:28 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:11:28 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance e733574a-56ba-4e24-babd-855bcb5bda61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:11:28 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 42994e39-187a-4fb6-a293-24a4eb57177b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:11:28 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance f25ef6a9-d007-419d-8478-2a9e79d5f03a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:11:28 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance f457f5c7-58e3-4f7f-b495-6cfd3440d7dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:11:28 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 13449e5c-809b-4db2-af0b-53f5865eb3a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:11:28 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance c49f4ec3-6f9b-4e14-ba29-208aa026301e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:11:28 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance a92bce56-1038-4762-9c1e-19b5a7ff8cef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:11:28 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance ff69d6dd-bce4-400b-8f03-429068cf32eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:11:28 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 24cd7ac4-3724-4189-82a7-ba61ba46097a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:11:28 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 9411b570-6aaa-48bb-bf68-5765bf7d7a04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:11:28 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:11:28 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:11:28 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:11:28 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:11:28 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:11:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.517s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:11:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Acquiring lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:11:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:11:29 user nova-compute[74898]: INFO nova.compute.manager [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Unshelving
Nov 17 03:11:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:29 user nova-compute[74898]: INFO nova.virt.block_device [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Booting with volume 317e439b-e336-4f22-9638-809454e990f7 at /dev/vda
Nov 17 03:11:29 user nova-compute[74898]: DEBUG os_brick.utils [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:11:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9f808c-6d0a-419e-99b6-01234a6de44f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8198b143-8086-48b9-be95-0e0948120915]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7e7768-0600-4d13-8732-be42a46077a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd8f1f2-914f-4078-a3a2-a1b043375645]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:11:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:11:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:11:29 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:11:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb8ca80-c094-427e-8bdf-d71553756ff8]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:11:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:11:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:11:29 user nova-compute[74898]: DEBUG os_brick.utils [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:11:29 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Updating existing volume attachment record: 09a79fd8-82c7-42ea-9ad0-6093e4336c50 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:11:29 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:11:29 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:11:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "ecb90e79-877e-4012-b569-53aefd96de38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:11:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "ecb90e79-877e-4012-b569-53aefd96de38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:11:30 user nova-compute[74898]: DEBUG nova.compute.manager [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:11:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:11:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:11:30 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:11:30 user nova-compute[74898]: INFO nova.compute.claims [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Claim successful on node user
Nov 17 03:11:30 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:11:30 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:11:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:11:30 user nova-compute[74898]: DEBUG nova.compute.manager [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:11:30 user nova-compute[74898]: DEBUG nova.compute.manager [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:11:30 user nova-compute[74898]: DEBUG nova.network.neutron [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:11:30 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:11:30 user nova-compute[74898]: DEBUG nova.compute.manager [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:11:30 user nova-compute[74898]: DEBUG nova.policy [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '926d8bd27eb24824a71cb9f1969f9c45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de7d05d475c49f0805f5aab5853a0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:11:30 user nova-compute[74898]: DEBUG nova.compute.manager [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:11:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:11:30 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Creating image(s)
Nov 17 03:11:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "/opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:11:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "/opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:11:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "/opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:11:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.182s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:11:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:11:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.185s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk 1073741824" returned: 0 in 0.055s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:11:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:31 user nova-compute[74898]: DEBUG nova.network.neutron [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Successfully created port: 794c112e-9370-4bcc-9fc1-51a9c3b692e1 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:11:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.177s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:31 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:11:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:31 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Cannot resize image /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:11:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:11:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Ensure instance console log exists: /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:11:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:11:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:11:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:11:31 user nova-compute[74898]: DEBUG nova.network.neutron [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Successfully updated port: 794c112e-9370-4bcc-9fc1-51a9c3b692e1 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "refresh_cache-ecb90e79-877e-4012-b569-53aefd96de38" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquired lock "refresh_cache-ecb90e79-877e-4012-b569-53aefd96de38" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.network.neutron [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.compute.manager [req-526f329b-d65f-4100-9220-097c00b7946f req-fc468b4f-0081-4b2d-8a08-af5969083a6e service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Received event network-changed-794c112e-9370-4bcc-9fc1-51a9c3b692e1 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.compute.manager [req-526f329b-d65f-4100-9220-097c00b7946f req-fc468b4f-0081-4b2d-8a08-af5969083a6e service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Refreshing instance network info cache due to event network-changed-794c112e-9370-4bcc-9fc1-51a9c3b692e1. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-526f329b-d65f-4100-9220-097c00b7946f req-fc468b4f-0081-4b2d-8a08-af5969083a6e service nova] Acquiring lock "refresh_cache-ecb90e79-877e-4012-b569-53aefd96de38" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.network.neutron [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.network.neutron [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Updating instance_info_cache with network_info: [{"id": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "address": "fa:16:3e:bd:21:91", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794c112e-93", "ovs_interfaceid": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Releasing lock "refresh_cache-ecb90e79-877e-4012-b569-53aefd96de38" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.compute.manager [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Instance network_info: |[{"id": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "address": "fa:16:3e:bd:21:91", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794c112e-93", "ovs_interfaceid": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-526f329b-d65f-4100-9220-097c00b7946f req-fc468b4f-0081-4b2d-8a08-af5969083a6e service nova] Acquired lock "refresh_cache-ecb90e79-877e-4012-b569-53aefd96de38" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.network.neutron [req-526f329b-d65f-4100-9220-097c00b7946f req-fc468b4f-0081-4b2d-8a08-af5969083a6e service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Refreshing network info cache for port 794c112e-9370-4bcc-9fc1-51a9c3b692e1 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Start _get_guest_xml network_info=[{"id": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "address": "fa:16:3e:bd:21:91", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794c112e-93", "ovs_interfaceid": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:11:32 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:11:32 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:11:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2100741292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2100741292',id=28,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtbu5U3PmGex6+l+d2xQitFVFUhTB/42hBUcwFM3rFddUybYVm/HJa1SSl7ynLj16o3HC8Me2Uv8377M/7TJKq0m1jfyBGUoyNiWj576PEY80BEbiklEpgOviDozZNNhg==',key_name='tempest-keypair-301754943',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3de7d05d475c49f0805f5aab5853a0b2',ramdisk_id='',reservation_id='r-plwophpo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-940982522',owner_user_name='tempest-AttachVolumeShelveTestJSON-940982522-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:11:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='926d8bd27eb24824a71cb9f1969f9c45',uuid=ecb90e79-877e-4012-b569-53aefd96de38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "address": "fa:16:3e:bd:21:91", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794c112e-93", "ovs_interfaceid": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Converting VIF {"id": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "address": "fa:16:3e:bd:21:91", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794c112e-93", "ovs_interfaceid": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:21:91,bridge_name='br-int',has_traffic_filtering=True,id=794c112e-9370-4bcc-9fc1-51a9c3b692e1,network=Network(c92bc72d-7b33-49a8-96e5-ca2ed117fa48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap794c112e-93') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.objects.instance [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lazy-loading 'pci_devices' on Instance uuid ecb90e79-877e-4012-b569-53aefd96de38 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:11:32 user nova-compute[74898]:   <uuid>ecb90e79-877e-4012-b569-53aefd96de38</uuid>
Nov 17 03:11:32 user nova-compute[74898]:   <name>instance-0000001c</name>
Nov 17 03:11:32 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:11:32 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:11:32 user nova-compute[74898]:   <metadata>
Nov 17 03:11:32 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:11:32 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:11:32 user nova-compute[74898]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2100741292</nova:name>
Nov 17 03:11:32 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:11:32</nova:creationTime>
Nov 17 03:11:32 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:11:32 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:11:32 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:11:32 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:11:32 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:11:32 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:11:32 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:11:32 user nova-compute[74898]:       <nova:owner>
Nov 17 03:11:32 user nova-compute[74898]:         <nova:user uuid="926d8bd27eb24824a71cb9f1969f9c45">tempest-AttachVolumeShelveTestJSON-940982522-project-member</nova:user>
Nov 17 03:11:32 user nova-compute[74898]:         <nova:project uuid="3de7d05d475c49f0805f5aab5853a0b2">tempest-AttachVolumeShelveTestJSON-940982522</nova:project>
Nov 17 03:11:32 user nova-compute[74898]:       </nova:owner>
Nov 17 03:11:32 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:11:32 user nova-compute[74898]:       <nova:ports>
Nov 17 03:11:32 user nova-compute[74898]:         <nova:port uuid="794c112e-9370-4bcc-9fc1-51a9c3b692e1">
Nov 17 03:11:32 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 17 03:11:32 user nova-compute[74898]:         </nova:port>
Nov 17 03:11:32 user nova-compute[74898]:       </nova:ports>
Nov 17 03:11:32 user nova-compute[74898]:     </nova:instance>
Nov 17 03:11:32 user nova-compute[74898]:   </metadata>
Nov 17 03:11:32 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:11:32 user nova-compute[74898]:     <system>
Nov 17 03:11:32 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:11:32 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:11:32 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:11:32 user nova-compute[74898]:       <entry name="serial">ecb90e79-877e-4012-b569-53aefd96de38</entry>
Nov 17 03:11:32 user nova-compute[74898]:       <entry name="uuid">ecb90e79-877e-4012-b569-53aefd96de38</entry>
Nov 17 03:11:32 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:11:32 user nova-compute[74898]:     </system>
Nov 17 03:11:32 user nova-compute[74898]:   </sysinfo>
Nov 17 03:11:32 user nova-compute[74898]:   <os>
Nov 17 03:11:32 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:11:32 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:11:32 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:11:32 user nova-compute[74898]:   </os>
Nov 17 03:11:32 user nova-compute[74898]:   <features>
Nov 17 03:11:32 user nova-compute[74898]:     <acpi/>
Nov 17 03:11:32 user nova-compute[74898]:     <apic/>
Nov 17 03:11:32 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:11:32 user nova-compute[74898]:   </features>
Nov 17 03:11:32 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:11:32 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:11:32 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:11:32 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:11:32 user nova-compute[74898]:   </clock>
Nov 17 03:11:32 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:11:32 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:11:32 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:11:32 user nova-compute[74898]:   </cpu>
Nov 17 03:11:32 user nova-compute[74898]:   <devices>
Nov 17 03:11:32 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:11:32 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:11:32 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk"/>
Nov 17 03:11:32 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:11:32 user nova-compute[74898]:     </disk>
Nov 17 03:11:32 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:11:32 user nova-compute[74898]:       <mac address="fa:16:3e:bd:21:91"/>
Nov 17 03:11:32 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:11:32 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:11:32 user nova-compute[74898]:       <target dev="tap794c112e-93"/>
Nov 17 03:11:32 user nova-compute[74898]:     </interface>
Nov 17 03:11:32 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:11:32 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/console.log" append="off"/>
Nov 17 03:11:32 user nova-compute[74898]:     </serial>
Nov 17 03:11:32 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:11:32 user nova-compute[74898]:     <video>
Nov 17 03:11:32 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:11:32 user nova-compute[74898]:     </video>
Nov 17 03:11:32 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:11:32 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:11:32 user nova-compute[74898]:     </rng>
Nov 17 03:11:32 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:11:32 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:11:32 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:11:32 user nova-compute[74898]:     </memballoon>
Nov 17 03:11:32 user nova-compute[74898]:   </devices>
Nov 17 03:11:32 user nova-compute[74898]: </domain>
Nov 17 03:11:32 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:11:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2100741292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2100741292',id=28,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtbu5U3PmGex6+l+d2xQitFVFUhTB/42hBUcwFM3rFddUybYVm/HJa1SSl7ynLj16o3HC8Me2Uv8377M/7TJKq0m1jfyBGUoyNiWj576PEY80BEbiklEpgOviDozZNNhg==',key_name='tempest-keypair-301754943',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3de7d05d475c49f0805f5aab5853a0b2',ramdisk_id='',reservation_id='r-plwophpo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-940982522',owner_user_name='tempest-AttachVolumeShelveTestJSON-940982522-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:11:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='926d8bd27eb24824a71cb9f1969f9c45',uuid=ecb90e79-877e-4012-b569-53aefd96de38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "address": "fa:16:3e:bd:21:91", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794c112e-93", "ovs_interfaceid": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Converting VIF {"id": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "address": "fa:16:3e:bd:21:91", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794c112e-93", "ovs_interfaceid": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:21:91,bridge_name='br-int',has_traffic_filtering=True,id=794c112e-9370-4bcc-9fc1-51a9c3b692e1,network=Network(c92bc72d-7b33-49a8-96e5-ca2ed117fa48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap794c112e-93') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG os_vif [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:21:91,bridge_name='br-int',has_traffic_filtering=True,id=794c112e-9370-4bcc-9fc1-51a9c3b692e1,network=Network(c92bc72d-7b33-49a8-96e5-ca2ed117fa48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap794c112e-93') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a2a3e6c-cf85-5f35-8ce1-eccd02d71d00', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap794c112e-93, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap794c112e-93, col_values=(('qos', UUID('550744ea-f16a-4864-87b1-bf48c4e2ffbd')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap794c112e-93, col_values=(('external_ids', {'iface-id': '794c112e-9370-4bcc-9fc1-51a9c3b692e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:21:91', 'vm-uuid': 'ecb90e79-877e-4012-b569-53aefd96de38'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:32 user nova-compute[74898]: INFO os_vif [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:21:91,bridge_name='br-int',has_traffic_filtering=True,id=794c112e-9370-4bcc-9fc1-51a9c3b692e1,network=Network(c92bc72d-7b33-49a8-96e5-ca2ed117fa48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap794c112e-93')
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] No VIF found with MAC fa:16:3e:bd:21:91, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.network.neutron [req-526f329b-d65f-4100-9220-097c00b7946f req-fc468b4f-0081-4b2d-8a08-af5969083a6e service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Updated VIF entry in instance network info cache for port 794c112e-9370-4bcc-9fc1-51a9c3b692e1. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG nova.network.neutron [req-526f329b-d65f-4100-9220-097c00b7946f req-fc468b4f-0081-4b2d-8a08-af5969083a6e service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Updating instance_info_cache with network_info: [{"id": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "address": "fa:16:3e:bd:21:91", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794c112e-93", "ovs_interfaceid": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:11:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-526f329b-d65f-4100-9220-097c00b7946f req-fc468b4f-0081-4b2d-8a08-af5969083a6e service nova] Releasing lock "refresh_cache-ecb90e79-877e-4012-b569-53aefd96de38" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:11:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-54ce2076-e3d9-4d82-a4b7-d7edbdf1d092 req-dd81a9b2-2ee1-47fd-b875-287f202fce62 service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Received event network-vif-plugged-794c112e-9370-4bcc-9fc1-51a9c3b692e1 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:11:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-54ce2076-e3d9-4d82-a4b7-d7edbdf1d092 req-dd81a9b2-2ee1-47fd-b875-287f202fce62 service nova] Acquiring lock "ecb90e79-877e-4012-b569-53aefd96de38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:11:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-54ce2076-e3d9-4d82-a4b7-d7edbdf1d092 req-dd81a9b2-2ee1-47fd-b875-287f202fce62 service nova] Lock "ecb90e79-877e-4012-b569-53aefd96de38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:11:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-54ce2076-e3d9-4d82-a4b7-d7edbdf1d092 req-dd81a9b2-2ee1-47fd-b875-287f202fce62 service nova] Lock "ecb90e79-877e-4012-b569-53aefd96de38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:11:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-54ce2076-e3d9-4d82-a4b7-d7edbdf1d092 req-dd81a9b2-2ee1-47fd-b875-287f202fce62 service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] No waiting events found dispatching network-vif-plugged-794c112e-9370-4bcc-9fc1-51a9c3b692e1 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:11:34 user nova-compute[74898]: WARNING nova.compute.manager [req-54ce2076-e3d9-4d82-a4b7-d7edbdf1d092 req-dd81a9b2-2ee1-47fd-b875-287f202fce62 service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Received unexpected event network-vif-plugged-794c112e-9370-4bcc-9fc1-51a9c3b692e1 for instance with vm_state building and task_state spawning.
Nov 17 03:11:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:11:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:11:35 user nova-compute[74898]: DEBUG nova.objects.instance [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lazy-loading 'pci_requests' on Instance uuid e188cb77-4a1d-4cab-9b32-9e3d442bb64d {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:11:35 user nova-compute[74898]: DEBUG nova.objects.instance [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lazy-loading 'numa_topology' on Instance uuid e188cb77-4a1d-4cab-9b32-9e3d442bb64d {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:11:35 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:11:35 user nova-compute[74898]: INFO nova.compute.claims [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Claim successful on node user
Nov 17 03:11:35 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:11:35 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:11:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.615s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:11:35 user nova-compute[74898]: INFO nova.network.neutron [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Updating port 1ab100dc-5533-4676-9814-2c9ce077e75e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 17 03:11:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.compute.manager [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:11:36 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Instance spawned successfully.
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.compute.manager [req-0b146979-67b9-412b-a7e4-2f9912deb857 req-3dbc50cc-09a5-46f7-ba14-88618ea41b2e service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Received event network-vif-plugged-794c112e-9370-4bcc-9fc1-51a9c3b692e1 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0b146979-67b9-412b-a7e4-2f9912deb857 req-3dbc50cc-09a5-46f7-ba14-88618ea41b2e service nova] Acquiring lock "ecb90e79-877e-4012-b569-53aefd96de38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0b146979-67b9-412b-a7e4-2f9912deb857 req-3dbc50cc-09a5-46f7-ba14-88618ea41b2e service nova] Lock "ecb90e79-877e-4012-b569-53aefd96de38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0b146979-67b9-412b-a7e4-2f9912deb857 req-3dbc50cc-09a5-46f7-ba14-88618ea41b2e service nova] Lock "ecb90e79-877e-4012-b569-53aefd96de38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.compute.manager [req-0b146979-67b9-412b-a7e4-2f9912deb857 req-3dbc50cc-09a5-46f7-ba14-88618ea41b2e service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] No waiting events found dispatching network-vif-plugged-794c112e-9370-4bcc-9fc1-51a9c3b692e1 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:11:36 user nova-compute[74898]: WARNING nova.compute.manager [req-0b146979-67b9-412b-a7e4-2f9912deb857 req-3dbc50cc-09a5-46f7-ba14-88618ea41b2e service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Received unexpected event network-vif-plugged-794c112e-9370-4bcc-9fc1-51a9c3b692e1 for instance with vm_state building and task_state spawning.
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:11:36 user nova-compute[74898]: INFO nova.compute.manager [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Took 5.28 seconds to spawn the instance on the hypervisor.
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.compute.manager [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:11:36 user nova-compute[74898]: INFO nova.compute.manager [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Took 6.10 seconds to build instance.
Nov 17 03:11:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0956af8b-fd86-419c-84b9-a01d8356caf2 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "ecb90e79-877e-4012-b569-53aefd96de38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.198s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Acquiring lock "refresh_cache-e188cb77-4a1d-4cab-9b32-9e3d442bb64d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Acquired lock "refresh_cache-e188cb77-4a1d-4cab-9b32-9e3d442bb64d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.network.neutron [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.compute.manager [req-9eeff4e7-8ed1-4ba8-ae6b-5ec2c6dcbf3b req-7ffa4a5c-1242-4081-be25-12a9b0acf770 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Received event network-changed-1ab100dc-5533-4676-9814-2c9ce077e75e {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.compute.manager [req-9eeff4e7-8ed1-4ba8-ae6b-5ec2c6dcbf3b req-7ffa4a5c-1242-4081-be25-12a9b0acf770 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Refreshing instance network info cache due to event network-changed-1ab100dc-5533-4676-9814-2c9ce077e75e. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9eeff4e7-8ed1-4ba8-ae6b-5ec2c6dcbf3b req-7ffa4a5c-1242-4081-be25-12a9b0acf770 service nova] Acquiring lock "refresh_cache-e188cb77-4a1d-4cab-9b32-9e3d442bb64d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.network.neutron [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Updating instance_info_cache with network_info: [{"id": "1ab100dc-5533-4676-9814-2c9ce077e75e", "address": "fa:16:3e:15:59:1e", "network": {"id": "52b2b9ce-ab0e-4516-b46f-04f1670a5859", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349717026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e17e2cb304d88832baac8d20b6ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab100dc-55", "ovs_interfaceid": "1ab100dc-5533-4676-9814-2c9ce077e75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Releasing lock "refresh_cache-e188cb77-4a1d-4cab-9b32-9e3d442bb64d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:11:36 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Creating image(s)
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Did not create local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Ensure instance console log exists: /opt/stack/data/nova/instances/e188cb77-4a1d-4cab-9b32-9e3d442bb64d/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Start _get_guest_xml network_info=[{"id": "1ab100dc-5533-4676-9814-2c9ce077e75e", "address": "fa:16:3e:15:59:1e", "network": {"id": "52b2b9ce-ab0e-4516-b46f-04f1670a5859", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349717026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e17e2cb304d88832baac8d20b6ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab100dc-55", "ovs_interfaceid": "1ab100dc-5533-4676-9814-2c9ce077e75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgCfIaPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e188cb77-4a1d-4cab-9b32-9e3d442bb64d', 'attached_at': '', 'detached_at': '', 'volume_id': '317e439b-e336-4f22-9638-809454e990f7', 'serial': '317e439b-e336-4f22-9638-809454e990f7'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '09a79fd8-82c7-42ea-9ad0-6093e4336c50', 'volume_type': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9eeff4e7-8ed1-4ba8-ae6b-5ec2c6dcbf3b req-7ffa4a5c-1242-4081-be25-12a9b0acf770 service nova] Acquired lock "refresh_cache-e188cb77-4a1d-4cab-9b32-9e3d442bb64d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.network.neutron [req-9eeff4e7-8ed1-4ba8-ae6b-5ec2c6dcbf3b req-7ffa4a5c-1242-4081-be25-12a9b0acf770 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Refreshing network info cache for port 1ab100dc-5533-4676-9814-2c9ce077e75e {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:11:36 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:11:36 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.objects.instance [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lazy-loading 'vcpu_model' on Instance uuid e188cb77-4a1d-4cab-9b32-9e3d442bb64d {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.objects.base [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Object Instance<e188cb77-4a1d-4cab-9b32-9e3d442bb64d> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgCfIaPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:11:36 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:11:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:11:36 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:11:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:11:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:11:36 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:11:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0e5723-a99c-4a08-a580-4fc2d1dbc4ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:11:37 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ed6530-e707-46df-9be9-3e15dc0d8c83]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7] added
Nov 17 03:11:37 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26bd9d1-bed0-4c57-a8ca-efeda65f8c33]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f640441-7d44-4b69-a82f-037a4ff77615]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jgCfIaPB {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jgCfIaPB" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6335d6-c4e2-4f5a-b2b3-bf005a12d6c5]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jgCfIaPB'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:11:37 user nova-compute[74898]: INFO nova.compute.manager [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Detaching volume c48f4c9e-2c05-41b5-b2f8-236a81a837c2
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[842ff775-a87c-486a-b09f-8ab64a19a9d5]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff98a7d6-63cd-41ba-8e0c-8cfd883a4342]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:11:37 user nova-compute[74898]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)
Nov 17 03:11:37 user nova-compute[74898]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)
Nov 17 03:11:37 user nova-compute[74898]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:11:37 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:11:37 user nova-compute[74898]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)
Nov 17 03:11:37 user nova-compute[74898]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)
Nov 17 03:11:37 user nova-compute[74898]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:11:37 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:37 user nova-compute[74898]: INFO nova.virt.block_device [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Attempting to driver detach volume c48f4c9e-2c05-41b5-b2f8-236a81a837c2 from mountpoint /dev/vdb
Nov 17 03:11:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Attempting to detach device vdb from instance f25ef6a9-d007-419d-8478-2a9e79d5f03a from the persistent domain config. {{(pid=74898) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:11:37 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:11:37 user nova-compute[74898]:   <source dev="/dev/sdd"/>
Nov 17 03:11:37 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:11:37 user nova-compute[74898]:   <serial>c48f4c9e-2c05-41b5-b2f8-236a81a837c2</serial>
Nov 17 03:11:37 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 17 03:11:37 user nova-compute[74898]: </disk>
Nov 17 03:11:37 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da15ab1-7a93-4e80-b99f-eef2c4e4fe21]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7, portal: 172.16.0.220,3260]
Nov 17 03:11:37 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7, portal: 172.16.0.220,3260] successful.
Nov 17 03:11:37 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:11:37 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Successfully detached device vdb from instance f25ef6a9-d007-419d-8478-2a9e79d5f03a from the persistent domain config.
Nov 17 03:11:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f25ef6a9-d007-419d-8478-2a9e79d5f03a from the live domain config. {{(pid=74898) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:11:37 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:11:37 user nova-compute[74898]:   <source dev="/dev/sdd"/>
Nov 17 03:11:37 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:11:37 user nova-compute[74898]:   <serial>c48f4c9e-2c05-41b5-b2f8-236a81a837c2</serial>
Nov 17 03:11:37 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 17 03:11:37 user nova-compute[74898]: </disk>
Nov 17 03:11:37 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4f888c-9a8e-41dc-8af6-c31a5b9a446f]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3575765b-c51f-4b45-b239-a14b97f3e42c]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:11:37 user nova-compute[74898]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)
Nov 17 03:11:37 user nova-compute[74898]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)
Nov 17 03:11:37 user nova-compute[74898]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:11:37 user nova-compute[74898]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:11:37 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:11:37 user nova-compute[74898]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)
Nov 17 03:11:37 user nova-compute[74898]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)
Nov 17 03:11:37 user nova-compute[74898]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:11:37 user nova-compute[74898]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:11:37 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[08928350-79f0-4c0a-99b1-172847fb7bbc]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgCfIaPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG nova.network.neutron [req-9eeff4e7-8ed1-4ba8-ae6b-5ec2c6dcbf3b req-7ffa4a5c-1242-4081-be25-12a9b0acf770 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Updated VIF entry in instance network info cache for port 1ab100dc-5533-4676-9814-2c9ce077e75e. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG nova.network.neutron [req-9eeff4e7-8ed1-4ba8-ae6b-5ec2c6dcbf3b req-7ffa4a5c-1242-4081-be25-12a9b0acf770 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Updating instance_info_cache with network_info: [{"id": "1ab100dc-5533-4676-9814-2c9ce077e75e", "address": "fa:16:3e:15:59:1e", "network": {"id": "52b2b9ce-ab0e-4516-b46f-04f1670a5859", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349717026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e17e2cb304d88832baac8d20b6ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab100dc-55", "ovs_interfaceid": "1ab100dc-5533-4676-9814-2c9ce077e75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9eeff4e7-8ed1-4ba8-ae6b-5ec2c6dcbf3b req-7ffa4a5c-1242-4081-be25-12a9b0acf770 service nova] Releasing lock "refresh_cache-e188cb77-4a1d-4cab-9b32-9e3d442bb64d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f25ef6a9-d007-419d-8478-2a9e79d5f03a {{(pid=74898) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 03:11:38 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:11:38 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23262363462313037', 'path': '/dev/sdf'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:11:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262363462313037', 'path': '/dev/sdf'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:11:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-17T03:07:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-438225612',display_name='tempest-TestShelveInstance-server-438225612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-438225612',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1240625614',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:07:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3c9e17e2cb304d88832baac8d20b6ae8',ramdisk_id='',reservation_id='r-6x3ptz5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-440551976',owner_user_name='tempest-TestShelveInstance-440551976-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:11:29Z,user_data=None,user_id='633094c28d414c1fac599af2a16bc1f6',uuid=e188cb77-4a1d-4cab-9b32-9e3d442bb64d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1ab100dc-5533-4676-9814-2c9ce077e75e", "address": "fa:16:3e:15:59:1e", "network": {"id": "52b2b9ce-ab0e-4516-b46f-04f1670a5859", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349717026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e17e2cb304d88832baac8d20b6ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab100dc-55", "ovs_interfaceid": "1ab100dc-5533-4676-9814-2c9ce077e75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:11:38 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Converting VIF {"id": "1ab100dc-5533-4676-9814-2c9ce077e75e", "address": "fa:16:3e:15:59:1e", "network": {"id": "52b2b9ce-ab0e-4516-b46f-04f1670a5859", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349717026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e17e2cb304d88832baac8d20b6ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab100dc-55", "ovs_interfaceid": "1ab100dc-5533-4676-9814-2c9ce077e75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:11:38 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:59:1e,bridge_name='br-int',has_traffic_filtering=True,id=1ab100dc-5533-4676-9814-2c9ce077e75e,network=Network(52b2b9ce-ab0e-4516-b46f-04f1670a5859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ab100dc-55') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:11:38 user nova-compute[74898]: DEBUG nova.objects.instance [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lazy-loading 'pci_devices' on Instance uuid e188cb77-4a1d-4cab-9b32-9e3d442bb64d {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:11:38 user nova-compute[74898]: DEBUG nova.objects.base [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Object Instance<e188cb77-4a1d-4cab-9b32-9e3d442bb64d> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:11:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:11:38 user nova-compute[74898]:   <uuid>e188cb77-4a1d-4cab-9b32-9e3d442bb64d</uuid>
Nov 17 03:11:38 user nova-compute[74898]:   <name>instance-00000016</name>
Nov 17 03:11:38 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:11:38 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:11:38 user nova-compute[74898]:   <metadata>
Nov 17 03:11:38 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:11:38 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:11:38 user nova-compute[74898]:       <nova:name>tempest-TestShelveInstance-server-438225612</nova:name>
Nov 17 03:11:38 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:11:36</nova:creationTime>
Nov 17 03:11:38 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:11:38 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:11:38 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:11:38 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:11:38 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:11:38 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:11:38 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:11:38 user nova-compute[74898]:       <nova:owner>
Nov 17 03:11:38 user nova-compute[74898]:         <nova:user uuid="633094c28d414c1fac599af2a16bc1f6">tempest-TestShelveInstance-440551976-project-member</nova:user>
Nov 17 03:11:38 user nova-compute[74898]:         <nova:project uuid="3c9e17e2cb304d88832baac8d20b6ae8">tempest-TestShelveInstance-440551976</nova:project>
Nov 17 03:11:38 user nova-compute[74898]:       </nova:owner>
Nov 17 03:11:38 user nova-compute[74898]:       <nova:ports>
Nov 17 03:11:38 user nova-compute[74898]:         <nova:port uuid="1ab100dc-5533-4676-9814-2c9ce077e75e">
Nov 17 03:11:38 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 17 03:11:38 user nova-compute[74898]:         </nova:port>
Nov 17 03:11:38 user nova-compute[74898]:       </nova:ports>
Nov 17 03:11:38 user nova-compute[74898]:     </nova:instance>
Nov 17 03:11:38 user nova-compute[74898]:   </metadata>
Nov 17 03:11:38 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:11:38 user nova-compute[74898]:     <system>
Nov 17 03:11:38 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:11:38 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:11:38 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:11:38 user nova-compute[74898]:       <entry name="serial">e188cb77-4a1d-4cab-9b32-9e3d442bb64d</entry>
Nov 17 03:11:38 user nova-compute[74898]:       <entry name="uuid">e188cb77-4a1d-4cab-9b32-9e3d442bb64d</entry>
Nov 17 03:11:38 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:11:38 user nova-compute[74898]:     </system>
Nov 17 03:11:38 user nova-compute[74898]:   </sysinfo>
Nov 17 03:11:38 user nova-compute[74898]:   <os>
Nov 17 03:11:38 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:11:38 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:11:38 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:11:38 user nova-compute[74898]:   </os>
Nov 17 03:11:38 user nova-compute[74898]:   <features>
Nov 17 03:11:38 user nova-compute[74898]:     <acpi/>
Nov 17 03:11:38 user nova-compute[74898]:     <apic/>
Nov 17 03:11:38 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:11:38 user nova-compute[74898]:   </features>
Nov 17 03:11:38 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:11:38 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:11:38 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:11:38 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:11:38 user nova-compute[74898]:   </clock>
Nov 17 03:11:38 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:11:38 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:11:38 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:11:38 user nova-compute[74898]:   </cpu>
Nov 17 03:11:38 user nova-compute[74898]:   <devices>
Nov 17 03:11:38 user nova-compute[74898]:     <disk type="block" device="disk">
Nov 17 03:11:38 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:11:38 user nova-compute[74898]:       <source dev="/dev/sdf"/>
Nov 17 03:11:38 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:11:38 user nova-compute[74898]:       <serial>317e439b-e336-4f22-9638-809454e990f7</serial>
Nov 17 03:11:38 user nova-compute[74898]:     </disk>
Nov 17 03:11:38 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:11:38 user nova-compute[74898]:       <mac address="fa:16:3e:15:59:1e"/>
Nov 17 03:11:38 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:11:38 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:11:38 user nova-compute[74898]:       <target dev="tap1ab100dc-55"/>
Nov 17 03:11:38 user nova-compute[74898]:     </interface>
Nov 17 03:11:38 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:11:38 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/e188cb77-4a1d-4cab-9b32-9e3d442bb64d/console.log" append="off"/>
Nov 17 03:11:38 user nova-compute[74898]:     </serial>
Nov 17 03:11:38 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:11:38 user nova-compute[74898]:     <video>
Nov 17 03:11:38 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:11:38 user nova-compute[74898]:     </video>
Nov 17 03:11:38 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:11:38 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:11:38 user nova-compute[74898]:     </rng>
Nov 17 03:11:38 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:11:38 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:11:38 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:11:38 user nova-compute[74898]:     </memballoon>
Nov 17 03:11:38 user nova-compute[74898]:   </devices>
Nov 17 03:11:38 user nova-compute[74898]: </domain>
Nov 17 03:11:38 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:11:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-17T03:07:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-438225612',display_name='tempest-TestShelveInstance-server-438225612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-438225612',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1240625614',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:07:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3c9e17e2cb304d88832baac8d20b6ae8',ramdisk_id='',reservation_id='r-6x3ptz5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-440551976',owner_user_name='tempest-TestShelveInstance-440551976-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:11:29Z,user_data=None,user_id='633094c28d414c1fac599af2a16bc1f6',uuid=e188cb77-4a1d-4cab-9b32-9e3d442bb64d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1ab100dc-5533-4676-9814-2c9ce077e75e", "address": "fa:16:3e:15:59:1e", "network": {"id": "52b2b9ce-ab0e-4516-b46f-04f1670a5859", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349717026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e17e2cb304d88832baac8d20b6ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab100dc-55", "ovs_interfaceid": "1ab100dc-5533-4676-9814-2c9ce077e75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:11:38 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Converting VIF {"id": "1ab100dc-5533-4676-9814-2c9ce077e75e", "address": "fa:16:3e:15:59:1e", "network": {"id": "52b2b9ce-ab0e-4516-b46f-04f1670a5859", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349717026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e17e2cb304d88832baac8d20b6ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab100dc-55", "ovs_interfaceid": "1ab100dc-5533-4676-9814-2c9ce077e75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:11:38 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:59:1e,bridge_name='br-int',has_traffic_filtering=True,id=1ab100dc-5533-4676-9814-2c9ce077e75e,network=Network(52b2b9ce-ab0e-4516-b46f-04f1670a5859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ab100dc-55') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:11:38 user nova-compute[74898]: DEBUG os_vif [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:59:1e,bridge_name='br-int',has_traffic_filtering=True,id=1ab100dc-5533-4676-9814-2c9ce077e75e,network=Network(52b2b9ce-ab0e-4516-b46f-04f1670a5859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ab100dc-55') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:11:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:11:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:11:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4dc64343-1e3f-5781-bbc0-d1cfaf4ec410', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:11:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:11:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ab100dc-55, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:11:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1ab100dc-55, col_values=(('qos', UUID('de56d615-5eeb-4896-ab89-dee1524e2ced')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:11:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1ab100dc-55, col_values=(('external_ids', {'iface-id': '1ab100dc-5533-4676-9814-2c9ce077e75e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:59:1e', 'vm-uuid': 'e188cb77-4a1d-4cab-9b32-9e3d442bb64d'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:11:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:11:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:38 user nova-compute[74898]: INFO os_vif [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:59:1e,bridge_name='br-int',has_traffic_filtering=True,id=1ab100dc-5533-4676-9814-2c9ce077e75e,network=Network(52b2b9ce-ab0e-4516-b46f-04f1670a5859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ab100dc-55')
Nov 17 03:11:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:11:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] No VIF found with MAC fa:16:3e:15:59:1e, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:11:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-057f689b-eb1a-46a1-a7c7-4d4c60a45e76 req-e20ceb68-ebbb-4ba0-8250-622007ffa9f0 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Received event network-vif-plugged-1ab100dc-5533-4676-9814-2c9ce077e75e {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:11:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-057f689b-eb1a-46a1-a7c7-4d4c60a45e76 req-e20ceb68-ebbb-4ba0-8250-622007ffa9f0 service nova] Acquiring lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:11:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-057f689b-eb1a-46a1-a7c7-4d4c60a45e76 req-e20ceb68-ebbb-4ba0-8250-622007ffa9f0 service nova] Lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:11:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-057f689b-eb1a-46a1-a7c7-4d4c60a45e76 req-e20ceb68-ebbb-4ba0-8250-622007ffa9f0 service nova] Lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:11:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-057f689b-eb1a-46a1-a7c7-4d4c60a45e76 req-e20ceb68-ebbb-4ba0-8250-622007ffa9f0 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] No waiting events found dispatching network-vif-plugged-1ab100dc-5533-4676-9814-2c9ce077e75e {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:11:39 user nova-compute[74898]: WARNING nova.compute.manager [req-057f689b-eb1a-46a1-a7c7-4d4c60a45e76 req-e20ceb68-ebbb-4ba0-8250-622007ffa9f0 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Received unexpected event network-vif-plugged-1ab100dc-5533-4676-9814-2c9ce077e75e for instance with vm_state shelved_offloaded and task_state spawning.
Nov 17 03:11:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:41 user nova-compute[74898]: DEBUG nova.compute.manager [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:11:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:11:41 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Instance spawned successfully.
Nov 17 03:11:41 user nova-compute[74898]: DEBUG nova.compute.manager [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:11:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8460d121-9be8-48dd-82e4-d45c97eb93c2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.887s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:11:42 user nova-compute[74898]: DEBUG nova.compute.manager [req-3de3e0aa-ec23-4d46-a9c6-627fc4d2be65 req-528a7c2a-5282-4b1b-8c0f-4cbdda20a329 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Received event network-vif-plugged-1ab100dc-5533-4676-9814-2c9ce077e75e {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:11:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3de3e0aa-ec23-4d46-a9c6-627fc4d2be65 req-528a7c2a-5282-4b1b-8c0f-4cbdda20a329 service nova] Acquiring lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:11:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3de3e0aa-ec23-4d46-a9c6-627fc4d2be65 req-528a7c2a-5282-4b1b-8c0f-4cbdda20a329 service nova] Lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:11:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3de3e0aa-ec23-4d46-a9c6-627fc4d2be65 req-528a7c2a-5282-4b1b-8c0f-4cbdda20a329 service nova] Lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:11:42 user nova-compute[74898]: DEBUG nova.compute.manager [req-3de3e0aa-ec23-4d46-a9c6-627fc4d2be65 req-528a7c2a-5282-4b1b-8c0f-4cbdda20a329 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] No waiting events found dispatching network-vif-plugged-1ab100dc-5533-4676-9814-2c9ce077e75e {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:11:42 user nova-compute[74898]: WARNING nova.compute.manager [req-3de3e0aa-ec23-4d46-a9c6-627fc4d2be65 req-528a7c2a-5282-4b1b-8c0f-4cbdda20a329 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Received unexpected event network-vif-plugged-1ab100dc-5533-4676-9814-2c9ce077e75e for instance with vm_state active and task_state None.
Nov 17 03:11:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:45 user nova-compute[74898]: DEBUG nova.objects.instance [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'flavor' on Instance uuid c49f4ec3-6f9b-4e14-ba29-208aa026301e {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:11:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "refresh_cache-c49f4ec3-6f9b-4e14-ba29-208aa026301e" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:11:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquired lock "refresh_cache-c49f4ec3-6f9b-4e14-ba29-208aa026301e" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:11:45 user nova-compute[74898]: DEBUG nova.network.neutron [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:11:45 user nova-compute[74898]: DEBUG nova.objects.instance [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'info_cache' on Instance uuid c49f4ec3-6f9b-4e14-ba29-208aa026301e {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:11:45 user nova-compute[74898]: DEBUG nova.objects.base [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Object Instance<c49f4ec3-6f9b-4e14-ba29-208aa026301e> lazy-loaded attributes: flavor,info_cache {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:11:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG nova.network.neutron [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Updating instance_info_cache with network_info: [{"id": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "address": "fa:16:3e:7d:3c:56", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89cfa577-9a", "ovs_interfaceid": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Releasing lock "refresh_cache-c49f4ec3-6f9b-4e14-ba29-208aa026301e" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:11:46 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Instance destroyed successfully.
Nov 17 03:11:46 user nova-compute[74898]: DEBUG nova.objects.instance [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'resources' on Instance uuid c49f4ec3-6f9b-4e14-ba29-208aa026301e {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG nova.objects.base [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Object Instance<c49f4ec3-6f9b-4e14-ba29-208aa026301e> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-559848382',display_name='tempest-AttachVolumeTestJSON-server-559848382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-559848382',id=23,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbyIJI2eENCayym7wJaTE5mkfjBea5My/OAyGGxTUZlk7cC9WDtXyYqwoAMcoNPQD8MTCjcX10bj1aNkxQk64CCPBoHWZhGjVWIxFCC/x0O8IS9lweYLOVUWDQLxxg2Nw==',key_name='tempest-keypair-1028377093',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:07:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='08b13b86a294437da9a38ca4fd9b98e1',ramdisk_id='',reservation_id='r-ctvf81kq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1097544794',owner_user_name='tempest-AttachVolumeTestJSON-1097544794-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:09:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f67341bd3d3a47698364dcfc7a7c8a9a',uuid=c49f4ec3-6f9b-4e14-ba29-208aa026301e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "address": "fa:16:3e:7d:3c:56", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89cfa577-9a", "ovs_interfaceid": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Converting VIF {"id": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "address": "fa:16:3e:7d:3c:56", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89cfa577-9a", "ovs_interfaceid": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:3c:56,bridge_name='br-int',has_traffic_filtering=True,id=89cfa577-9add-4c3b-81be-59ddb7e34d59,network=Network(b4bcd1f2-7a46-421a-8979-8ba9aca50ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89cfa577-9a') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG os_vif [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:3c:56,bridge_name='br-int',has_traffic_filtering=True,id=89cfa577-9add-4c3b-81be-59ddb7e34d59,network=Network(b4bcd1f2-7a46-421a-8979-8ba9aca50ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89cfa577-9a') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89cfa577-9a, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e9f8273-b160-4db1-8137-5bf327cd4529) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:46 user nova-compute[74898]: INFO os_vif [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:3c:56,bridge_name='br-int',has_traffic_filtering=True,id=89cfa577-9add-4c3b-81be-59ddb7e34d59,network=Network(b4bcd1f2-7a46-421a-8979-8ba9aca50ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89cfa577-9a')
Nov 17 03:11:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSFYaLqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:11:46 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:11:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53f1d16-8f23-4216-979f-e4805090a82f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:11:46 user nova-compute[74898]: No targets found.
Nov 17 03:11:46 user nova-compute[74898]: iSNS:
Nov 17 03:11:46 user nova-compute[74898]: No targets found.
Nov 17 03:11:46 user nova-compute[74898]: STATIC:
Nov 17 03:11:46 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7
Nov 17 03:11:46 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:11:46 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:11:46 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1
Nov 17 03:11:46 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:11:46 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:11:46 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4
Nov 17 03:11:46 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:11:46 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:11:46 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2
Nov 17 03:11:46 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:11:46 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:11:46 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19
Nov 17 03:11:46 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:11:46 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:11:46 user nova-compute[74898]: FIRMWARE:
Nov 17 03:11:46 user nova-compute[74898]: No targets found.
Nov 17 03:11:46 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:11:46 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:11:46 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a770b6-4bce-43e1-817b-cde9e4a24ec3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[209aa223-6c14-4c8d-92bd-62964610ee6e]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:11:46 user nova-compute[74898]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)
Nov 17 03:11:46 user nova-compute[74898]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)
Nov 17 03:11:46 user nova-compute[74898]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:11:46 user nova-compute[74898]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:11:46 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:11:46 user nova-compute[74898]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)
Nov 17 03:11:46 user nova-compute[74898]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)
Nov 17 03:11:46 user nova-compute[74898]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:11:46 user nova-compute[74898]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:11:46 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9c201f5f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19'): ({'sdb'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Removing single pathed devices sdb {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb5b8d7-583b-4c26-af4a-4effd21cb95e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c3b9d2-2a75-414f-9b0b-f2a553191fe4]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Flushing IO for device /dev/sdb {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac04ebd0-27f7-4a4c-aafc-e721d091fa78]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b0e294-8dba-4161-904d-227771764899]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccb8ac1-32c5-4ca0-984e-fea248fbd4e1]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b81483-6fa3-4a56-8ce4-12f76bdffbea]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19, portal: 172.16.0.220,3260]
Nov 17 03:11:46 user nova-compute[74898]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19, portal: 172.16.0.220,3260] successful.
Nov 17 03:11:46 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1a7486-196c-441f-bccc-a0853f01ee19]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] <== disconnect_volume: return (331ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Start _get_guest_xml network_info=[{"id": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "address": "fa:16:3e:7d:3c:56", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89cfa577-9a", "ovs_interfaceid": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSFYaLqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'c49f4ec3-6f9b-4e14-ba29-208aa026301e', 'attached_at': '', 'detached_at': '', 'volume_id': '77b8d623-ac48-40a4-8abe-85631824fc19', 'serial': '77b8d623-ac48-40a4-8abe-85631824fc19'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '77794db8-6b61-464b-86b2-7f1bb3b5e53d', 'volume_type': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG nova.objects.instance [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'numa_topology' on Instance uuid c49f4ec3-6f9b-4e14-ba29-208aa026301e {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG nova.objects.base [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Object Instance<c49f4ec3-6f9b-4e14-ba29-208aa026301e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:11:46 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:11:46 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:11:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG nova.objects.instance [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'vcpu_model' on Instance uuid c49f4ec3-6f9b-4e14-ba29-208aa026301e {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG nova.objects.base [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Object Instance<c49f4ec3-6f9b-4e14-ba29-208aa026301e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSFYaLqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:11:46 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:11:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:11:46 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:11:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:11:46 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ce19a8-cefd-4aa1-a570-1f75e6c230f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:11:46 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2843b98c-c118-449b-aa02-145be6e51762]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19] added
Nov 17 03:11:46 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9d0e3f-9e43-441e-bfa1-b5363fe4227e]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:11:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d811dc5-2505-4cf8-a2cb-31dec548648c]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PSFYaLqT {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PSFYaLqT" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6564280a-88ec-4277-a8d0-61180bf1a849]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PSFYaLqT'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacb1ab0-51cd-48a0-aec1-bc071bfa54c5]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7b0e39-443a-4c07-a100-185e7e9acdef]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:11:47 user nova-compute[74898]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)
Nov 17 03:11:47 user nova-compute[74898]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:11:47 user nova-compute[74898]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:11:47 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:11:47 user nova-compute[74898]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)
Nov 17 03:11:47 user nova-compute[74898]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:11:47 user nova-compute[74898]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:11:47 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a23240-3a3e-4742-a8ce-749b27efc01f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19, portal: 172.16.0.220,3260]
Nov 17 03:11:47 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19, portal: 172.16.0.220,3260] successful.
Nov 17 03:11:47 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c22b2c6-fc90-49b2-b188-59d3988e33b2]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0aa506-3067-4cc4-b327-3a1c2f1f434d]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:11:47 user nova-compute[74898]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)
Nov 17 03:11:47 user nova-compute[74898]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:11:47 user nova-compute[74898]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:11:47 user nova-compute[74898]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)
Nov 17 03:11:47 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:11:47 user nova-compute[74898]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)
Nov 17 03:11:47 user nova-compute[74898]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:11:47 user nova-compute[74898]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:11:47 user nova-compute[74898]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)
Nov 17 03:11:47 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9fb6d4-8087-4be4-b7c7-1e67ae00bf27]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSFYaLqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:11:47 user nova-compute[74898]: INFO nova.compute.manager [None req-9c9147b0-7cbd-4a7f-a961-29d354db15c0 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Unrescuing
Nov 17 03:11:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-9c9147b0-7cbd-4a7f-a961-29d354db15c0 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "refresh_cache-a92bce56-1038-4762-9c1e-19b5a7ff8cef" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-9c9147b0-7cbd-4a7f-a961-29d354db15c0 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquired lock "refresh_cache-a92bce56-1038-4762-9c1e-19b5a7ff8cef" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:11:47 user nova-compute[74898]: DEBUG nova.network.neutron [None req-9c9147b0-7cbd-4a7f-a961-29d354db15c0 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:11:48 user nova-compute[74898]: DEBUG nova.network.neutron [None req-9c9147b0-7cbd-4a7f-a961-29d354db15c0 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Updating instance_info_cache with network_info: [{"id": "423e9165-99d6-4938-a3dc-3406806ce781", "address": "fa:16:3e:4a:ec:b4", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423e9165-99", "ovs_interfaceid": "423e9165-99d6-4938-a3dc-3406806ce781", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:11:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-9c9147b0-7cbd-4a7f-a961-29d354db15c0 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Releasing lock "refresh_cache-a92bce56-1038-4762-9c1e-19b5a7ff8cef" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:11:48 user nova-compute[74898]: DEBUG nova.objects.instance [None req-9c9147b0-7cbd-4a7f-a961-29d354db15c0 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lazy-loading 'flavor' on Instance uuid a92bce56-1038-4762-9c1e-19b5a7ff8cef {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:11:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:11:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23964666566666661', 'path': '/dev/sdb'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:11:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964666566666661', 'path': '/dev/sdb'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:11:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-559848382',display_name='tempest-AttachVolumeTestJSON-server-559848382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-559848382',id=23,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbyIJI2eENCayym7wJaTE5mkfjBea5My/OAyGGxTUZlk7cC9WDtXyYqwoAMcoNPQD8MTCjcX10bj1aNkxQk64CCPBoHWZhGjVWIxFCC/x0O8IS9lweYLOVUWDQLxxg2Nw==',key_name='tempest-keypair-1028377093',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:07:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='08b13b86a294437da9a38ca4fd9b98e1',ramdisk_id='',reservation_id='r-ctvf81kq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1097544794',owner_user_name='tempest-AttachVolumeTestJSON-1097544794-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:09:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f67341bd3d3a47698364dcfc7a7c8a9a',uuid=c49f4ec3-6f9b-4e14-ba29-208aa026301e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "address": "fa:16:3e:7d:3c:56", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89cfa577-9a", "ovs_interfaceid": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:11:48 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Converting VIF {"id": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "address": "fa:16:3e:7d:3c:56", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89cfa577-9a", "ovs_interfaceid": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:11:48 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:3c:56,bridge_name='br-int',has_traffic_filtering=True,id=89cfa577-9add-4c3b-81be-59ddb7e34d59,network=Network(b4bcd1f2-7a46-421a-8979-8ba9aca50ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89cfa577-9a') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:11:48 user nova-compute[74898]: DEBUG nova.objects.instance [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'pci_devices' on Instance uuid c49f4ec3-6f9b-4e14-ba29-208aa026301e {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:11:48 user nova-compute[74898]: DEBUG nova.objects.base [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Object Instance<c49f4ec3-6f9b-4e14-ba29-208aa026301e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:11:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:11:48 user nova-compute[74898]:   <uuid>c49f4ec3-6f9b-4e14-ba29-208aa026301e</uuid>
Nov 17 03:11:48 user nova-compute[74898]:   <name>instance-00000017</name>
Nov 17 03:11:48 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:11:48 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:11:48 user nova-compute[74898]:   <metadata>
Nov 17 03:11:48 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:11:48 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:11:48 user nova-compute[74898]:       <nova:name>tempest-AttachVolumeTestJSON-server-559848382</nova:name>
Nov 17 03:11:48 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:11:46</nova:creationTime>
Nov 17 03:11:48 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:11:48 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:11:48 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:11:48 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:11:48 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:11:48 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:11:48 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:11:48 user nova-compute[74898]:       <nova:owner>
Nov 17 03:11:48 user nova-compute[74898]:         <nova:user uuid="f67341bd3d3a47698364dcfc7a7c8a9a">tempest-AttachVolumeTestJSON-1097544794-project-member</nova:user>
Nov 17 03:11:48 user nova-compute[74898]:         <nova:project uuid="08b13b86a294437da9a38ca4fd9b98e1">tempest-AttachVolumeTestJSON-1097544794</nova:project>
Nov 17 03:11:48 user nova-compute[74898]:       </nova:owner>
Nov 17 03:11:48 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:11:48 user nova-compute[74898]:       <nova:ports>
Nov 17 03:11:48 user nova-compute[74898]:         <nova:port uuid="89cfa577-9add-4c3b-81be-59ddb7e34d59">
Nov 17 03:11:48 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 17 03:11:48 user nova-compute[74898]:         </nova:port>
Nov 17 03:11:48 user nova-compute[74898]:       </nova:ports>
Nov 17 03:11:48 user nova-compute[74898]:     </nova:instance>
Nov 17 03:11:48 user nova-compute[74898]:   </metadata>
Nov 17 03:11:48 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:11:48 user nova-compute[74898]:     <system>
Nov 17 03:11:48 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:11:48 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:11:48 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:11:48 user nova-compute[74898]:       <entry name="serial">c49f4ec3-6f9b-4e14-ba29-208aa026301e</entry>
Nov 17 03:11:48 user nova-compute[74898]:       <entry name="uuid">c49f4ec3-6f9b-4e14-ba29-208aa026301e</entry>
Nov 17 03:11:48 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:11:48 user nova-compute[74898]:     </system>
Nov 17 03:11:48 user nova-compute[74898]:   </sysinfo>
Nov 17 03:11:48 user nova-compute[74898]:   <os>
Nov 17 03:11:48 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:11:48 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:11:48 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:11:48 user nova-compute[74898]:   </os>
Nov 17 03:11:48 user nova-compute[74898]:   <features>
Nov 17 03:11:48 user nova-compute[74898]:     <acpi/>
Nov 17 03:11:48 user nova-compute[74898]:     <apic/>
Nov 17 03:11:48 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:11:48 user nova-compute[74898]:   </features>
Nov 17 03:11:48 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:11:48 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:11:48 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:11:48 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:11:48 user nova-compute[74898]:   </clock>
Nov 17 03:11:48 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:11:48 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:11:48 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:11:48 user nova-compute[74898]:   </cpu>
Nov 17 03:11:48 user nova-compute[74898]:   <devices>
Nov 17 03:11:48 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:11:48 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:11:48 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk"/>
Nov 17 03:11:48 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:11:48 user nova-compute[74898]:     </disk>
Nov 17 03:11:48 user nova-compute[74898]:     <disk type="block" device="disk">
Nov 17 03:11:48 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:11:48 user nova-compute[74898]:       <source dev="/dev/sdb"/>
Nov 17 03:11:48 user nova-compute[74898]:       <target dev="vdb" bus="virtio"/>
Nov 17 03:11:48 user nova-compute[74898]:       <serial>77b8d623-ac48-40a4-8abe-85631824fc19</serial>
Nov 17 03:11:48 user nova-compute[74898]:     </disk>
Nov 17 03:11:48 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:11:48 user nova-compute[74898]:       <mac address="fa:16:3e:7d:3c:56"/>
Nov 17 03:11:48 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:11:48 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:11:48 user nova-compute[74898]:       <target dev="tap89cfa577-9a"/>
Nov 17 03:11:48 user nova-compute[74898]:     </interface>
Nov 17 03:11:48 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:11:48 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/console.log" append="off"/>
Nov 17 03:11:48 user nova-compute[74898]:     </serial>
Nov 17 03:11:48 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:11:48 user nova-compute[74898]:     <video>
Nov 17 03:11:48 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:11:48 user nova-compute[74898]:     </video>
Nov 17 03:11:48 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:11:48 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:11:48 user nova-compute[74898]:     </rng>
Nov 17 03:11:48 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:11:48 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:11:48 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:11:48 user nova-compute[74898]:     </memballoon>
Nov 17 03:11:48 user nova-compute[74898]:   </devices>
Nov 17 03:11:48 user nova-compute[74898]: </domain>
Nov 17 03:11:48 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:11:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:48 user nova-compute[74898]: DEBUG nova.compute.manager [req-86f32b74-dc05-430c-ab30-f281afc345df req-fa0864c8-df75-4782-9ef4-8bcae6323249 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Received event network-vif-unplugged-423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:11:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-86f32b74-dc05-430c-ab30-f281afc345df req-fa0864c8-df75-4782-9ef4-8bcae6323249 service nova] Acquiring lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:11:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-86f32b74-dc05-430c-ab30-f281afc345df req-fa0864c8-df75-4782-9ef4-8bcae6323249 service nova] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:11:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-86f32b74-dc05-430c-ab30-f281afc345df req-fa0864c8-df75-4782-9ef4-8bcae6323249 service nova] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:11:48 user nova-compute[74898]: DEBUG nova.compute.manager [req-86f32b74-dc05-430c-ab30-f281afc345df req-fa0864c8-df75-4782-9ef4-8bcae6323249 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] No waiting events found dispatching network-vif-unplugged-423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:11:48 user nova-compute[74898]: WARNING nova.compute.manager [req-86f32b74-dc05-430c-ab30-f281afc345df req-fa0864c8-df75-4782-9ef4-8bcae6323249 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Received unexpected event network-vif-unplugged-423e9165-99d6-4938-a3dc-3406806ce781 for instance with vm_state rescued and task_state unrescuing.
Nov 17 03:11:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:48 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Instance destroyed successfully.
Nov 17 03:11:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:11:48 user nova-compute[74898]: DEBUG nova.objects.instance [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'trusted_certs' on Instance uuid c49f4ec3-6f9b-4e14-ba29-208aa026301e {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:11:48 user nova-compute[74898]: DEBUG nova.objects.base [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Object Instance<c49f4ec3-6f9b-4e14-ba29-208aa026301e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:11:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.176s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:49 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:11:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:49 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Cannot resize image /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:11:49 user nova-compute[74898]: DEBUG nova.objects.instance [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'migration_context' on Instance uuid c49f4ec3-6f9b-4e14-ba29-208aa026301e {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:11:49 user nova-compute[74898]: DEBUG nova.objects.base [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Object Instance<c49f4ec3-6f9b-4e14-ba29-208aa026301e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:11:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-559848382',display_name='tempest-AttachVolumeTestJSON-server-559848382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-559848382',id=23,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbyIJI2eENCayym7wJaTE5mkfjBea5My/OAyGGxTUZlk7cC9WDtXyYqwoAMcoNPQD8MTCjcX10bj1aNkxQk64CCPBoHWZhGjVWIxFCC/x0O8IS9lweYLOVUWDQLxxg2Nw==',key_name='tempest-keypair-1028377093',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:07:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='08b13b86a294437da9a38ca4fd9b98e1',ramdisk_id='',reservation_id='r-ctvf81kq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1097544794',owner_user_name='tempest-AttachVolumeTestJSON-1097544794-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:09:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f67341bd3d3a47698364dcfc7a7c8a9a',uuid=c49f4ec3-6f9b-4e14-ba29-208aa026301e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "address": "fa:16:3e:7d:3c:56", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89cfa577-9a", "ovs_interfaceid": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:11:49 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Converting VIF {"id": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "address": "fa:16:3e:7d:3c:56", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89cfa577-9a", "ovs_interfaceid": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:11:49 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:3c:56,bridge_name='br-int',has_traffic_filtering=True,id=89cfa577-9add-4c3b-81be-59ddb7e34d59,network=Network(b4bcd1f2-7a46-421a-8979-8ba9aca50ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89cfa577-9a') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:11:49 user nova-compute[74898]: DEBUG os_vif [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:3c:56,bridge_name='br-int',has_traffic_filtering=True,id=89cfa577-9add-4c3b-81be-59ddb7e34d59,network=Network(b4bcd1f2-7a46-421a-8979-8ba9aca50ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89cfa577-9a') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:11:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:11:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:11:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5092eaa1-7329-5a46-b318-86d1f893c038', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:11:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:11:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89cfa577-9a, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:11:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89cfa577-9a, col_values=(('qos', UUID('cb31e014-1bc0-4ecc-934a-e9fd76b24765')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:11:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89cfa577-9a, col_values=(('external_ids', {'iface-id': '89cfa577-9add-4c3b-81be-59ddb7e34d59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:3c:56', 'vm-uuid': 'c49f4ec3-6f9b-4e14-ba29-208aa026301e'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:11:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:11:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:49 user nova-compute[74898]: INFO os_vif [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:3c:56,bridge_name='br-int',has_traffic_filtering=True,id=89cfa577-9add-4c3b-81be-59ddb7e34d59,network=Network(b4bcd1f2-7a46-421a-8979-8ba9aca50ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89cfa577-9a')
Nov 17 03:11:50 user nova-compute[74898]: DEBUG nova.compute.manager [req-8826aab5-2fee-4162-ad8d-c7743ec660bc req-fd0c2590-2acd-48bb-bc60-3a7b10946302 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Received event network-vif-plugged-423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:11:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8826aab5-2fee-4162-ad8d-c7743ec660bc req-fd0c2590-2acd-48bb-bc60-3a7b10946302 service nova] Acquiring lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:11:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8826aab5-2fee-4162-ad8d-c7743ec660bc req-fd0c2590-2acd-48bb-bc60-3a7b10946302 service nova] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:11:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8826aab5-2fee-4162-ad8d-c7743ec660bc req-fd0c2590-2acd-48bb-bc60-3a7b10946302 service nova] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:11:50 user nova-compute[74898]: DEBUG nova.compute.manager [req-8826aab5-2fee-4162-ad8d-c7743ec660bc req-fd0c2590-2acd-48bb-bc60-3a7b10946302 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] No waiting events found dispatching network-vif-plugged-423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:11:50 user nova-compute[74898]: WARNING nova.compute.manager [req-8826aab5-2fee-4162-ad8d-c7743ec660bc req-fd0c2590-2acd-48bb-bc60-3a7b10946302 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Received unexpected event network-vif-plugged-423e9165-99d6-4938-a3dc-3406806ce781 for instance with vm_state rescued and task_state unrescuing.
Nov 17 03:11:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:51 user nova-compute[74898]: DEBUG nova.compute.manager [req-f48442ae-60d3-4376-b5d5-51d2e71fcdbb req-1c71a9f3-7fc7-4b2f-8b7f-24364f233ccf service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Received event network-vif-plugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:11:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f48442ae-60d3-4376-b5d5-51d2e71fcdbb req-1c71a9f3-7fc7-4b2f-8b7f-24364f233ccf service nova] Acquiring lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:11:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f48442ae-60d3-4376-b5d5-51d2e71fcdbb req-1c71a9f3-7fc7-4b2f-8b7f-24364f233ccf service nova] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:11:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f48442ae-60d3-4376-b5d5-51d2e71fcdbb req-1c71a9f3-7fc7-4b2f-8b7f-24364f233ccf service nova] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:11:51 user nova-compute[74898]: DEBUG nova.compute.manager [req-f48442ae-60d3-4376-b5d5-51d2e71fcdbb req-1c71a9f3-7fc7-4b2f-8b7f-24364f233ccf service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] No waiting events found dispatching network-vif-plugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:11:51 user nova-compute[74898]: WARNING nova.compute.manager [req-f48442ae-60d3-4376-b5d5-51d2e71fcdbb req-1c71a9f3-7fc7-4b2f-8b7f-24364f233ccf service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Received unexpected event network-vif-plugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 for instance with vm_state stopped and task_state powering-on.
Nov 17 03:11:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:52 user nova-compute[74898]: DEBUG nova.compute.manager [req-56844937-96e7-4d04-af74-b7e0149998c7 req-0f1fa3ee-35de-4a26-888d-fb7d6daef7ad service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Received event network-vif-plugged-423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:11:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-56844937-96e7-4d04-af74-b7e0149998c7 req-0f1fa3ee-35de-4a26-888d-fb7d6daef7ad service nova] Acquiring lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:11:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-56844937-96e7-4d04-af74-b7e0149998c7 req-0f1fa3ee-35de-4a26-888d-fb7d6daef7ad service nova] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:11:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-56844937-96e7-4d04-af74-b7e0149998c7 req-0f1fa3ee-35de-4a26-888d-fb7d6daef7ad service nova] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:11:52 user nova-compute[74898]: DEBUG nova.compute.manager [req-56844937-96e7-4d04-af74-b7e0149998c7 req-0f1fa3ee-35de-4a26-888d-fb7d6daef7ad service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] No waiting events found dispatching network-vif-plugged-423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:11:52 user nova-compute[74898]: WARNING nova.compute.manager [req-56844937-96e7-4d04-af74-b7e0149998c7 req-0f1fa3ee-35de-4a26-888d-fb7d6daef7ad service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Received unexpected event network-vif-plugged-423e9165-99d6-4938-a3dc-3406806ce781 for instance with vm_state rescued and task_state unrescuing.
Nov 17 03:11:52 user nova-compute[74898]: DEBUG nova.compute.manager [req-56844937-96e7-4d04-af74-b7e0149998c7 req-0f1fa3ee-35de-4a26-888d-fb7d6daef7ad service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Received event network-vif-plugged-423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:11:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-56844937-96e7-4d04-af74-b7e0149998c7 req-0f1fa3ee-35de-4a26-888d-fb7d6daef7ad service nova] Acquiring lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:11:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-56844937-96e7-4d04-af74-b7e0149998c7 req-0f1fa3ee-35de-4a26-888d-fb7d6daef7ad service nova] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:11:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-56844937-96e7-4d04-af74-b7e0149998c7 req-0f1fa3ee-35de-4a26-888d-fb7d6daef7ad service nova] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:11:52 user nova-compute[74898]: DEBUG nova.compute.manager [req-56844937-96e7-4d04-af74-b7e0149998c7 req-0f1fa3ee-35de-4a26-888d-fb7d6daef7ad service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] No waiting events found dispatching network-vif-plugged-423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:11:52 user nova-compute[74898]: WARNING nova.compute.manager [req-56844937-96e7-4d04-af74-b7e0149998c7 req-0f1fa3ee-35de-4a26-888d-fb7d6daef7ad service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Received unexpected event network-vif-plugged-423e9165-99d6-4938-a3dc-3406806ce781 for instance with vm_state rescued and task_state unrescuing.
Nov 17 03:11:53 user nova-compute[74898]: DEBUG nova.compute.manager [req-fa11e217-1f65-4469-b2f2-6d8826f04394 req-b3b1f5fb-2a82-43a2-8853-fa27a01c1b70 service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Received event network-vif-plugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:11:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fa11e217-1f65-4469-b2f2-6d8826f04394 req-b3b1f5fb-2a82-43a2-8853-fa27a01c1b70 service nova] Acquiring lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:11:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fa11e217-1f65-4469-b2f2-6d8826f04394 req-b3b1f5fb-2a82-43a2-8853-fa27a01c1b70 service nova] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:11:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fa11e217-1f65-4469-b2f2-6d8826f04394 req-b3b1f5fb-2a82-43a2-8853-fa27a01c1b70 service nova] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:11:53 user nova-compute[74898]: DEBUG nova.compute.manager [req-fa11e217-1f65-4469-b2f2-6d8826f04394 req-b3b1f5fb-2a82-43a2-8853-fa27a01c1b70 service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] No waiting events found dispatching network-vif-plugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:11:53 user nova-compute[74898]: WARNING nova.compute.manager [req-fa11e217-1f65-4469-b2f2-6d8826f04394 req-b3b1f5fb-2a82-43a2-8853-fa27a01c1b70 service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Received unexpected event network-vif-plugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 for instance with vm_state stopped and task_state powering-on.
Nov 17 03:11:54 user nova-compute[74898]: DEBUG nova.compute.manager [None req-9c9147b0-7cbd-4a7f-a961-29d354db15c0 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:11:54 user nova-compute[74898]: DEBUG nova.compute.manager [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:11:54 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Instance rebooted successfully.
Nov 17 03:11:54 user nova-compute[74898]: DEBUG nova.compute.manager [None req-919a0a4b-e058-4bc7-97ec-09ff18fcb340 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:11:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:11:57 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f25ef6a9-d007-419d-8478-2a9e79d5f03a is timed out.
Nov 17 03:11:57 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Successfully detached device vdb from instance f25ef6a9-d007-419d-8478-2a9e79d5f03a from the live domain config.
Nov 17 03:11:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjxCVeFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:11:57 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:11:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[909f361a-8902-4550-a74c-b9783ef04206]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:11:57 user nova-compute[74898]: No targets found.
Nov 17 03:11:57 user nova-compute[74898]: iSNS:
Nov 17 03:11:57 user nova-compute[74898]: No targets found.
Nov 17 03:11:57 user nova-compute[74898]: STATIC:
Nov 17 03:11:57 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7
Nov 17 03:11:57 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:11:57 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:11:57 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1
Nov 17 03:11:57 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:11:57 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:11:57 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4
Nov 17 03:11:57 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:11:57 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:11:57 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2
Nov 17 03:11:57 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:11:57 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:11:57 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19
Nov 17 03:11:57 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:11:57 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:11:57 user nova-compute[74898]: FIRMWARE:
Nov 17 03:11:57 user nova-compute[74898]: No targets found.
Nov 17 03:11:57 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:11:57 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:11:57 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7291a3f7-a359-4a60-829d-21d22c9d8008]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[eece5ebb-f349-4077-8f1a-cc9cdb9a8439]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:11:57 user nova-compute[74898]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)
Nov 17 03:11:57 user nova-compute[74898]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:11:57 user nova-compute[74898]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:11:57 user nova-compute[74898]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)
Nov 17 03:11:57 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 (non-flash)
Nov 17 03:11:57 user nova-compute[74898]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)
Nov 17 03:11:57 user nova-compute[74898]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:11:57 user nova-compute[74898]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:11:57 user nova-compute[74898]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)
Nov 17 03:11:57 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9c18366950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2'): ({'sdd'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Removing single pathed devices sdd {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8010a362-6865-4adb-9b1f-263587d25f5a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.036s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedab37e-1037-45f5-97d3-ea3a91d04cd1]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Flushing IO for device /dev/sdd {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[43851ed3-c1f7-408f-8c3f-bcd00ab29a2d]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ed3792-bd09-47b7-8d42-bc10ccc3135e]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] SCSI volumes sdd have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8d920b-48aa-4c8c-8727-bff3483c761f]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:11:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28b8d40-5981-48e4-b678-260f5d144df8]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2, portal: 172.16.0.220,3260]
Nov 17 03:11:58 user nova-compute[74898]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2, portal: 172.16.0.220,3260] successful.
Nov 17 03:11:58 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:11:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:11:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c48f4c9e-2c05-41b5-b2f8-236a81a837c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:11:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[97accc70-d7c9-4803-851f-1dc832e77eea]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:11:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:11:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:11:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] <== disconnect_volume: return (373ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:11:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:11:58 user nova-compute[74898]: DEBUG nova.objects.instance [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lazy-loading 'flavor' on Instance uuid f25ef6a9-d007-419d-8478-2a9e79d5f03a {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:11:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0daf6244-2632-423d-8db9-8917ec9d446f tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.896s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:11:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e6315e84-7086-4d4a-b3bc-7c7d0ef00404 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "f457f5c7-58e3-4f7f-b495-6cfd3440d7dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:12:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e6315e84-7086-4d4a-b3bc-7c7d0ef00404 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "f457f5c7-58e3-4f7f-b495-6cfd3440d7dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:12:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e6315e84-7086-4d4a-b3bc-7c7d0ef00404 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "f457f5c7-58e3-4f7f-b495-6cfd3440d7dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:12:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e6315e84-7086-4d4a-b3bc-7c7d0ef00404 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "f457f5c7-58e3-4f7f-b495-6cfd3440d7dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:12:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e6315e84-7086-4d4a-b3bc-7c7d0ef00404 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "f457f5c7-58e3-4f7f-b495-6cfd3440d7dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:12:02 user nova-compute[74898]: INFO nova.compute.manager [None req-e6315e84-7086-4d4a-b3bc-7c7d0ef00404 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Terminating instance
Nov 17 03:12:02 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e6315e84-7086-4d4a-b3bc-7c7d0ef00404 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:12:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:03 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Instance destroyed successfully.
Nov 17 03:12:03 user nova-compute[74898]: DEBUG nova.objects.instance [None req-e6315e84-7086-4d4a-b3bc-7c7d0ef00404 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lazy-loading 'resources' on Instance uuid f457f5c7-58e3-4f7f-b495-6cfd3440d7dd {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:12:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-e6315e84-7086-4d4a-b3bc-7c7d0ef00404 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-811665424',display_name='tempest-TestMinimumBasicScenario-server-811665424',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-811665424',id=20,image_ref='ffdd166f-d8b8-46ac-bd56-f641ea3131cb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7moiPS/URWGjOpnoXa2/0/YNsKrwdAmA6Q5SQ4CqXTVSx+V/BMH/oVgEDkkA45FSqK7ToQ41yeGODe/WVJdnOv77H+6nORZzKciRW20riqL3y2vVaPhSldTkMof/EiKQ==',key_name='tempest-TestMinimumBasicScenario-234024958',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:06:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3251ef4d69740409c9beec4f368bf72',ramdisk_id='',reservation_id='r-oqszxo22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ffdd166f-d8b8-46ac-bd56-f641ea3131cb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1625508354',owner_user_name='tempest-TestMinimumBasicScenario-1625508354-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:06:55Z,user_data=None,user_id='8507fa418393437cbba167b470aa7dc1',uuid=f457f5c7-58e3-4f7f-b495-6cfd3440d7dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc696f62-bbd0-40f8-8c83-2622f22ff494", "address": "fa:16:3e:a0:44:e9", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc696f62-bb", "ovs_interfaceid": "bc696f62-bbd0-40f8-8c83-2622f22ff494", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:12:03 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-e6315e84-7086-4d4a-b3bc-7c7d0ef00404 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Converting VIF {"id": "bc696f62-bbd0-40f8-8c83-2622f22ff494", "address": "fa:16:3e:a0:44:e9", "network": {"id": "7b139a66-9d14-40e3-b129-0febdd13b264", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-190505050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3251ef4d69740409c9beec4f368bf72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc696f62-bb", "ovs_interfaceid": "bc696f62-bbd0-40f8-8c83-2622f22ff494", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:12:03 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-e6315e84-7086-4d4a-b3bc-7c7d0ef00404 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:44:e9,bridge_name='br-int',has_traffic_filtering=True,id=bc696f62-bbd0-40f8-8c83-2622f22ff494,network=Network(7b139a66-9d14-40e3-b129-0febdd13b264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc696f62-bb') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:12:03 user nova-compute[74898]: DEBUG os_vif [None req-e6315e84-7086-4d4a-b3bc-7c7d0ef00404 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:44:e9,bridge_name='br-int',has_traffic_filtering=True,id=bc696f62-bbd0-40f8-8c83-2622f22ff494,network=Network(7b139a66-9d14-40e3-b129-0febdd13b264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc696f62-bb') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:12:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc696f62-bb, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:12:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1333c6ee-0f29-4732-8958-17aa36eae6c4) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:12:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:12:03 user nova-compute[74898]: INFO os_vif [None req-e6315e84-7086-4d4a-b3bc-7c7d0ef00404 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:44:e9,bridge_name='br-int',has_traffic_filtering=True,id=bc696f62-bbd0-40f8-8c83-2622f22ff494,network=Network(7b139a66-9d14-40e3-b129-0febdd13b264),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc696f62-bb')
Nov 17 03:12:03 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-e6315e84-7086-4d4a-b3bc-7c7d0ef00404 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Deleting instance files /opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd_del
Nov 17 03:12:03 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-e6315e84-7086-4d4a-b3bc-7c7d0ef00404 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Deletion of /opt/stack/data/nova/instances/f457f5c7-58e3-4f7f-b495-6cfd3440d7dd_del complete
Nov 17 03:12:03 user nova-compute[74898]: INFO nova.compute.manager [None req-e6315e84-7086-4d4a-b3bc-7c7d0ef00404 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 17 03:12:03 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-e6315e84-7086-4d4a-b3bc-7c7d0ef00404 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:12:03 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:12:03 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:12:03 user nova-compute[74898]: DEBUG nova.compute.manager [req-beaa256f-c96a-434d-a93b-fc97173b309a req-6501a78f-9813-426f-99ba-59bc01e9fdfa service nova] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Received event network-vif-unplugged-bc696f62-bbd0-40f8-8c83-2622f22ff494 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:12:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-beaa256f-c96a-434d-a93b-fc97173b309a req-6501a78f-9813-426f-99ba-59bc01e9fdfa service nova] Acquiring lock "f457f5c7-58e3-4f7f-b495-6cfd3440d7dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:12:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-beaa256f-c96a-434d-a93b-fc97173b309a req-6501a78f-9813-426f-99ba-59bc01e9fdfa service nova] Lock "f457f5c7-58e3-4f7f-b495-6cfd3440d7dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:12:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-beaa256f-c96a-434d-a93b-fc97173b309a req-6501a78f-9813-426f-99ba-59bc01e9fdfa service nova] Lock "f457f5c7-58e3-4f7f-b495-6cfd3440d7dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:12:03 user nova-compute[74898]: DEBUG nova.compute.manager [req-beaa256f-c96a-434d-a93b-fc97173b309a req-6501a78f-9813-426f-99ba-59bc01e9fdfa service nova] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] No waiting events found dispatching network-vif-unplugged-bc696f62-bbd0-40f8-8c83-2622f22ff494 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:12:03 user nova-compute[74898]: DEBUG nova.compute.manager [req-beaa256f-c96a-434d-a93b-fc97173b309a req-6501a78f-9813-426f-99ba-59bc01e9fdfa service nova] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Received event network-vif-unplugged-bc696f62-bbd0-40f8-8c83-2622f22ff494 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:12:03 user nova-compute[74898]: INFO nova.compute.manager [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Rescuing
Nov 17 03:12:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "refresh_cache-24cd7ac4-3724-4189-82a7-ba61ba46097a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:12:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquired lock "refresh_cache-24cd7ac4-3724-4189-82a7-ba61ba46097a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:12:03 user nova-compute[74898]: DEBUG nova.network.neutron [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:12:04 user nova-compute[74898]: DEBUG nova.network.neutron [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Updating instance_info_cache with network_info: [{"id": "b7880813-a5fe-4eb7-b6aa-f91832114171", "address": "fa:16:3e:da:6b:da", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7880813-a5", "ovs_interfaceid": "b7880813-a5fe-4eb7-b6aa-f91832114171", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:12:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Releasing lock "refresh_cache-24cd7ac4-3724-4189-82a7-ba61ba46097a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:12:04 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:12:04 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Took 1.02 seconds to deallocate network for instance.
Nov 17 03:12:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e6315e84-7086-4d4a-b3bc-7c7d0ef00404 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:12:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e6315e84-7086-4d4a-b3bc-7c7d0ef00404 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:12:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:04 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e6315e84-7086-4d4a-b3bc-7c7d0ef00404 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:12:04 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e6315e84-7086-4d4a-b3bc-7c7d0ef00404 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:12:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e6315e84-7086-4d4a-b3bc-7c7d0ef00404 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.484s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:12:04 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-e6315e84-7086-4d4a-b3bc-7c7d0ef00404 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Deleted allocations for instance f457f5c7-58e3-4f7f-b495-6cfd3440d7dd
Nov 17 03:12:04 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Instance destroyed successfully.
Nov 17 03:12:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e6315e84-7086-4d4a-b3bc-7c7d0ef00404 tempest-TestMinimumBasicScenario-1625508354 tempest-TestMinimumBasicScenario-1625508354-project-member] Lock "f457f5c7-58e3-4f7f-b495-6cfd3440d7dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.421s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:12:04 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Attempting a stable device rescue
Nov 17 03:12:04 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74898) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 17 03:12:05 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Instance directory exists: not creating {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 17 03:12:05 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Creating image(s)
Nov 17 03:12:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "/opt/stack/data/nova/instances/24cd7ac4-3724-4189-82a7-ba61ba46097a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:12:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "/opt/stack/data/nova/instances/24cd7ac4-3724-4189-82a7-ba61ba46097a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:12:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "/opt/stack/data/nova/instances/24cd7ac4-3724-4189-82a7-ba61ba46097a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:12:05 user nova-compute[74898]: DEBUG nova.objects.instance [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lazy-loading 'trusted_certs' on Instance uuid 24cd7ac4-3724-4189-82a7-ba61ba46097a {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:12:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "81d2df432862b964f2d6ccbefb2e669d37512525" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:12:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "81d2df432862b964f2d6ccbefb2e669d37512525" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:12:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/81d2df432862b964f2d6ccbefb2e669d37512525.part --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:06 user nova-compute[74898]: DEBUG nova.compute.manager [req-c0f6f213-b6e5-4ff7-b89f-08f714691793 req-7afae6f9-7718-4a6d-bc85-71739314ba88 service nova] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Received event network-vif-plugged-bc696f62-bbd0-40f8-8c83-2622f22ff494 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:12:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c0f6f213-b6e5-4ff7-b89f-08f714691793 req-7afae6f9-7718-4a6d-bc85-71739314ba88 service nova] Acquiring lock "f457f5c7-58e3-4f7f-b495-6cfd3440d7dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:12:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c0f6f213-b6e5-4ff7-b89f-08f714691793 req-7afae6f9-7718-4a6d-bc85-71739314ba88 service nova] Lock "f457f5c7-58e3-4f7f-b495-6cfd3440d7dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:12:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c0f6f213-b6e5-4ff7-b89f-08f714691793 req-7afae6f9-7718-4a6d-bc85-71739314ba88 service nova] Lock "f457f5c7-58e3-4f7f-b495-6cfd3440d7dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:12:06 user nova-compute[74898]: DEBUG nova.compute.manager [req-c0f6f213-b6e5-4ff7-b89f-08f714691793 req-7afae6f9-7718-4a6d-bc85-71739314ba88 service nova] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] No waiting events found dispatching network-vif-plugged-bc696f62-bbd0-40f8-8c83-2622f22ff494 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:12:06 user nova-compute[74898]: WARNING nova.compute.manager [req-c0f6f213-b6e5-4ff7-b89f-08f714691793 req-7afae6f9-7718-4a6d-bc85-71739314ba88 service nova] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Received unexpected event network-vif-plugged-bc696f62-bbd0-40f8-8c83-2622f22ff494 for instance with vm_state deleted and task_state None.
Nov 17 03:12:06 user nova-compute[74898]: DEBUG nova.compute.manager [req-c0f6f213-b6e5-4ff7-b89f-08f714691793 req-7afae6f9-7718-4a6d-bc85-71739314ba88 service nova] [instance: f457f5c7-58e3-4f7f-b495-6cfd3440d7dd] Received event network-vif-deleted-bc696f62-bbd0-40f8-8c83-2622f22ff494 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:12:06 user nova-compute[74898]: DEBUG nova.compute.manager [req-c0f6f213-b6e5-4ff7-b89f-08f714691793 req-7afae6f9-7718-4a6d-bc85-71739314ba88 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Received event network-vif-unplugged-b7880813-a5fe-4eb7-b6aa-f91832114171 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:12:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c0f6f213-b6e5-4ff7-b89f-08f714691793 req-7afae6f9-7718-4a6d-bc85-71739314ba88 service nova] Acquiring lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:12:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c0f6f213-b6e5-4ff7-b89f-08f714691793 req-7afae6f9-7718-4a6d-bc85-71739314ba88 service nova] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:12:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c0f6f213-b6e5-4ff7-b89f-08f714691793 req-7afae6f9-7718-4a6d-bc85-71739314ba88 service nova] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:12:06 user nova-compute[74898]: DEBUG nova.compute.manager [req-c0f6f213-b6e5-4ff7-b89f-08f714691793 req-7afae6f9-7718-4a6d-bc85-71739314ba88 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] No waiting events found dispatching network-vif-unplugged-b7880813-a5fe-4eb7-b6aa-f91832114171 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:12:06 user nova-compute[74898]: WARNING nova.compute.manager [req-c0f6f213-b6e5-4ff7-b89f-08f714691793 req-7afae6f9-7718-4a6d-bc85-71739314ba88 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Received unexpected event network-vif-unplugged-b7880813-a5fe-4eb7-b6aa-f91832114171 for instance with vm_state active and task_state rescuing.
Nov 17 03:12:06 user nova-compute[74898]: DEBUG nova.compute.manager [req-c0f6f213-b6e5-4ff7-b89f-08f714691793 req-7afae6f9-7718-4a6d-bc85-71739314ba88 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Received event network-vif-plugged-b7880813-a5fe-4eb7-b6aa-f91832114171 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:12:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c0f6f213-b6e5-4ff7-b89f-08f714691793 req-7afae6f9-7718-4a6d-bc85-71739314ba88 service nova] Acquiring lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:12:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c0f6f213-b6e5-4ff7-b89f-08f714691793 req-7afae6f9-7718-4a6d-bc85-71739314ba88 service nova] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:12:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c0f6f213-b6e5-4ff7-b89f-08f714691793 req-7afae6f9-7718-4a6d-bc85-71739314ba88 service nova] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:12:06 user nova-compute[74898]: DEBUG nova.compute.manager [req-c0f6f213-b6e5-4ff7-b89f-08f714691793 req-7afae6f9-7718-4a6d-bc85-71739314ba88 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] No waiting events found dispatching network-vif-plugged-b7880813-a5fe-4eb7-b6aa-f91832114171 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:12:06 user nova-compute[74898]: WARNING nova.compute.manager [req-c0f6f213-b6e5-4ff7-b89f-08f714691793 req-7afae6f9-7718-4a6d-bc85-71739314ba88 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Received unexpected event network-vif-plugged-b7880813-a5fe-4eb7-b6aa-f91832114171 for instance with vm_state active and task_state rescuing.
Nov 17 03:12:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/81d2df432862b964f2d6ccbefb2e669d37512525.part --force-share --output=json" returned: 0 in 0.193s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:06 user nova-compute[74898]: DEBUG nova.virt.images [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] 73933d8b-ff79-4def-ba7f-8f0e5f2df87b was qcow2, converting to raw {{(pid=74898) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 17 03:12:06 user nova-compute[74898]: DEBUG nova.privsep.utils [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74898) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 03:12:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/81d2df432862b964f2d6ccbefb2e669d37512525.part /opt/stack/data/nova/instances/_base/81d2df432862b964f2d6ccbefb2e669d37512525.converted {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/81d2df432862b964f2d6ccbefb2e669d37512525.part /opt/stack/data/nova/instances/_base/81d2df432862b964f2d6ccbefb2e669d37512525.converted" returned: 0 in 0.259s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/81d2df432862b964f2d6ccbefb2e669d37512525.converted --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/81d2df432862b964f2d6ccbefb2e669d37512525.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "81d2df432862b964f2d6ccbefb2e669d37512525" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.908s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:12:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "81d2df432862b964f2d6ccbefb2e669d37512525" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:12:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "81d2df432862b964f2d6ccbefb2e669d37512525" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:12:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/81d2df432862b964f2d6ccbefb2e669d37512525 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/81d2df432862b964f2d6ccbefb2e669d37512525 --force-share --output=json" returned: 0 in 0.175s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/81d2df432862b964f2d6ccbefb2e669d37512525,backing_fmt=raw /opt/stack/data/nova/instances/24cd7ac4-3724-4189-82a7-ba61ba46097a/disk.rescue {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/81d2df432862b964f2d6ccbefb2e669d37512525,backing_fmt=raw /opt/stack/data/nova/instances/24cd7ac4-3724-4189-82a7-ba61ba46097a/disk.rescue" returned: 0 in 0.050s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "81d2df432862b964f2d6ccbefb2e669d37512525" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.objects.instance [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lazy-loading 'migration_context' on Instance uuid 24cd7ac4-3724-4189-82a7-ba61ba46097a {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.objects.base [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Object Instance<24cd7ac4-3724-4189-82a7-ba61ba46097a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Start _get_guest_xml network_info=[{"id": "b7880813-a5fe-4eb7-b6aa-f91832114171", "address": "fa:16:3e:da:6b:da", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "vif_mac": "fa:16:3e:da:6b:da"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7880813-a5", "ovs_interfaceid": "b7880813-a5fe-4eb7-b6aa-f91832114171", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '73933d8b-ff79-4def-ba7f-8f0e5f2df87b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBNRsapG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '24cd7ac4-3724-4189-82a7-ba61ba46097a', 'attached_at': '', 'detached_at': '', 'volume_id': '9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4', 'serial': '9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '02ee7966-7a29-434c-9f66-743b5ab18d61', 'volume_type': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.objects.instance [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lazy-loading 'resources' on Instance uuid 24cd7ac4-3724-4189-82a7-ba61ba46097a {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.objects.base [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Object Instance<24cd7ac4-3724-4189-82a7-ba61ba46097a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.objects.instance [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lazy-loading 'numa_topology' on Instance uuid 24cd7ac4-3724-4189-82a7-ba61ba46097a {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.objects.base [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Object Instance<24cd7ac4-3724-4189-82a7-ba61ba46097a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:12:07 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:12:07 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.objects.instance [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lazy-loading 'vcpu_model' on Instance uuid 24cd7ac4-3724-4189-82a7-ba61ba46097a {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.objects.base [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Object Instance<24cd7ac4-3724-4189-82a7-ba61ba46097a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBNRsapG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:12:07 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:12:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:12:07 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:12:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:12:07 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:12:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac086f85-1cca-4ee1-a965-a19dc674d1b4]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = DBNRsapG\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 17 03:12:07 user nova-compute[74898]: node.name = iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4
Nov 17 03:12:07 user nova-compute[74898]: node.tpgt = -1
Nov 17 03:12:07 user nova-compute[74898]: node.startup = automatic
Nov 17 03:12:07 user nova-compute[74898]: node.leading_login = No
Nov 17 03:12:07 user nova-compute[74898]: iface.iscsi_ifacename = default
Nov 17 03:12:07 user nova-compute[74898]: iface.net_ifacename = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.ipaddress = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.prefix_len = 0
Nov 17 03:12:07 user nova-compute[74898]: iface.hwaddress = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.transport_name = tcp
Nov 17 03:12:07 user nova-compute[74898]: iface.initiatorname = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.state = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.vlan_id = 0
Nov 17 03:12:07 user nova-compute[74898]: iface.vlan_priority = 0
Nov 17 03:12:07 user nova-compute[74898]: iface.vlan_state = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.iface_num = 0
Nov 17 03:12:07 user nova-compute[74898]: iface.mtu = 0
Nov 17 03:12:07 user nova-compute[74898]: iface.port = 0
Nov 17 03:12:07 user nova-compute[74898]: iface.bootproto = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.subnet_mask = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.gateway = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.dhcp_alt_client_id_state = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.dhcp_alt_client_id = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.dhcp_dns = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.dhcp_learn_iqn = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.dhcp_req_vendor_id_state = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.dhcp_vendor_id_state = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.dhcp_vendor_id = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.dhcp_slp_da = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.fragmentation = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.gratuitous_arp = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.incoming_forwarding = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.tos_state = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.tos = 0
Nov 17 03:12:07 user nova-compute[74898]: iface.ttl = 0
Nov 17 03:12:07 user nova-compute[74898]: iface.delayed_ack = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.tcp_nagle = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.tcp_wsf_state = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.tcp_wsf = 0
Nov 17 03:12:07 user nova-compute[74898]: iface.tcp_timer_scale = 0
Nov 17 03:12:07 user nova-compute[74898]: iface.tcp_timestamp = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.redirect = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.def_task_mgmt_timeout = 0
Nov 17 03:12:07 user nova-compute[74898]: iface.header_digest = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.data_digest = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.immediate_data = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.initial_r2t = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.data_seq_inorder = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.data_pdu_inorder = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.erl = 0
Nov 17 03:12:07 user nova-compute[74898]: iface.max_receive_data_len = 0
Nov 17 03:12:07 user nova-compute[74898]: iface.first_burst_len = 0
Nov 17 03:12:07 user nova-compute[74898]: iface.max_outstanding_r2t = 0
Nov 17 03:12:07 user nova-compute[74898]: iface.max_burst_len = 0
Nov 17 03:12:07 user nova-compute[74898]: iface.chap_auth = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.bidi_chap = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.strict_login_compliance = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.discovery_auth = <empty>
Nov 17 03:12:07 user nova-compute[74898]: iface.discovery_logout = <empty>
Nov 17 03:12:07 user nova-compute[74898]: node.discovery_address = <empty>
Nov 17 03:12:07 user nova-compute[74898]: node.discovery_port = 0
Nov 17 03:12:07 user nova-compute[74898]: node.discovery_type = static
Nov 17 03:12:07 user nova-compute[74898]: node.session.initial_cmdsn = 0
Nov 17 03:12:07 user nova-compute[74898]: node.session.initial_login_retry_max = 8
Nov 17 03:12:07 user nova-compute[74898]: node.session.xmit_thread_priority = -20
Nov 17 03:12:07 user nova-compute[74898]: node.session.cmds_max = 128
Nov 17 03:12:07 user nova-compute[74898]: node.session.queue_depth = 32
Nov 17 03:12:07 user nova-compute[74898]: node.session.nr_sessions = 1
Nov 17 03:12:07 user nova-compute[74898]: node.session.auth.authmethod = CHAP
Nov 17 03:12:07 user nova-compute[74898]: node.session.auth.username = DBNRsapG
Nov 17 03:12:07 user nova-compute[74898]: node.session.auth.password = ***
Nov 17 03:12:07 user nova-compute[74898]: node.session.auth.username_in = <empty>
Nov 17 03:12:07 user nova-compute[74898]: node.session.auth.password_in = <empty>
Nov 17 03:12:07 user nova-compute[74898]: node.session.auth.chap_algs = MD5
Nov 17 03:12:07 user nova-compute[74898]: node.session.timeo.replacement_timeout = 120
Nov 17 03:12:07 user nova-compute[74898]: node.session.err_timeo.abort_timeout = 15
Nov 17 03:12:07 user nova-compute[74898]: node.session.err_timeo.lu_reset_timeout = 30
Nov 17 03:12:07 user nova-compute[74898]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 17 03:12:07 user nova-compute[74898]: node.session.err_timeo.host_reset_timeout = 60
Nov 17 03:12:07 user nova-compute[74898]: node.session.iscsi.FastAbort = Yes
Nov 17 03:12:07 user nova-compute[74898]: node.session.iscsi.InitialR2T = No
Nov 17 03:12:07 user nova-compute[74898]: node.session.iscsi.ImmediateData = Yes
Nov 17 03:12:07 user nova-compute[74898]: node.session.iscsi.FirstBurstLength = 262144
Nov 17 03:12:07 user nova-compute[74898]: node.session.iscsi.MaxBurstLength = 16776192
Nov 17 03:12:07 user nova-compute[74898]: node.session.iscsi.DefaultTime2Retain = 0
Nov 17 03:12:07 user nova-compute[74898]: node.session.iscsi.DefaultTime2Wait = 2
Nov 17 03:12:07 user nova-compute[74898]: node.session.iscsi.MaxConnections = 1
Nov 17 03:12:07 user nova-compute[74898]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 17 03:12:07 user nova-compute[74898]: node.session.iscsi.ERL = 0
Nov 17 03:12:07 user nova-compute[74898]: node.session.scan = manual
Nov 17 03:12:07 user nova-compute[74898]: node.session.reopen_max = 0
Nov 17 03:12:07 user nova-compute[74898]: node.conn[0].address = 172.16.0.220
Nov 17 03:12:07 user nova-compute[74898]: node.conn[0].port = 3260
Nov 17 03:12:07 user nova-compute[74898]: node.conn[0].startup = manual
Nov 17 03:12:07 user nova-compute[74898]: node.conn[0].tcp.window_size = 524288
Nov 17 03:12:07 user nova-compute[74898]: node.conn[0].tcp.type_of_service = 0
Nov 17 03:12:07 user nova-compute[74898]: node.conn[0].timeo.logout_timeout = 15
Nov 17 03:12:07 user nova-compute[74898]: node.conn[0].timeo.login_timeout = 15
Nov 17 03:12:07 user nova-compute[74898]: node.conn[0].timeo.auth_timeout = 45
Nov 17 03:12:07 user nova-compute[74898]: node.conn[0].timeo.noop_out_interval = 5
Nov 17 03:12:07 user nova-compute[74898]: node.conn[0].timeo.noop_out_timeout = 5
Nov 17 03:12:07 user nova-compute[74898]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 17 03:12:07 user nova-compute[74898]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 17 03:12:07 user nova-compute[74898]: node.conn[0].iscsi.HeaderDigest = None
Nov 17 03:12:07 user nova-compute[74898]: node.conn[0].iscsi.DataDigest = None
Nov 17 03:12:07 user nova-compute[74898]: node.conn[0].iscsi.IFMarker = No
Nov 17 03:12:07 user nova-compute[74898]: node.conn[0].iscsi.OFMarker = No
Nov 17 03:12:07 user nova-compute[74898]: # END RECORD
Nov 17 03:12:07 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e036ee99-f056-4e15-8e30-624d153d0363]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c025bf56-3814-47cc-8d79-c4d10752800b]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DBNRsapG {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DBNRsapG" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3606373d-5903-4887-9ef2-93e046e8649b]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DBNRsapG'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d454bb-1b65-42c5-a55d-bb6f6d28757d]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[22725709-e023-48a7-aafe-5c5e04f80032]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)
Nov 17 03:12:07 user nova-compute[74898]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:12:07 user nova-compute[74898]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:12:07 user nova-compute[74898]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)
Nov 17 03:12:07 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)
Nov 17 03:12:07 user nova-compute[74898]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:12:07 user nova-compute[74898]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:12:07 user nova-compute[74898]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)
Nov 17 03:12:07 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.146s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] HCTL ('34', '0', '0', 0) found on session 34 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[544c2856-9a36-4b9a-b441-d59455c2cbf0]: (4, ('0 0 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Searching for a device in session 34 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBNRsapG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.172s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] <== connect_volume: return (173ms) {'type': 'block', 'scsi_wwn': '26639363834643539', 'path': '/dev/sdc'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639363834643539', 'path': '/dev/sdc'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-845758421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-845758421',id=26,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:10:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0cd941de23248d8ac93b03f930f565f',ramdisk_id='',reservation_id='r-nwjpn9ta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-507656828',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:10:31Z,user_data=None,user_id='05397a6b586843338aafbc8a17c6e42c',uuid=24cd7ac4-3724-4189-82a7-ba61ba46097a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7880813-a5fe-4eb7-b6aa-f91832114171", "address": "fa:16:3e:da:6b:da", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "vif_mac": "fa:16:3e:da:6b:da"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7880813-a5", "ovs_interfaceid": "b7880813-a5fe-4eb7-b6aa-f91832114171", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Converting VIF {"id": "b7880813-a5fe-4eb7-b6aa-f91832114171", "address": "fa:16:3e:da:6b:da", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "vif_mac": "fa:16:3e:da:6b:da"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7880813-a5", "ovs_interfaceid": "b7880813-a5fe-4eb7-b6aa-f91832114171", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:6b:da,bridge_name='br-int',has_traffic_filtering=True,id=b7880813-a5fe-4eb7-b6aa-f91832114171,network=Network(9302cb9a-12f9-4845-b6cc-905f4bf24b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7880813-a5') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.objects.instance [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lazy-loading 'pci_devices' on Instance uuid 24cd7ac4-3724-4189-82a7-ba61ba46097a {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.objects.base [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Object Instance<24cd7ac4-3724-4189-82a7-ba61ba46097a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:12:07 user nova-compute[74898]:   <uuid>24cd7ac4-3724-4189-82a7-ba61ba46097a</uuid>
Nov 17 03:12:07 user nova-compute[74898]:   <name>instance-0000001a</name>
Nov 17 03:12:07 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:12:07 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:12:07 user nova-compute[74898]:   <metadata>
Nov 17 03:12:07 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:12:07 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:12:07 user nova-compute[74898]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-845758421</nova:name>
Nov 17 03:12:07 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:12:07</nova:creationTime>
Nov 17 03:12:07 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:12:07 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:12:07 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:12:07 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:12:07 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:12:07 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:12:07 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:12:07 user nova-compute[74898]:       <nova:owner>
Nov 17 03:12:07 user nova-compute[74898]:         <nova:user uuid="05397a6b586843338aafbc8a17c6e42c">tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member</nova:user>
Nov 17 03:12:07 user nova-compute[74898]:         <nova:project uuid="b0cd941de23248d8ac93b03f930f565f">tempest-ServerBootFromVolumeStableRescueTest-507656828</nova:project>
Nov 17 03:12:07 user nova-compute[74898]:       </nova:owner>
Nov 17 03:12:07 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:12:07 user nova-compute[74898]:       <nova:ports>
Nov 17 03:12:07 user nova-compute[74898]:         <nova:port uuid="b7880813-a5fe-4eb7-b6aa-f91832114171">
Nov 17 03:12:07 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 17 03:12:07 user nova-compute[74898]:         </nova:port>
Nov 17 03:12:07 user nova-compute[74898]:       </nova:ports>
Nov 17 03:12:07 user nova-compute[74898]:     </nova:instance>
Nov 17 03:12:07 user nova-compute[74898]:   </metadata>
Nov 17 03:12:07 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:12:07 user nova-compute[74898]:     <system>
Nov 17 03:12:07 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:12:07 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:12:07 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:12:07 user nova-compute[74898]:       <entry name="serial">24cd7ac4-3724-4189-82a7-ba61ba46097a</entry>
Nov 17 03:12:07 user nova-compute[74898]:       <entry name="uuid">24cd7ac4-3724-4189-82a7-ba61ba46097a</entry>
Nov 17 03:12:07 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:12:07 user nova-compute[74898]:     </system>
Nov 17 03:12:07 user nova-compute[74898]:   </sysinfo>
Nov 17 03:12:07 user nova-compute[74898]:   <os>
Nov 17 03:12:07 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:12:07 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:12:07 user nova-compute[74898]:   </os>
Nov 17 03:12:07 user nova-compute[74898]:   <features>
Nov 17 03:12:07 user nova-compute[74898]:     <acpi/>
Nov 17 03:12:07 user nova-compute[74898]:     <apic/>
Nov 17 03:12:07 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:12:07 user nova-compute[74898]:   </features>
Nov 17 03:12:07 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:12:07 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:12:07 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:12:07 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:12:07 user nova-compute[74898]:   </clock>
Nov 17 03:12:07 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:12:07 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:12:07 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:12:07 user nova-compute[74898]:   </cpu>
Nov 17 03:12:07 user nova-compute[74898]:   <devices>
Nov 17 03:12:07 user nova-compute[74898]:     <disk type="block" device="disk">
Nov 17 03:12:07 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:12:07 user nova-compute[74898]:       <source dev="/dev/sdc"/>
Nov 17 03:12:07 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:12:07 user nova-compute[74898]:       <serial>9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4</serial>
Nov 17 03:12:07 user nova-compute[74898]:     </disk>
Nov 17 03:12:07 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:12:07 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:12:07 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/24cd7ac4-3724-4189-82a7-ba61ba46097a/disk.rescue"/>
Nov 17 03:12:07 user nova-compute[74898]:       <target dev="vdb" bus="virtio"/>
Nov 17 03:12:07 user nova-compute[74898]:       <boot order="1"/>
Nov 17 03:12:07 user nova-compute[74898]:     </disk>
Nov 17 03:12:07 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:12:07 user nova-compute[74898]:       <mac address="fa:16:3e:da:6b:da"/>
Nov 17 03:12:07 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:12:07 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:12:07 user nova-compute[74898]:       <target dev="tapb7880813-a5"/>
Nov 17 03:12:07 user nova-compute[74898]:     </interface>
Nov 17 03:12:07 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:12:07 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/24cd7ac4-3724-4189-82a7-ba61ba46097a/console.log" append="off"/>
Nov 17 03:12:07 user nova-compute[74898]:     </serial>
Nov 17 03:12:07 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:12:07 user nova-compute[74898]:     <video>
Nov 17 03:12:07 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:12:07 user nova-compute[74898]:     </video>
Nov 17 03:12:07 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:12:07 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:12:07 user nova-compute[74898]:     </rng>
Nov 17 03:12:07 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:12:07 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:12:07 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:12:07 user nova-compute[74898]:     </memballoon>
Nov 17 03:12:07 user nova-compute[74898]:   </devices>
Nov 17 03:12:07 user nova-compute[74898]: </domain>
Nov 17 03:12:07 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:12:07 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Instance destroyed successfully.
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:12:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] No VIF found with MAC fa:16:3e:da:6b:da, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:12:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:09 user nova-compute[74898]: DEBUG nova.compute.manager [req-2ead9bb1-5b2d-4f36-a279-4b9e9912162a req-0e539da4-4a5d-467c-a08e-d8db5ce1d6c6 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Received event network-vif-plugged-b7880813-a5fe-4eb7-b6aa-f91832114171 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:12:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-2ead9bb1-5b2d-4f36-a279-4b9e9912162a req-0e539da4-4a5d-467c-a08e-d8db5ce1d6c6 service nova] Acquiring lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:12:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-2ead9bb1-5b2d-4f36-a279-4b9e9912162a req-0e539da4-4a5d-467c-a08e-d8db5ce1d6c6 service nova] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:12:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-2ead9bb1-5b2d-4f36-a279-4b9e9912162a req-0e539da4-4a5d-467c-a08e-d8db5ce1d6c6 service nova] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:12:09 user nova-compute[74898]: DEBUG nova.compute.manager [req-2ead9bb1-5b2d-4f36-a279-4b9e9912162a req-0e539da4-4a5d-467c-a08e-d8db5ce1d6c6 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] No waiting events found dispatching network-vif-plugged-b7880813-a5fe-4eb7-b6aa-f91832114171 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:12:09 user nova-compute[74898]: WARNING nova.compute.manager [req-2ead9bb1-5b2d-4f36-a279-4b9e9912162a req-0e539da4-4a5d-467c-a08e-d8db5ce1d6c6 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Received unexpected event network-vif-plugged-b7880813-a5fe-4eb7-b6aa-f91832114171 for instance with vm_state active and task_state rescuing.
Nov 17 03:12:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:11 user nova-compute[74898]: DEBUG nova.compute.manager [None req-b57cdc3d-444a-4042-87e9-e44b9309782b tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:12:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-526b4da7-a764-4766-93c0-0664d57c94dd req-94fd28e4-cf29-4850-863a-8d56b7b26930 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Received event network-vif-plugged-b7880813-a5fe-4eb7-b6aa-f91832114171 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:12:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-526b4da7-a764-4766-93c0-0664d57c94dd req-94fd28e4-cf29-4850-863a-8d56b7b26930 service nova] Acquiring lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:12:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-526b4da7-a764-4766-93c0-0664d57c94dd req-94fd28e4-cf29-4850-863a-8d56b7b26930 service nova] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:12:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-526b4da7-a764-4766-93c0-0664d57c94dd req-94fd28e4-cf29-4850-863a-8d56b7b26930 service nova] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:12:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-526b4da7-a764-4766-93c0-0664d57c94dd req-94fd28e4-cf29-4850-863a-8d56b7b26930 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] No waiting events found dispatching network-vif-plugged-b7880813-a5fe-4eb7-b6aa-f91832114171 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:12:11 user nova-compute[74898]: WARNING nova.compute.manager [req-526b4da7-a764-4766-93c0-0664d57c94dd req-94fd28e4-cf29-4850-863a-8d56b7b26930 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Received unexpected event network-vif-plugged-b7880813-a5fe-4eb7-b6aa-f91832114171 for instance with vm_state active and task_state rescuing.
Nov 17 03:12:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:19 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:12:20 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:12:20 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:12:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:21 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:12:22 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:12:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:23 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:12:24 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:12:24 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:12:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-13449e5c-809b-4db2-af0b-53f5865eb3a4" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:12:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-13449e5c-809b-4db2-af0b-53f5865eb3a4" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:12:24 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:12:25 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Updating instance_info_cache with network_info: [{"id": "2bdfdbe2-b457-4078-b4be-979a51ba442a", "address": "fa:16:3e:a1:96:f0", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdfdbe2-b4", "ovs_interfaceid": "2bdfdbe2-b457-4078-b4be-979a51ba442a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:12:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-13449e5c-809b-4db2-af0b-53f5865eb3a4" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:12:25 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:12:25 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:12:25 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:12:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:12:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:12:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:12:25 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:12:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:27 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:12:27 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:12:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-df1c10c6-cc07-456b-a310-a065d012ad46 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:12:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-df1c10c6-cc07-456b-a310-a065d012ad46 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:12:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-df1c10c6-cc07-456b-a310-a065d012ad46 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:12:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-df1c10c6-cc07-456b-a310-a065d012ad46 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:12:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-df1c10c6-cc07-456b-a310-a065d012ad46 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:12:27 user nova-compute[74898]: INFO nova.compute.manager [None req-df1c10c6-cc07-456b-a310-a065d012ad46 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Terminating instance
Nov 17 03:12:27 user nova-compute[74898]: DEBUG nova.compute.manager [None req-df1c10c6-cc07-456b-a310-a065d012ad46 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:12:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:27 user nova-compute[74898]: DEBUG nova.compute.manager [req-010fb756-990f-4fbd-b5ba-2c0dfb9dac4c req-523514f1-dfda-4ca3-bcc8-853474213d6a service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Received event network-vif-unplugged-f819d75d-a65d-4342-9912-944d2fb13dd3 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:12:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-010fb756-990f-4fbd-b5ba-2c0dfb9dac4c req-523514f1-dfda-4ca3-bcc8-853474213d6a service nova] Acquiring lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:12:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-010fb756-990f-4fbd-b5ba-2c0dfb9dac4c req-523514f1-dfda-4ca3-bcc8-853474213d6a service nova] Lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:12:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-010fb756-990f-4fbd-b5ba-2c0dfb9dac4c req-523514f1-dfda-4ca3-bcc8-853474213d6a service nova] Lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:12:27 user nova-compute[74898]: DEBUG nova.compute.manager [req-010fb756-990f-4fbd-b5ba-2c0dfb9dac4c req-523514f1-dfda-4ca3-bcc8-853474213d6a service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] No waiting events found dispatching network-vif-unplugged-f819d75d-a65d-4342-9912-944d2fb13dd3 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:12:27 user nova-compute[74898]: DEBUG nova.compute.manager [req-010fb756-990f-4fbd-b5ba-2c0dfb9dac4c req-523514f1-dfda-4ca3-bcc8-853474213d6a service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Received event network-vif-unplugged-f819d75d-a65d-4342-9912-944d2fb13dd3 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:12:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:28 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Instance destroyed successfully.
Nov 17 03:12:28 user nova-compute[74898]: DEBUG nova.objects.instance [None req-df1c10c6-cc07-456b-a310-a065d012ad46 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lazy-loading 'resources' on Instance uuid f25ef6a9-d007-419d-8478-2a9e79d5f03a {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:12:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:28 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-df1c10c6-cc07-456b-a310-a065d012ad46 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-17T03:06:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-300218009',display_name='tempest-ServerActionsTestOtherA-server-1915932620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-300218009',id=19,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHj48AyfPGEuTYyaaXRPfUux/t0c9DvnKU2/5+czxQ0LiT4+FXnkFmRFT1qWvFotFB4OLCF7MZEn857VDvvqJISIgLBUP+o+9WiZvKEG2wWiBy731G5vP6ol8yd3WhW9MQ==',key_name='tempest-keypair-278072850',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:09:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ff82629b7d7486a86574994974fabda',ramdisk_id='',reservation_id='r-orvyz1o1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-214359699',owner_user_name='tempest-ServerActionsTestOtherA-214359699-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:09:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28445b2b2360414bac2607ec94166369',uuid=f25ef6a9-d007-419d-8478-2a9e79d5f03a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f819d75d-a65d-4342-9912-944d2fb13dd3", "address": "fa:16:3e:89:06:c8", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf819d75d-a6", "ovs_interfaceid": "f819d75d-a65d-4342-9912-944d2fb13dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:12:28 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-df1c10c6-cc07-456b-a310-a065d012ad46 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Converting VIF {"id": "f819d75d-a65d-4342-9912-944d2fb13dd3", "address": "fa:16:3e:89:06:c8", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf819d75d-a6", "ovs_interfaceid": "f819d75d-a65d-4342-9912-944d2fb13dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:12:28 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-df1c10c6-cc07-456b-a310-a065d012ad46 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:06:c8,bridge_name='br-int',has_traffic_filtering=True,id=f819d75d-a65d-4342-9912-944d2fb13dd3,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf819d75d-a6') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:12:28 user nova-compute[74898]: DEBUG os_vif [None req-df1c10c6-cc07-456b-a310-a065d012ad46 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:06:c8,bridge_name='br-int',has_traffic_filtering=True,id=f819d75d-a65d-4342-9912-944d2fb13dd3,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf819d75d-a6') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:12:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf819d75d-a6, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:12:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:12:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb15fd11-4841-4e53-adaa-7a65145c4952) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:12:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:28 user nova-compute[74898]: INFO os_vif [None req-df1c10c6-cc07-456b-a310-a065d012ad46 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:06:c8,bridge_name='br-int',has_traffic_filtering=True,id=f819d75d-a65d-4342-9912-944d2fb13dd3,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf819d75d-a6')
Nov 17 03:12:28 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-df1c10c6-cc07-456b-a310-a065d012ad46 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Deleting instance files /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a_del
Nov 17 03:12:28 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-df1c10c6-cc07-456b-a310-a065d012ad46 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Deletion of /opt/stack/data/nova/instances/f25ef6a9-d007-419d-8478-2a9e79d5f03a_del complete
Nov 17 03:12:28 user nova-compute[74898]: INFO nova.compute.manager [None req-df1c10c6-cc07-456b-a310-a065d012ad46 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 17 03:12:28 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-df1c10c6-cc07-456b-a310-a065d012ad46 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:12:28 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:12:28 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:12:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:29 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:12:29 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Took 0.79 seconds to deallocate network for instance.
Nov 17 03:12:29 user nova-compute[74898]: DEBUG nova.compute.manager [req-47b3f386-521e-43ca-a993-ff7c728f0fb9 req-fe9844e6-164b-4cd4-947a-e51a5d6c114b service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Received event network-vif-deleted-f819d75d-a65d-4342-9912-944d2fb13dd3 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:12:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-df1c10c6-cc07-456b-a310-a065d012ad46 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:12:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-df1c10c6-cc07-456b-a310-a065d012ad46 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:12:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9411b570-6aaa-48bb-bf68-5765bf7d7a04/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9411b570-6aaa-48bb-bf68-5765bf7d7a04/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9411b570-6aaa-48bb-bf68-5765bf7d7a04/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:29 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-df1c10c6-cc07-456b-a310-a065d012ad46 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:12:29 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-df1c10c6-cc07-456b-a310-a065d012ad46 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:12:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-df1c10c6-cc07-456b-a310-a065d012ad46 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.458s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:12:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9411b570-6aaa-48bb-bf68-5765bf7d7a04/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:29 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-df1c10c6-cc07-456b-a310-a065d012ad46 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Deleted allocations for instance f25ef6a9-d007-419d-8478-2a9e79d5f03a
Nov 17 03:12:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:29 user nova-compute[74898]: DEBUG nova.compute.manager [req-9b07c32a-4543-48f1-b805-4d8b0104d1e2 req-f6e18d48-f8af-4241-adb4-0f79cd5f5754 service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Received event network-vif-plugged-f819d75d-a65d-4342-9912-944d2fb13dd3 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:12:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9b07c32a-4543-48f1-b805-4d8b0104d1e2 req-f6e18d48-f8af-4241-adb4-0f79cd5f5754 service nova] Acquiring lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:12:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9b07c32a-4543-48f1-b805-4d8b0104d1e2 req-f6e18d48-f8af-4241-adb4-0f79cd5f5754 service nova] Lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:12:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9b07c32a-4543-48f1-b805-4d8b0104d1e2 req-f6e18d48-f8af-4241-adb4-0f79cd5f5754 service nova] Lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:12:29 user nova-compute[74898]: DEBUG nova.compute.manager [req-9b07c32a-4543-48f1-b805-4d8b0104d1e2 req-f6e18d48-f8af-4241-adb4-0f79cd5f5754 service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] No waiting events found dispatching network-vif-plugged-f819d75d-a65d-4342-9912-944d2fb13dd3 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:12:29 user nova-compute[74898]: WARNING nova.compute.manager [req-9b07c32a-4543-48f1-b805-4d8b0104d1e2 req-f6e18d48-f8af-4241-adb4-0f79cd5f5754 service nova] [instance: f25ef6a9-d007-419d-8478-2a9e79d5f03a] Received unexpected event network-vif-plugged-f819d75d-a65d-4342-9912-944d2fb13dd3 for instance with vm_state deleted and task_state None.
Nov 17 03:12:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-df1c10c6-cc07-456b-a310-a065d012ad46 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "f25ef6a9-d007-419d-8478-2a9e79d5f03a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.400s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:12:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:12:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:12:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cd7ac4-3724-4189-82a7-ba61ba46097a/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cd7ac4-3724-4189-82a7-ba61ba46097a/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cd7ac4-3724-4189-82a7-ba61ba46097a/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:12:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cd7ac4-3724-4189-82a7-ba61ba46097a/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:12:30 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:12:30 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:12:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=7248MB free_disk=25.172760009765625GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:12:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:12:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:12:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:12:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance e733574a-56ba-4e24-babd-855bcb5bda61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:12:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 42994e39-187a-4fb6-a293-24a4eb57177b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:12:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 13449e5c-809b-4db2-af0b-53f5865eb3a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:12:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance c49f4ec3-6f9b-4e14-ba29-208aa026301e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:12:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance a92bce56-1038-4762-9c1e-19b5a7ff8cef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:12:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance ff69d6dd-bce4-400b-8f03-429068cf32eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:12:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 24cd7ac4-3724-4189-82a7-ba61ba46097a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:12:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 9411b570-6aaa-48bb-bf68-5765bf7d7a04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:12:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance e188cb77-4a1d-4cab-9b32-9e3d442bb64d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:12:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance ecb90e79-877e-4012-b569-53aefd96de38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:12:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:12:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:12:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:31 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:12:31 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:12:31 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:12:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.452s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:12:32 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:12:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a47958c1-8dbe-4ada-bcea-593063392e74 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Acquiring lock "9411b570-6aaa-48bb-bf68-5765bf7d7a04" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:12:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a47958c1-8dbe-4ada-bcea-593063392e74 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "9411b570-6aaa-48bb-bf68-5765bf7d7a04" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:12:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a47958c1-8dbe-4ada-bcea-593063392e74 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Acquiring lock "9411b570-6aaa-48bb-bf68-5765bf7d7a04-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:12:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a47958c1-8dbe-4ada-bcea-593063392e74 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "9411b570-6aaa-48bb-bf68-5765bf7d7a04-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:12:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a47958c1-8dbe-4ada-bcea-593063392e74 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "9411b570-6aaa-48bb-bf68-5765bf7d7a04-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:12:51 user nova-compute[74898]: INFO nova.compute.manager [None req-a47958c1-8dbe-4ada-bcea-593063392e74 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Terminating instance
Nov 17 03:12:51 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a47958c1-8dbe-4ada-bcea-593063392e74 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:12:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:51 user nova-compute[74898]: DEBUG nova.compute.manager [req-1ac1410b-7fc9-4f72-99bd-0845fb01b4a6 req-aa24b3cf-9f8a-484f-8255-bbcb6afa9791 service nova] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Received event network-vif-unplugged-4aa34942-15bf-440a-baef-7145d7794c7c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:12:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1ac1410b-7fc9-4f72-99bd-0845fb01b4a6 req-aa24b3cf-9f8a-484f-8255-bbcb6afa9791 service nova] Acquiring lock "9411b570-6aaa-48bb-bf68-5765bf7d7a04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:12:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1ac1410b-7fc9-4f72-99bd-0845fb01b4a6 req-aa24b3cf-9f8a-484f-8255-bbcb6afa9791 service nova] Lock "9411b570-6aaa-48bb-bf68-5765bf7d7a04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:12:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1ac1410b-7fc9-4f72-99bd-0845fb01b4a6 req-aa24b3cf-9f8a-484f-8255-bbcb6afa9791 service nova] Lock "9411b570-6aaa-48bb-bf68-5765bf7d7a04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:12:51 user nova-compute[74898]: DEBUG nova.compute.manager [req-1ac1410b-7fc9-4f72-99bd-0845fb01b4a6 req-aa24b3cf-9f8a-484f-8255-bbcb6afa9791 service nova] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] No waiting events found dispatching network-vif-unplugged-4aa34942-15bf-440a-baef-7145d7794c7c {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:12:51 user nova-compute[74898]: DEBUG nova.compute.manager [req-1ac1410b-7fc9-4f72-99bd-0845fb01b4a6 req-aa24b3cf-9f8a-484f-8255-bbcb6afa9791 service nova] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Received event network-vif-unplugged-4aa34942-15bf-440a-baef-7145d7794c7c for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:12:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:52 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Instance destroyed successfully.
Nov 17 03:12:52 user nova-compute[74898]: DEBUG nova.objects.instance [None req-a47958c1-8dbe-4ada-bcea-593063392e74 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lazy-loading 'resources' on Instance uuid 9411b570-6aaa-48bb-bf68-5765bf7d7a04 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:12:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-a47958c1-8dbe-4ada-bcea-593063392e74 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:11:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-605983999',display_name='tempest-ServersNegativeTestJSON-server-605983999',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-605983999',id=27,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:11:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f68ad714a1e48a4aac171700c25db18',ramdisk_id='',reservation_id='r-gzub57ih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-945120285',owner_user_name='tempest-ServersNegativeTestJSON-945120285-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:11:08Z,user_data=None,user_id='ebb3c9e75a2d4e858116fb214b411d8d',uuid=9411b570-6aaa-48bb-bf68-5765bf7d7a04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4aa34942-15bf-440a-baef-7145d7794c7c", "address": "fa:16:3e:bc:25:63", "network": {"id": "9a342d69-a890-4e6d-af91-66e71d4a1ea8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1591686450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f68ad714a1e48a4aac171700c25db18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa34942-15", "ovs_interfaceid": "4aa34942-15bf-440a-baef-7145d7794c7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:12:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-a47958c1-8dbe-4ada-bcea-593063392e74 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Converting VIF {"id": "4aa34942-15bf-440a-baef-7145d7794c7c", "address": "fa:16:3e:bc:25:63", "network": {"id": "9a342d69-a890-4e6d-af91-66e71d4a1ea8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1591686450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f68ad714a1e48a4aac171700c25db18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa34942-15", "ovs_interfaceid": "4aa34942-15bf-440a-baef-7145d7794c7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:12:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-a47958c1-8dbe-4ada-bcea-593063392e74 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:25:63,bridge_name='br-int',has_traffic_filtering=True,id=4aa34942-15bf-440a-baef-7145d7794c7c,network=Network(9a342d69-a890-4e6d-af91-66e71d4a1ea8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa34942-15') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:12:52 user nova-compute[74898]: DEBUG os_vif [None req-a47958c1-8dbe-4ada-bcea-593063392e74 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:25:63,bridge_name='br-int',has_traffic_filtering=True,id=4aa34942-15bf-440a-baef-7145d7794c7c,network=Network(9a342d69-a890-4e6d-af91-66e71d4a1ea8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa34942-15') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:12:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4aa34942-15, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:12:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:12:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=99741df4-f32e-48de-8083-95471d7a7ceb) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:12:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:12:52 user nova-compute[74898]: INFO os_vif [None req-a47958c1-8dbe-4ada-bcea-593063392e74 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:25:63,bridge_name='br-int',has_traffic_filtering=True,id=4aa34942-15bf-440a-baef-7145d7794c7c,network=Network(9a342d69-a890-4e6d-af91-66e71d4a1ea8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa34942-15')
Nov 17 03:12:52 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-a47958c1-8dbe-4ada-bcea-593063392e74 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Deleting instance files /opt/stack/data/nova/instances/9411b570-6aaa-48bb-bf68-5765bf7d7a04_del
Nov 17 03:12:52 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-a47958c1-8dbe-4ada-bcea-593063392e74 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Deletion of /opt/stack/data/nova/instances/9411b570-6aaa-48bb-bf68-5765bf7d7a04_del complete
Nov 17 03:12:52 user nova-compute[74898]: INFO nova.compute.manager [None req-a47958c1-8dbe-4ada-bcea-593063392e74 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 17 03:12:52 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-a47958c1-8dbe-4ada-bcea-593063392e74 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:12:52 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:12:52 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:12:52 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:12:52 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Took 0.39 seconds to deallocate network for instance.
Nov 17 03:12:52 user nova-compute[74898]: DEBUG nova.compute.manager [req-5cb98feb-bf9f-4dc9-b775-98cedbbb9fa6 req-0483246d-d0a1-43d1-bd78-7bd88b37ae5e service nova] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Received event network-vif-deleted-4aa34942-15bf-440a-baef-7145d7794c7c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:12:52 user nova-compute[74898]: INFO nova.compute.manager [req-5cb98feb-bf9f-4dc9-b775-98cedbbb9fa6 req-0483246d-d0a1-43d1-bd78-7bd88b37ae5e service nova] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Neutron deleted interface 4aa34942-15bf-440a-baef-7145d7794c7c; detaching it from the instance and deleting it from the info cache
Nov 17 03:12:52 user nova-compute[74898]: DEBUG nova.network.neutron [req-5cb98feb-bf9f-4dc9-b775-98cedbbb9fa6 req-0483246d-d0a1-43d1-bd78-7bd88b37ae5e service nova] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:12:52 user nova-compute[74898]: DEBUG nova.compute.manager [req-5cb98feb-bf9f-4dc9-b775-98cedbbb9fa6 req-0483246d-d0a1-43d1-bd78-7bd88b37ae5e service nova] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Detach interface failed, port_id=4aa34942-15bf-440a-baef-7145d7794c7c, reason: Instance 9411b570-6aaa-48bb-bf68-5765bf7d7a04 could not be found. {{(pid=74898) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 03:12:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a47958c1-8dbe-4ada-bcea-593063392e74 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:12:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a47958c1-8dbe-4ada-bcea-593063392e74 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:12:53 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-a47958c1-8dbe-4ada-bcea-593063392e74 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:12:53 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-a47958c1-8dbe-4ada-bcea-593063392e74 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:12:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a47958c1-8dbe-4ada-bcea-593063392e74 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:12:53 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-a47958c1-8dbe-4ada-bcea-593063392e74 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Deleted allocations for instance 9411b570-6aaa-48bb-bf68-5765bf7d7a04
Nov 17 03:12:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a47958c1-8dbe-4ada-bcea-593063392e74 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "9411b570-6aaa-48bb-bf68-5765bf7d7a04" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.604s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:12:53 user nova-compute[74898]: DEBUG nova.compute.manager [req-57b00bb9-ed18-4a83-948b-b6338a75311b req-b4a08193-d742-4877-bfb7-b7b2a9c3aa03 service nova] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Received event network-vif-plugged-4aa34942-15bf-440a-baef-7145d7794c7c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:12:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-57b00bb9-ed18-4a83-948b-b6338a75311b req-b4a08193-d742-4877-bfb7-b7b2a9c3aa03 service nova] Acquiring lock "9411b570-6aaa-48bb-bf68-5765bf7d7a04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:12:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-57b00bb9-ed18-4a83-948b-b6338a75311b req-b4a08193-d742-4877-bfb7-b7b2a9c3aa03 service nova] Lock "9411b570-6aaa-48bb-bf68-5765bf7d7a04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:12:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-57b00bb9-ed18-4a83-948b-b6338a75311b req-b4a08193-d742-4877-bfb7-b7b2a9c3aa03 service nova] Lock "9411b570-6aaa-48bb-bf68-5765bf7d7a04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:12:53 user nova-compute[74898]: DEBUG nova.compute.manager [req-57b00bb9-ed18-4a83-948b-b6338a75311b req-b4a08193-d742-4877-bfb7-b7b2a9c3aa03 service nova] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] No waiting events found dispatching network-vif-plugged-4aa34942-15bf-440a-baef-7145d7794c7c {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:12:53 user nova-compute[74898]: WARNING nova.compute.manager [req-57b00bb9-ed18-4a83-948b-b6338a75311b req-b4a08193-d742-4877-bfb7-b7b2a9c3aa03 service nova] [instance: 9411b570-6aaa-48bb-bf68-5765bf7d7a04] Received unexpected event network-vif-plugged-4aa34942-15bf-440a-baef-7145d7794c7c for instance with vm_state deleted and task_state None.
Nov 17 03:12:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:12:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Acquiring lock "351b40ac-146d-49e5-b576-726493897945" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:13:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lock "351b40ac-146d-49e5-b576-726493897945" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:13:14 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:13:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:13:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:13:14 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:13:14 user nova-compute[74898]: INFO nova.compute.claims [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Claim successful on node user
Nov 17 03:13:15 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:13:15 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:13:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:13:15 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:13:15 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:13:15 user nova-compute[74898]: DEBUG nova.network.neutron [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:13:15 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:13:15 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:13:15 user nova-compute[74898]: DEBUG nova.policy [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc353ba522a54aab95a1be8e8a0a6aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad65d3ca604b36926e90f682f95354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:13:15 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:13:15 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:13:15 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Creating image(s)
Nov 17 03:13:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Acquiring lock "/opt/stack/data/nova/instances/351b40ac-146d-49e5-b576-726493897945/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:13:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lock "/opt/stack/data/nova/instances/351b40ac-146d-49e5-b576-726493897945/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:13:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lock "/opt/stack/data/nova/instances/351b40ac-146d-49e5-b576-726493897945/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:13:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.175s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:13:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:13:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/351b40ac-146d-49e5-b576-726493897945/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/351b40ac-146d-49e5-b576-726493897945/disk 1073741824" returned: 0 in 0.048s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:13:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.170s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:15 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Checking if we can resize image /opt/stack/data/nova/instances/351b40ac-146d-49e5-b576-726493897945/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:13:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351b40ac-146d-49e5-b576-726493897945/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:16 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:16 user nova-compute[74898]: DEBUG nova.network.neutron [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Successfully created port: 7a94312f-9d65-4b04-874e-21bcdb6750f7 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:13:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351b40ac-146d-49e5-b576-726493897945/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:16 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Cannot resize image /opt/stack/data/nova/instances/351b40ac-146d-49e5-b576-726493897945/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:13:16 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:13:16 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Ensure instance console log exists: /opt/stack/data/nova/instances/351b40ac-146d-49e5-b576-726493897945/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:13:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:13:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:13:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:13:16 user nova-compute[74898]: DEBUG nova.network.neutron [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Successfully updated port: 7a94312f-9d65-4b04-874e-21bcdb6750f7 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:13:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Acquiring lock "refresh_cache-351b40ac-146d-49e5-b576-726493897945" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:13:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Acquired lock "refresh_cache-351b40ac-146d-49e5-b576-726493897945" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:13:16 user nova-compute[74898]: DEBUG nova.network.neutron [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:13:16 user nova-compute[74898]: DEBUG nova.compute.manager [req-9df51977-30ae-40ea-9a9f-6a3ca77dd3e3 req-493952a0-a533-43f2-a035-a30873a16309 service nova] [instance: 351b40ac-146d-49e5-b576-726493897945] Received event network-changed-7a94312f-9d65-4b04-874e-21bcdb6750f7 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:13:16 user nova-compute[74898]: DEBUG nova.compute.manager [req-9df51977-30ae-40ea-9a9f-6a3ca77dd3e3 req-493952a0-a533-43f2-a035-a30873a16309 service nova] [instance: 351b40ac-146d-49e5-b576-726493897945] Refreshing instance network info cache due to event network-changed-7a94312f-9d65-4b04-874e-21bcdb6750f7. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:13:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9df51977-30ae-40ea-9a9f-6a3ca77dd3e3 req-493952a0-a533-43f2-a035-a30873a16309 service nova] Acquiring lock "refresh_cache-351b40ac-146d-49e5-b576-726493897945" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:13:16 user nova-compute[74898]: DEBUG nova.network.neutron [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.network.neutron [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Updating instance_info_cache with network_info: [{"id": "7a94312f-9d65-4b04-874e-21bcdb6750f7", "address": "fa:16:3e:ea:3b:50", "network": {"id": "cf23170a-1954-4a5c-a124-22dc9421cf7a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1758456257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6ad65d3ca604b36926e90f682f95354", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a94312f-9d", "ovs_interfaceid": "7a94312f-9d65-4b04-874e-21bcdb6750f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Releasing lock "refresh_cache-351b40ac-146d-49e5-b576-726493897945" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Instance network_info: |[{"id": "7a94312f-9d65-4b04-874e-21bcdb6750f7", "address": "fa:16:3e:ea:3b:50", "network": {"id": "cf23170a-1954-4a5c-a124-22dc9421cf7a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1758456257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6ad65d3ca604b36926e90f682f95354", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a94312f-9d", "ovs_interfaceid": "7a94312f-9d65-4b04-874e-21bcdb6750f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9df51977-30ae-40ea-9a9f-6a3ca77dd3e3 req-493952a0-a533-43f2-a035-a30873a16309 service nova] Acquired lock "refresh_cache-351b40ac-146d-49e5-b576-726493897945" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.network.neutron [req-9df51977-30ae-40ea-9a9f-6a3ca77dd3e3 req-493952a0-a533-43f2-a035-a30873a16309 service nova] [instance: 351b40ac-146d-49e5-b576-726493897945] Refreshing network info cache for port 7a94312f-9d65-4b04-874e-21bcdb6750f7 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Start _get_guest_xml network_info=[{"id": "7a94312f-9d65-4b04-874e-21bcdb6750f7", "address": "fa:16:3e:ea:3b:50", "network": {"id": "cf23170a-1954-4a5c-a124-22dc9421cf7a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1758456257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6ad65d3ca604b36926e90f682f95354", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a94312f-9d", "ovs_interfaceid": "7a94312f-9d65-4b04-874e-21bcdb6750f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:13:17 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:13:17 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:13:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-356559055',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-356559055',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3565590',id=29,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIHf2Q6Q6Veg5Qs18OTxqnheTgdmo0HiooLXbDcFDKXLRY0/P8RWczMfwJaUdH2jOeFpkgAWfJhBEc+0sEzyCFv1/QbJB5LJCpEZWpn/WjTiLxBcTiA1ZXARECLRpBUUw==',key_name='tempest-keypair-607587357',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6ad65d3ca604b36926e90f682f95354',ramdisk_id='',reservation_id='r-rknltgxp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1162503167',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:13:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc353ba522a54aab95a1be8e8a0a6aff',uuid=351b40ac-146d-49e5-b576-726493897945,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a94312f-9d65-4b04-874e-21bcdb6750f7", "address": "fa:16:3e:ea:3b:50", "network": {"id": "cf23170a-1954-4a5c-a124-22dc9421cf7a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1758456257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6ad65d3ca604b36926e90f682f95354", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a94312f-9d", "ovs_interfaceid": "7a94312f-9d65-4b04-874e-21bcdb6750f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Converting VIF {"id": "7a94312f-9d65-4b04-874e-21bcdb6750f7", "address": "fa:16:3e:ea:3b:50", "network": {"id": "cf23170a-1954-4a5c-a124-22dc9421cf7a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1758456257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6ad65d3ca604b36926e90f682f95354", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a94312f-9d", "ovs_interfaceid": "7a94312f-9d65-4b04-874e-21bcdb6750f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:3b:50,bridge_name='br-int',has_traffic_filtering=True,id=7a94312f-9d65-4b04-874e-21bcdb6750f7,network=Network(cf23170a-1954-4a5c-a124-22dc9421cf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a94312f-9d') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.objects.instance [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lazy-loading 'pci_devices' on Instance uuid 351b40ac-146d-49e5-b576-726493897945 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:13:17 user nova-compute[74898]:   <uuid>351b40ac-146d-49e5-b576-726493897945</uuid>
Nov 17 03:13:17 user nova-compute[74898]:   <name>instance-0000001d</name>
Nov 17 03:13:17 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:13:17 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:13:17 user nova-compute[74898]:   <metadata>
Nov 17 03:13:17 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:13:17 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:13:17 user nova-compute[74898]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-356559055</nova:name>
Nov 17 03:13:17 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:13:17</nova:creationTime>
Nov 17 03:13:17 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:13:17 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:13:17 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:13:17 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:13:17 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:13:17 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:13:17 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:13:17 user nova-compute[74898]:       <nova:owner>
Nov 17 03:13:17 user nova-compute[74898]:         <nova:user uuid="bc353ba522a54aab95a1be8e8a0a6aff">tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member</nova:user>
Nov 17 03:13:17 user nova-compute[74898]:         <nova:project uuid="c6ad65d3ca604b36926e90f682f95354">tempest-TestServerVolumeAttachScenarioOldVersion-1162503167</nova:project>
Nov 17 03:13:17 user nova-compute[74898]:       </nova:owner>
Nov 17 03:13:17 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:13:17 user nova-compute[74898]:       <nova:ports>
Nov 17 03:13:17 user nova-compute[74898]:         <nova:port uuid="7a94312f-9d65-4b04-874e-21bcdb6750f7">
Nov 17 03:13:17 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 17 03:13:17 user nova-compute[74898]:         </nova:port>
Nov 17 03:13:17 user nova-compute[74898]:       </nova:ports>
Nov 17 03:13:17 user nova-compute[74898]:     </nova:instance>
Nov 17 03:13:17 user nova-compute[74898]:   </metadata>
Nov 17 03:13:17 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:13:17 user nova-compute[74898]:     <system>
Nov 17 03:13:17 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:13:17 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:13:17 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:13:17 user nova-compute[74898]:       <entry name="serial">351b40ac-146d-49e5-b576-726493897945</entry>
Nov 17 03:13:17 user nova-compute[74898]:       <entry name="uuid">351b40ac-146d-49e5-b576-726493897945</entry>
Nov 17 03:13:17 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:13:17 user nova-compute[74898]:     </system>
Nov 17 03:13:17 user nova-compute[74898]:   </sysinfo>
Nov 17 03:13:17 user nova-compute[74898]:   <os>
Nov 17 03:13:17 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:13:17 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:13:17 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:13:17 user nova-compute[74898]:   </os>
Nov 17 03:13:17 user nova-compute[74898]:   <features>
Nov 17 03:13:17 user nova-compute[74898]:     <acpi/>
Nov 17 03:13:17 user nova-compute[74898]:     <apic/>
Nov 17 03:13:17 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:13:17 user nova-compute[74898]:   </features>
Nov 17 03:13:17 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:13:17 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:13:17 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:13:17 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:13:17 user nova-compute[74898]:   </clock>
Nov 17 03:13:17 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:13:17 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:13:17 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:13:17 user nova-compute[74898]:   </cpu>
Nov 17 03:13:17 user nova-compute[74898]:   <devices>
Nov 17 03:13:17 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:13:17 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:13:17 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/351b40ac-146d-49e5-b576-726493897945/disk"/>
Nov 17 03:13:17 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:13:17 user nova-compute[74898]:     </disk>
Nov 17 03:13:17 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:13:17 user nova-compute[74898]:       <mac address="fa:16:3e:ea:3b:50"/>
Nov 17 03:13:17 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:13:17 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:13:17 user nova-compute[74898]:       <target dev="tap7a94312f-9d"/>
Nov 17 03:13:17 user nova-compute[74898]:     </interface>
Nov 17 03:13:17 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:13:17 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/351b40ac-146d-49e5-b576-726493897945/console.log" append="off"/>
Nov 17 03:13:17 user nova-compute[74898]:     </serial>
Nov 17 03:13:17 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:13:17 user nova-compute[74898]:     <video>
Nov 17 03:13:17 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:13:17 user nova-compute[74898]:     </video>
Nov 17 03:13:17 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:13:17 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:13:17 user nova-compute[74898]:     </rng>
Nov 17 03:13:17 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:13:17 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:13:17 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:13:17 user nova-compute[74898]:     </memballoon>
Nov 17 03:13:17 user nova-compute[74898]:   </devices>
Nov 17 03:13:17 user nova-compute[74898]: </domain>
Nov 17 03:13:17 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:13:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-356559055',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-356559055',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3565590',id=29,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIHf2Q6Q6Veg5Qs18OTxqnheTgdmo0HiooLXbDcFDKXLRY0/P8RWczMfwJaUdH2jOeFpkgAWfJhBEc+0sEzyCFv1/QbJB5LJCpEZWpn/WjTiLxBcTiA1ZXARECLRpBUUw==',key_name='tempest-keypair-607587357',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6ad65d3ca604b36926e90f682f95354',ramdisk_id='',reservation_id='r-rknltgxp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1162503167',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:13:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc353ba522a54aab95a1be8e8a0a6aff',uuid=351b40ac-146d-49e5-b576-726493897945,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a94312f-9d65-4b04-874e-21bcdb6750f7", "address": "fa:16:3e:ea:3b:50", "network": {"id": "cf23170a-1954-4a5c-a124-22dc9421cf7a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1758456257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6ad65d3ca604b36926e90f682f95354", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a94312f-9d", "ovs_interfaceid": "7a94312f-9d65-4b04-874e-21bcdb6750f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Converting VIF {"id": "7a94312f-9d65-4b04-874e-21bcdb6750f7", "address": "fa:16:3e:ea:3b:50", "network": {"id": "cf23170a-1954-4a5c-a124-22dc9421cf7a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1758456257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6ad65d3ca604b36926e90f682f95354", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a94312f-9d", "ovs_interfaceid": "7a94312f-9d65-4b04-874e-21bcdb6750f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:3b:50,bridge_name='br-int',has_traffic_filtering=True,id=7a94312f-9d65-4b04-874e-21bcdb6750f7,network=Network(cf23170a-1954-4a5c-a124-22dc9421cf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a94312f-9d') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG os_vif [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:3b:50,bridge_name='br-int',has_traffic_filtering=True,id=7a94312f-9d65-4b04-874e-21bcdb6750f7,network=Network(cf23170a-1954-4a5c-a124-22dc9421cf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a94312f-9d') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6eeaaf24-082b-5f5b-a6d0-7bd9f4b13162', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a94312f-9d, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a94312f-9d, col_values=(('qos', UUID('0cd4539a-1185-443c-8151-3491910a3715')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a94312f-9d, col_values=(('external_ids', {'iface-id': '7a94312f-9d65-4b04-874e-21bcdb6750f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:3b:50', 'vm-uuid': '351b40ac-146d-49e5-b576-726493897945'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:17 user nova-compute[74898]: INFO os_vif [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:3b:50,bridge_name='br-int',has_traffic_filtering=True,id=7a94312f-9d65-4b04-874e-21bcdb6750f7,network=Network(cf23170a-1954-4a5c-a124-22dc9421cf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a94312f-9d')
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] No VIF found with MAC fa:16:3e:ea:3b:50, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.network.neutron [req-9df51977-30ae-40ea-9a9f-6a3ca77dd3e3 req-493952a0-a533-43f2-a035-a30873a16309 service nova] [instance: 351b40ac-146d-49e5-b576-726493897945] Updated VIF entry in instance network info cache for port 7a94312f-9d65-4b04-874e-21bcdb6750f7. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG nova.network.neutron [req-9df51977-30ae-40ea-9a9f-6a3ca77dd3e3 req-493952a0-a533-43f2-a035-a30873a16309 service nova] [instance: 351b40ac-146d-49e5-b576-726493897945] Updating instance_info_cache with network_info: [{"id": "7a94312f-9d65-4b04-874e-21bcdb6750f7", "address": "fa:16:3e:ea:3b:50", "network": {"id": "cf23170a-1954-4a5c-a124-22dc9421cf7a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1758456257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6ad65d3ca604b36926e90f682f95354", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a94312f-9d", "ovs_interfaceid": "7a94312f-9d65-4b04-874e-21bcdb6750f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:13:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9df51977-30ae-40ea-9a9f-6a3ca77dd3e3 req-493952a0-a533-43f2-a035-a30873a16309 service nova] Releasing lock "refresh_cache-351b40ac-146d-49e5-b576-726493897945" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:13:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:18 user nova-compute[74898]: DEBUG nova.compute.manager [req-77363481-7096-4ae2-8b1c-dff70465f205 req-75c04442-ed32-4b3e-b7fd-a93767732d18 service nova] [instance: 351b40ac-146d-49e5-b576-726493897945] Received event network-vif-plugged-7a94312f-9d65-4b04-874e-21bcdb6750f7 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:13:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-77363481-7096-4ae2-8b1c-dff70465f205 req-75c04442-ed32-4b3e-b7fd-a93767732d18 service nova] Acquiring lock "351b40ac-146d-49e5-b576-726493897945-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:13:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-77363481-7096-4ae2-8b1c-dff70465f205 req-75c04442-ed32-4b3e-b7fd-a93767732d18 service nova] Lock "351b40ac-146d-49e5-b576-726493897945-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:13:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-77363481-7096-4ae2-8b1c-dff70465f205 req-75c04442-ed32-4b3e-b7fd-a93767732d18 service nova] Lock "351b40ac-146d-49e5-b576-726493897945-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:13:18 user nova-compute[74898]: DEBUG nova.compute.manager [req-77363481-7096-4ae2-8b1c-dff70465f205 req-75c04442-ed32-4b3e-b7fd-a93767732d18 service nova] [instance: 351b40ac-146d-49e5-b576-726493897945] No waiting events found dispatching network-vif-plugged-7a94312f-9d65-4b04-874e-21bcdb6750f7 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:13:18 user nova-compute[74898]: WARNING nova.compute.manager [req-77363481-7096-4ae2-8b1c-dff70465f205 req-75c04442-ed32-4b3e-b7fd-a93767732d18 service nova] [instance: 351b40ac-146d-49e5-b576-726493897945] Received unexpected event network-vif-plugged-7a94312f-9d65-4b04-874e-21bcdb6750f7 for instance with vm_state building and task_state spawning.
Nov 17 03:13:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:19 user nova-compute[74898]: DEBUG nova.compute.manager [req-31ded29e-e087-408e-b51d-17d37894fbc1 req-e5bc9630-3fe8-4f07-8f0b-08025ee83592 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Received event network-changed-1ab100dc-5533-4676-9814-2c9ce077e75e {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:13:19 user nova-compute[74898]: DEBUG nova.compute.manager [req-31ded29e-e087-408e-b51d-17d37894fbc1 req-e5bc9630-3fe8-4f07-8f0b-08025ee83592 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Refreshing instance network info cache due to event network-changed-1ab100dc-5533-4676-9814-2c9ce077e75e. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:13:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-31ded29e-e087-408e-b51d-17d37894fbc1 req-e5bc9630-3fe8-4f07-8f0b-08025ee83592 service nova] Acquiring lock "refresh_cache-e188cb77-4a1d-4cab-9b32-9e3d442bb64d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:13:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-31ded29e-e087-408e-b51d-17d37894fbc1 req-e5bc9630-3fe8-4f07-8f0b-08025ee83592 service nova] Acquired lock "refresh_cache-e188cb77-4a1d-4cab-9b32-9e3d442bb64d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:13:19 user nova-compute[74898]: DEBUG nova.network.neutron [req-31ded29e-e087-408e-b51d-17d37894fbc1 req-e5bc9630-3fe8-4f07-8f0b-08025ee83592 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Refreshing network info cache for port 1ab100dc-5533-4676-9814-2c9ce077e75e {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:13:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Acquiring lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:13:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:13:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Acquiring lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:13:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:13:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:13:19 user nova-compute[74898]: INFO nova.compute.manager [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Terminating instance
Nov 17 03:13:19 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG nova.compute.manager [req-8117d7c2-3f7c-4420-b988-972108016a62 req-336acebf-a9e9-48f2-8134-aafc884eba26 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Received event network-vif-unplugged-1ab100dc-5533-4676-9814-2c9ce077e75e {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8117d7c2-3f7c-4420-b988-972108016a62 req-336acebf-a9e9-48f2-8134-aafc884eba26 service nova] Acquiring lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8117d7c2-3f7c-4420-b988-972108016a62 req-336acebf-a9e9-48f2-8134-aafc884eba26 service nova] Lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8117d7c2-3f7c-4420-b988-972108016a62 req-336acebf-a9e9-48f2-8134-aafc884eba26 service nova] Lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG nova.compute.manager [req-8117d7c2-3f7c-4420-b988-972108016a62 req-336acebf-a9e9-48f2-8134-aafc884eba26 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] No waiting events found dispatching network-vif-unplugged-1ab100dc-5533-4676-9814-2c9ce077e75e {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG nova.compute.manager [req-8117d7c2-3f7c-4420-b988-972108016a62 req-336acebf-a9e9-48f2-8134-aafc884eba26 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Received event network-vif-unplugged-1ab100dc-5533-4676-9814-2c9ce077e75e for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG nova.network.neutron [req-31ded29e-e087-408e-b51d-17d37894fbc1 req-e5bc9630-3fe8-4f07-8f0b-08025ee83592 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Updated VIF entry in instance network info cache for port 1ab100dc-5533-4676-9814-2c9ce077e75e. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG nova.network.neutron [req-31ded29e-e087-408e-b51d-17d37894fbc1 req-e5bc9630-3fe8-4f07-8f0b-08025ee83592 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Updating instance_info_cache with network_info: [{"id": "1ab100dc-5533-4676-9814-2c9ce077e75e", "address": "fa:16:3e:15:59:1e", "network": {"id": "52b2b9ce-ab0e-4516-b46f-04f1670a5859", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349717026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e17e2cb304d88832baac8d20b6ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab100dc-55", "ovs_interfaceid": "1ab100dc-5533-4676-9814-2c9ce077e75e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-31ded29e-e087-408e-b51d-17d37894fbc1 req-e5bc9630-3fe8-4f07-8f0b-08025ee83592 service nova] Releasing lock "refresh_cache-e188cb77-4a1d-4cab-9b32-9e3d442bb64d" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:13:20 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Instance destroyed successfully.
Nov 17 03:13:20 user nova-compute[74898]: DEBUG nova.objects.instance [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lazy-loading 'resources' on Instance uuid e188cb77-4a1d-4cab-9b32-9e3d442bb64d {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-17T03:07:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-438225612',display_name='tempest-TestShelveInstance-server-438225612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-438225612',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDmSd2NGubOcYAcKcy9vf9FFiaZ53lvPXbeSEL0PYEMFkGQuwJsRdb52jAzPICFCNpjRnvRgeRQ61dhOkF/dPmPwKEFLeDVySR2pJ9NtHk/FzrMRYBMjdFKARvsHGoSKg==',key_name='tempest-TestShelveInstance-1240625614',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:11:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c9e17e2cb304d88832baac8d20b6ae8',ramdisk_id='',reservation_id='r-6x3ptz5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-440551976',owner_user_name='tempest-TestShelveInstance-440551976-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:11:42Z,user_data=None,user_id='633094c28d414c1fac599af2a16bc1f6',uuid=e188cb77-4a1d-4cab-9b32-9e3d442bb64d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ab100dc-5533-4676-9814-2c9ce077e75e", "address": "fa:16:3e:15:59:1e", "network": {"id": "52b2b9ce-ab0e-4516-b46f-04f1670a5859", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349717026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e17e2cb304d88832baac8d20b6ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab100dc-55", "ovs_interfaceid": "1ab100dc-5533-4676-9814-2c9ce077e75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Converting VIF {"id": "1ab100dc-5533-4676-9814-2c9ce077e75e", "address": "fa:16:3e:15:59:1e", "network": {"id": "52b2b9ce-ab0e-4516-b46f-04f1670a5859", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349717026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9e17e2cb304d88832baac8d20b6ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab100dc-55", "ovs_interfaceid": "1ab100dc-5533-4676-9814-2c9ce077e75e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:59:1e,bridge_name='br-int',has_traffic_filtering=True,id=1ab100dc-5533-4676-9814-2c9ce077e75e,network=Network(52b2b9ce-ab0e-4516-b46f-04f1670a5859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ab100dc-55') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG os_vif [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:59:1e,bridge_name='br-int',has_traffic_filtering=True,id=1ab100dc-5533-4676-9814-2c9ce077e75e,network=Network(52b2b9ce-ab0e-4516-b46f-04f1670a5859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ab100dc-55') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ab100dc-55, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de56d615-5eeb-4896-ab89-dee1524e2ced) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:13:20 user nova-compute[74898]: INFO os_vif [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:59:1e,bridge_name='br-int',has_traffic_filtering=True,id=1ab100dc-5533-4676-9814-2c9ce077e75e,network=Network(52b2b9ce-ab0e-4516-b46f-04f1670a5859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ab100dc-55')
Nov 17 03:13:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgCfIaPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:13:20 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:13:20 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae9dc4c-a893-4545-b7ec-682b62c96677]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:13:20 user nova-compute[74898]: No targets found.
Nov 17 03:13:20 user nova-compute[74898]: iSNS:
Nov 17 03:13:20 user nova-compute[74898]: No targets found.
Nov 17 03:13:20 user nova-compute[74898]: STATIC:
Nov 17 03:13:20 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7
Nov 17 03:13:20 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:13:20 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:13:20 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1
Nov 17 03:13:20 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:13:20 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:13:20 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4
Nov 17 03:13:20 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:13:20 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:13:20 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19
Nov 17 03:13:20 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:13:20 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:13:20 user nova-compute[74898]: FIRMWARE:
Nov 17 03:13:20 user nova-compute[74898]: No targets found.
Nov 17 03:13:20 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:13:20 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:13:20 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[756f2239-099e-4fc6-916a-e3848213d176]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ea4d61-9ae6-4d11-b7ca-7ba74d94fbbf]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)
Nov 17 03:13:20 user nova-compute[74898]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:13:20 user nova-compute[74898]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:13:20 user nova-compute[74898]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)
Nov 17 03:13:20 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)
Nov 17 03:13:20 user nova-compute[74898]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:13:20 user nova-compute[74898]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 (non-flash)
Nov 17 03:13:20 user nova-compute[74898]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)
Nov 17 03:13:20 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9c18364550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7'): ({'sdf'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Removing single pathed devices sdf {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:20 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 351b40ac-146d-49e5-b576-726493897945] Instance spawned successfully.
Nov 17 03:13:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9aa601-8c00-427c-aecd-d3a9686a4edb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec7ee0c-3715-4593-96a2-b0e9ad960142]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Flushing IO for device /dev/sdf {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ec3b19-2475-4ff3-966a-d276071954ca]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b28a956-0e56-49c5-a288-ddc253ccd6a9]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] SCSI volumes sdf have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOccfa4aa6-2b64b1074548daff', '/dev/disk/by-id/scsi-23262363462313037', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ccfa4aa6') {{(pid=86021) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ec6710-444c-4366-bb41-be52b7547320]: (4, None) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG nova.compute.manager [req-26138652-4346-4f8f-aa0e-237d25569c4d req-de9688e9-ea11-4323-807c-5431af896c0b service nova] [instance: 351b40ac-146d-49e5-b576-726493897945] Received event network-vif-plugged-7a94312f-9d65-4b04-874e-21bcdb6750f7 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-26138652-4346-4f8f-aa0e-237d25569c4d req-de9688e9-ea11-4323-807c-5431af896c0b service nova] Acquiring lock "351b40ac-146d-49e5-b576-726493897945-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-26138652-4346-4f8f-aa0e-237d25569c4d req-de9688e9-ea11-4323-807c-5431af896c0b service nova] Lock "351b40ac-146d-49e5-b576-726493897945-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-26138652-4346-4f8f-aa0e-237d25569c4d req-de9688e9-ea11-4323-807c-5431af896c0b service nova] Lock "351b40ac-146d-49e5-b576-726493897945-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG nova.compute.manager [req-26138652-4346-4f8f-aa0e-237d25569c4d req-de9688e9-ea11-4323-807c-5431af896c0b service nova] [instance: 351b40ac-146d-49e5-b576-726493897945] No waiting events found dispatching network-vif-plugged-7a94312f-9d65-4b04-874e-21bcdb6750f7 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:13:20 user nova-compute[74898]: WARNING nova.compute.manager [req-26138652-4346-4f8f-aa0e-237d25569c4d req-de9688e9-ea11-4323-807c-5431af896c0b service nova] [instance: 351b40ac-146d-49e5-b576-726493897945] Received unexpected event network-vif-plugged-7a94312f-9d65-4b04-874e-21bcdb6750f7 for instance with vm_state building and task_state spawning.
Nov 17 03:13:20 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:13:20 user nova-compute[74898]: INFO nova.compute.manager [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Took 5.58 seconds to spawn the instance on the hypervisor.
Nov 17 03:13:20 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[313b91b2-47b7-43c2-9ceb-586d2d797500]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:13:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51906ea-2d2f-4c20-bca3-adeacec4a1a8]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:13:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7, portal: 172.16.0.220,3260]
Nov 17 03:13:21 user nova-compute[74898]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7, portal: 172.16.0.220,3260] successful.
Nov 17 03:13:21 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:13:21 user nova-compute[74898]: INFO nova.compute.manager [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Took 6.37 seconds to build instance.
Nov 17 03:13:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c729fbbe-8c0f-48c7-8570-46ecc4b157a1 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lock "351b40ac-146d-49e5-b576-726493897945" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.475s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:13:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317e439b-e336-4f22-9638-809454e990f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[de49be24-9516-4cde-9750-5a5b40b90595]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:13:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:13:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:13:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] <== disconnect_volume: return (342ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:13:21 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:13:21 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Deleting instance files /opt/stack/data/nova/instances/e188cb77-4a1d-4cab-9b32-9e3d442bb64d_del
Nov 17 03:13:21 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Deletion of /opt/stack/data/nova/instances/e188cb77-4a1d-4cab-9b32-9e3d442bb64d_del complete
Nov 17 03:13:21 user nova-compute[74898]: INFO nova.compute.manager [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 17 03:13:21 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:13:21 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:13:21 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:13:21 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:13:21 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Took 0.54 seconds to deallocate network for instance.
Nov 17 03:13:21 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:13:21 user nova-compute[74898]: DEBUG nova.compute.manager [req-1fe0a874-8b0b-4d37-a784-0f0df3997caf req-f0d1e2c6-4750-4dc4-8a3d-07cfd61a90a8 service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Received event network-changed-794c112e-9370-4bcc-9fc1-51a9c3b692e1 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:13:21 user nova-compute[74898]: DEBUG nova.compute.manager [req-1fe0a874-8b0b-4d37-a784-0f0df3997caf req-f0d1e2c6-4750-4dc4-8a3d-07cfd61a90a8 service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Refreshing instance network info cache due to event network-changed-794c112e-9370-4bcc-9fc1-51a9c3b692e1. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:13:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1fe0a874-8b0b-4d37-a784-0f0df3997caf req-f0d1e2c6-4750-4dc4-8a3d-07cfd61a90a8 service nova] Acquiring lock "refresh_cache-ecb90e79-877e-4012-b569-53aefd96de38" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:13:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1fe0a874-8b0b-4d37-a784-0f0df3997caf req-f0d1e2c6-4750-4dc4-8a3d-07cfd61a90a8 service nova] Acquired lock "refresh_cache-ecb90e79-877e-4012-b569-53aefd96de38" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:13:21 user nova-compute[74898]: DEBUG nova.network.neutron [req-1fe0a874-8b0b-4d37-a784-0f0df3997caf req-f0d1e2c6-4750-4dc4-8a3d-07cfd61a90a8 service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Refreshing network info cache for port 794c112e-9370-4bcc-9fc1-51a9c3b692e1 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:13:22 user nova-compute[74898]: DEBUG nova.network.neutron [req-1fe0a874-8b0b-4d37-a784-0f0df3997caf req-f0d1e2c6-4750-4dc4-8a3d-07cfd61a90a8 service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Updated VIF entry in instance network info cache for port 794c112e-9370-4bcc-9fc1-51a9c3b692e1. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:13:22 user nova-compute[74898]: DEBUG nova.network.neutron [req-1fe0a874-8b0b-4d37-a784-0f0df3997caf req-f0d1e2c6-4750-4dc4-8a3d-07cfd61a90a8 service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Updating instance_info_cache with network_info: [{"id": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "address": "fa:16:3e:bd:21:91", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794c112e-93", "ovs_interfaceid": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:13:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1fe0a874-8b0b-4d37-a784-0f0df3997caf req-f0d1e2c6-4750-4dc4-8a3d-07cfd61a90a8 service nova] Releasing lock "refresh_cache-ecb90e79-877e-4012-b569-53aefd96de38" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:13:22 user nova-compute[74898]: DEBUG nova.compute.manager [req-8e70a08f-4782-44ff-b39a-10b695aa84fc req-9879c80f-ff34-4449-8373-c1afde731877 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Received event network-vif-plugged-1ab100dc-5533-4676-9814-2c9ce077e75e {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:13:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8e70a08f-4782-44ff-b39a-10b695aa84fc req-9879c80f-ff34-4449-8373-c1afde731877 service nova] Acquiring lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:13:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8e70a08f-4782-44ff-b39a-10b695aa84fc req-9879c80f-ff34-4449-8373-c1afde731877 service nova] Lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:13:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8e70a08f-4782-44ff-b39a-10b695aa84fc req-9879c80f-ff34-4449-8373-c1afde731877 service nova] Lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:13:22 user nova-compute[74898]: DEBUG nova.compute.manager [req-8e70a08f-4782-44ff-b39a-10b695aa84fc req-9879c80f-ff34-4449-8373-c1afde731877 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] No waiting events found dispatching network-vif-plugged-1ab100dc-5533-4676-9814-2c9ce077e75e {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:13:22 user nova-compute[74898]: WARNING nova.compute.manager [req-8e70a08f-4782-44ff-b39a-10b695aa84fc req-9879c80f-ff34-4449-8373-c1afde731877 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Received unexpected event network-vif-plugged-1ab100dc-5533-4676-9814-2c9ce077e75e for instance with vm_state active and task_state deleting.
Nov 17 03:13:22 user nova-compute[74898]: DEBUG nova.compute.manager [req-8e70a08f-4782-44ff-b39a-10b695aa84fc req-9879c80f-ff34-4449-8373-c1afde731877 service nova] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Received event network-vif-deleted-1ab100dc-5533-4676-9814-2c9ce077e75e {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:13:22 user nova-compute[74898]: INFO nova.compute.manager [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Took 0.88 seconds to detach 1 volumes for instance.
Nov 17 03:13:22 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] [instance: e188cb77-4a1d-4cab-9b32-9e3d442bb64d] Deleting volume: 317e439b-e336-4f22-9638-809454e990f7 {{(pid=74898) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 17 03:13:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:13:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:13:23 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:13:23 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:13:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.449s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:13:23 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Deleted allocations for instance e188cb77-4a1d-4cab-9b32-9e3d442bb64d
Nov 17 03:13:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c9f6890b-97db-4d7c-baf6-a2c28bf23eb2 tempest-TestShelveInstance-440551976 tempest-TestShelveInstance-440551976-project-member] Lock "e188cb77-4a1d-4cab-9b32-9e3d442bb64d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.350s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:13:23 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:13:24 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:13:24 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:13:24 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:13:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "ecb90e79-877e-4012-b569-53aefd96de38" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:13:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "ecb90e79-877e-4012-b569-53aefd96de38" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:13:24 user nova-compute[74898]: INFO nova.compute.manager [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Shelving
Nov 17 03:13:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:25 user nova-compute[74898]: DEBUG nova.compute.manager [req-f7b3f15c-29c5-4154-acc7-6ad29099cfff req-444b3a1c-7245-491c-a521-c74d934db378 service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Received event network-vif-unplugged-794c112e-9370-4bcc-9fc1-51a9c3b692e1 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:13:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f7b3f15c-29c5-4154-acc7-6ad29099cfff req-444b3a1c-7245-491c-a521-c74d934db378 service nova] Acquiring lock "ecb90e79-877e-4012-b569-53aefd96de38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:13:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f7b3f15c-29c5-4154-acc7-6ad29099cfff req-444b3a1c-7245-491c-a521-c74d934db378 service nova] Lock "ecb90e79-877e-4012-b569-53aefd96de38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:13:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f7b3f15c-29c5-4154-acc7-6ad29099cfff req-444b3a1c-7245-491c-a521-c74d934db378 service nova] Lock "ecb90e79-877e-4012-b569-53aefd96de38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:13:25 user nova-compute[74898]: DEBUG nova.compute.manager [req-f7b3f15c-29c5-4154-acc7-6ad29099cfff req-444b3a1c-7245-491c-a521-c74d934db378 service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] No waiting events found dispatching network-vif-unplugged-794c112e-9370-4bcc-9fc1-51a9c3b692e1 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:13:25 user nova-compute[74898]: WARNING nova.compute.manager [req-f7b3f15c-29c5-4154-acc7-6ad29099cfff req-444b3a1c-7245-491c-a521-c74d934db378 service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Received unexpected event network-vif-unplugged-794c112e-9370-4bcc-9fc1-51a9c3b692e1 for instance with vm_state active and task_state shelving.
Nov 17 03:13:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:25 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Instance destroyed successfully.
Nov 17 03:13:25 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Beginning cold snapshot process
Nov 17 03:13:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:25 user nova-compute[74898]: DEBUG nova.privsep.utils [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74898) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 03:13:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk /opt/stack/data/nova/instances/snapshots/tmpvke96kq2/129bf4c06eed4c699c2c79e8393cc401 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk /opt/stack/data/nova/instances/snapshots/tmpvke96kq2/129bf4c06eed4c699c2c79e8393cc401" returned: 0 in 0.661s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:26 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Snapshot extracted, beginning image upload
Nov 17 03:13:26 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:13:26 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:13:26 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Rebuilding the list of instances to heal {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 03:13:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:13:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:13:26 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:13:26 user nova-compute[74898]: DEBUG nova.objects.instance [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lazy-loading 'info_cache' on Instance uuid 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:13:27 user nova-compute[74898]: DEBUG nova.compute.manager [req-283acc0d-5a49-46c4-b973-e7ce82ac5185 req-e572a281-4c7b-4452-8dfb-3230fd72903e service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Received event network-vif-plugged-794c112e-9370-4bcc-9fc1-51a9c3b692e1 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:13:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-283acc0d-5a49-46c4-b973-e7ce82ac5185 req-e572a281-4c7b-4452-8dfb-3230fd72903e service nova] Acquiring lock "ecb90e79-877e-4012-b569-53aefd96de38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:13:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-283acc0d-5a49-46c4-b973-e7ce82ac5185 req-e572a281-4c7b-4452-8dfb-3230fd72903e service nova] Lock "ecb90e79-877e-4012-b569-53aefd96de38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:13:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-283acc0d-5a49-46c4-b973-e7ce82ac5185 req-e572a281-4c7b-4452-8dfb-3230fd72903e service nova] Lock "ecb90e79-877e-4012-b569-53aefd96de38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:13:27 user nova-compute[74898]: DEBUG nova.compute.manager [req-283acc0d-5a49-46c4-b973-e7ce82ac5185 req-e572a281-4c7b-4452-8dfb-3230fd72903e service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] No waiting events found dispatching network-vif-plugged-794c112e-9370-4bcc-9fc1-51a9c3b692e1 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:13:27 user nova-compute[74898]: WARNING nova.compute.manager [req-283acc0d-5a49-46c4-b973-e7ce82ac5185 req-e572a281-4c7b-4452-8dfb-3230fd72903e service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Received unexpected event network-vif-plugged-794c112e-9370-4bcc-9fc1-51a9c3b692e1 for instance with vm_state active and task_state shelving_image_uploading.
Nov 17 03:13:27 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Updating instance_info_cache with network_info: [{"id": "78bdfbfa-3578-4ef5-b499-decd609cba62", "address": "fa:16:3e:b1:55:61", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78bdfbfa-35", "ovs_interfaceid": "78bdfbfa-3578-4ef5-b499-decd609cba62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:13:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:13:27 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:13:27 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:13:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:13:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:13:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:13:27 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:13:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:28 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:13:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:28 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Snapshot image upload complete
Nov 17 03:13:28 user nova-compute[74898]: DEBUG nova.compute.manager [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:13:29 user nova-compute[74898]: INFO nova.compute.manager [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Shelve offloading
Nov 17 03:13:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:29 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Instance destroyed successfully.
Nov 17 03:13:29 user nova-compute[74898]: DEBUG nova.compute.manager [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:13:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "refresh_cache-ecb90e79-877e-4012-b569-53aefd96de38" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:13:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquired lock "refresh_cache-ecb90e79-877e-4012-b569-53aefd96de38" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:13:29 user nova-compute[74898]: DEBUG nova.network.neutron [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:13:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:29 user nova-compute[74898]: DEBUG nova.network.neutron [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Updating instance_info_cache with network_info: [{"id": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "address": "fa:16:3e:bd:21:91", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794c112e-93", "ovs_interfaceid": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:13:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Releasing lock "refresh_cache-ecb90e79-877e-4012-b569-53aefd96de38" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:13:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:30 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Instance destroyed successfully.
Nov 17 03:13:30 user nova-compute[74898]: DEBUG nova.objects.instance [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lazy-loading 'resources' on Instance uuid ecb90e79-877e-4012-b569-53aefd96de38 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:11:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2100741292',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2100741292',id=28,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtbu5U3PmGex6+l+d2xQitFVFUhTB/42hBUcwFM3rFddUybYVm/HJa1SSl7ynLj16o3HC8Me2Uv8377M/7TJKq0m1jfyBGUoyNiWj576PEY80BEbiklEpgOviDozZNNhg==',key_name='tempest-keypair-301754943',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:11:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3de7d05d475c49f0805f5aab5853a0b2',ramdisk_id='',reservation_id='r-plwophpo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-940982522',owner_user_name='tempest-AttachVolumeShelveTestJSON-940982522-project-member',shelved_at='2023-11-17T03:13:28.988123',shelved_host='user',shelved_image_id='1919d592-85f7-4aaf-bf97-932335eb7de7'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:13:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='926d8bd27eb24824a71cb9f1969f9c45',uuid=ecb90e79-877e-4012-b569-53aefd96de38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "address": "fa:16:3e:bd:21:91", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794c112e-93", "ovs_interfaceid": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Converting VIF {"id": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "address": "fa:16:3e:bd:21:91", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794c112e-93", "ovs_interfaceid": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:21:91,bridge_name='br-int',has_traffic_filtering=True,id=794c112e-9370-4bcc-9fc1-51a9c3b692e1,network=Network(c92bc72d-7b33-49a8-96e5-ca2ed117fa48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap794c112e-93') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG os_vif [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:21:91,bridge_name='br-int',has_traffic_filtering=True,id=794c112e-9370-4bcc-9fc1-51a9c3b692e1,network=Network(c92bc72d-7b33-49a8-96e5-ca2ed117fa48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap794c112e-93') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap794c112e-93, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=550744ea-f16a-4864-87b1-bf48c4e2ffbd) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:30 user nova-compute[74898]: INFO os_vif [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:21:91,bridge_name='br-int',has_traffic_filtering=True,id=794c112e-9370-4bcc-9fc1-51a9c3b692e1,network=Network(c92bc72d-7b33-49a8-96e5-ca2ed117fa48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap794c112e-93')
Nov 17 03:13:30 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Deleting instance files /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38_del
Nov 17 03:13:30 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Deletion of /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38_del complete
Nov 17 03:13:30 user nova-compute[74898]: DEBUG nova.compute.manager [req-3d25955c-2906-4a46-97e5-f08a4bd9f162 req-44d06f78-91be-4e04-ab89-cb619d4c8a2c service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Received event network-changed-794c112e-9370-4bcc-9fc1-51a9c3b692e1 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG nova.compute.manager [req-3d25955c-2906-4a46-97e5-f08a4bd9f162 req-44d06f78-91be-4e04-ab89-cb619d4c8a2c service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Refreshing instance network info cache due to event network-changed-794c112e-9370-4bcc-9fc1-51a9c3b692e1. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3d25955c-2906-4a46-97e5-f08a4bd9f162 req-44d06f78-91be-4e04-ab89-cb619d4c8a2c service nova] Acquiring lock "refresh_cache-ecb90e79-877e-4012-b569-53aefd96de38" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3d25955c-2906-4a46-97e5-f08a4bd9f162 req-44d06f78-91be-4e04-ab89-cb619d4c8a2c service nova] Acquired lock "refresh_cache-ecb90e79-877e-4012-b569-53aefd96de38" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG nova.network.neutron [req-3d25955c-2906-4a46-97e5-f08a4bd9f162 req-44d06f78-91be-4e04-ab89-cb619d4c8a2c service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Refreshing network info cache for port 794c112e-9370-4bcc-9fc1-51a9c3b692e1 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk --force-share --output=json" returned: 1 in 0.188s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk --force-share --output=json' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:13:30 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000001c, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk
Nov 17 03:13:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:30 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Deleted allocations for instance ecb90e79-877e-4012-b569-53aefd96de38
Nov 17 03:13:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG nova.objects.instance [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lazy-loading 'numa_topology' on Instance uuid ecb90e79-877e-4012-b569-53aefd96de38 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG nova.objects.base [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Object Instance<ecb90e79-877e-4012-b569-53aefd96de38> lazy-loaded attributes: resources,numa_topology {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351b40ac-146d-49e5-b576-726493897945/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG nova.network.neutron [req-3d25955c-2906-4a46-97e5-f08a4bd9f162 req-44d06f78-91be-4e04-ab89-cb619d4c8a2c service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Updated VIF entry in instance network info cache for port 794c112e-9370-4bcc-9fc1-51a9c3b692e1. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG nova.network.neutron [req-3d25955c-2906-4a46-97e5-f08a4bd9f162 req-44d06f78-91be-4e04-ab89-cb619d4c8a2c service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Updating instance_info_cache with network_info: [{"id": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "address": "fa:16:3e:bd:21:91", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap794c112e-93", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3d25955c-2906-4a46-97e5-f08a4bd9f162 req-44d06f78-91be-4e04-ab89-cb619d4c8a2c service nova] Releasing lock "refresh_cache-ecb90e79-877e-4012-b569-53aefd96de38" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351b40ac-146d-49e5-b576-726493897945/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351b40ac-146d-49e5-b576-726493897945/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.461s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-dde21519-314c-4133-98be-8a0f085b3039 tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "ecb90e79-877e-4012-b569-53aefd96de38" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.950s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351b40ac-146d-49e5-b576-726493897945/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:13:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:13:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cd7ac4-3724-4189-82a7-ba61ba46097a/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cd7ac4-3724-4189-82a7-ba61ba46097a/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cd7ac4-3724-4189-82a7-ba61ba46097a/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24cd7ac4-3724-4189-82a7-ba61ba46097a/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:32 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:13:32 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:13:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=7670MB free_disk=25.20611572265625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:13:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:13:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:13:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:13:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance e733574a-56ba-4e24-babd-855bcb5bda61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:13:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 42994e39-187a-4fb6-a293-24a4eb57177b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:13:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 13449e5c-809b-4db2-af0b-53f5865eb3a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:13:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance c49f4ec3-6f9b-4e14-ba29-208aa026301e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:13:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance a92bce56-1038-4762-9c1e-19b5a7ff8cef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:13:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance ff69d6dd-bce4-400b-8f03-429068cf32eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:13:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 24cd7ac4-3724-4189-82a7-ba61ba46097a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:13:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 351b40ac-146d-49e5-b576-726493897945 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:13:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:13:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:13:32 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:13:32 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:13:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:13:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.391s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:13:32 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:13:32 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:13:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:13:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:13:37 user nova-compute[74898]: INFO nova.compute.manager [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Detaching volume 77b8d623-ac48-40a4-8abe-85631824fc19
Nov 17 03:13:37 user nova-compute[74898]: INFO nova.virt.block_device [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Attempting to driver detach volume 77b8d623-ac48-40a4-8abe-85631824fc19 from mountpoint /dev/vdb
Nov 17 03:13:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Attempting to detach device vdb from instance c49f4ec3-6f9b-4e14-ba29-208aa026301e from the persistent domain config. {{(pid=74898) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 03:13:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:13:37 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:13:37 user nova-compute[74898]:   <source dev="/dev/sdb"/>
Nov 17 03:13:37 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:13:37 user nova-compute[74898]:   <serial>77b8d623-ac48-40a4-8abe-85631824fc19</serial>
Nov 17 03:13:37 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 17 03:13:37 user nova-compute[74898]: </disk>
Nov 17 03:13:37 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:13:37 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Successfully detached device vdb from instance c49f4ec3-6f9b-4e14-ba29-208aa026301e from the persistent domain config.
Nov 17 03:13:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c49f4ec3-6f9b-4e14-ba29-208aa026301e from the live domain config. {{(pid=74898) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 03:13:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:13:37 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:13:37 user nova-compute[74898]:   <source dev="/dev/sdb"/>
Nov 17 03:13:37 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:13:37 user nova-compute[74898]:   <serial>77b8d623-ac48-40a4-8abe-85631824fc19</serial>
Nov 17 03:13:37 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 17 03:13:37 user nova-compute[74898]: </disk>
Nov 17 03:13:37 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:13:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c49f4ec3-6f9b-4e14-ba29-208aa026301e {{(pid=74898) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 03:13:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-f7f3c962-b933-4cf2-b0ca-331dd65b2070 req-e6e6228b-46bc-4bb9-a1f9-5e2684a8ead1 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Received event network-changed-423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:13:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-f7f3c962-b933-4cf2-b0ca-331dd65b2070 req-e6e6228b-46bc-4bb9-a1f9-5e2684a8ead1 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Refreshing instance network info cache due to event network-changed-423e9165-99d6-4938-a3dc-3406806ce781. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:13:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f7f3c962-b933-4cf2-b0ca-331dd65b2070 req-e6e6228b-46bc-4bb9-a1f9-5e2684a8ead1 service nova] Acquiring lock "refresh_cache-a92bce56-1038-4762-9c1e-19b5a7ff8cef" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:13:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f7f3c962-b933-4cf2-b0ca-331dd65b2070 req-e6e6228b-46bc-4bb9-a1f9-5e2684a8ead1 service nova] Acquired lock "refresh_cache-a92bce56-1038-4762-9c1e-19b5a7ff8cef" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:13:39 user nova-compute[74898]: DEBUG nova.network.neutron [req-f7f3c962-b933-4cf2-b0ca-331dd65b2070 req-e6e6228b-46bc-4bb9-a1f9-5e2684a8ead1 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Refreshing network info cache for port 423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:13:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:13:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:13:39 user nova-compute[74898]: DEBUG nova.network.neutron [req-f7f3c962-b933-4cf2-b0ca-331dd65b2070 req-e6e6228b-46bc-4bb9-a1f9-5e2684a8ead1 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Updated VIF entry in instance network info cache for port 423e9165-99d6-4938-a3dc-3406806ce781. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:13:39 user nova-compute[74898]: DEBUG nova.network.neutron [req-f7f3c962-b933-4cf2-b0ca-331dd65b2070 req-e6e6228b-46bc-4bb9-a1f9-5e2684a8ead1 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Updating instance_info_cache with network_info: [{"id": "423e9165-99d6-4938-a3dc-3406806ce781", "address": "fa:16:3e:4a:ec:b4", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423e9165-99", "ovs_interfaceid": "423e9165-99d6-4938-a3dc-3406806ce781", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:13:39 user nova-compute[74898]: INFO nova.compute.manager [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Detaching volume 8f14d664-36ab-40bb-9008-00165c5d60f1
Nov 17 03:13:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f7f3c962-b933-4cf2-b0ca-331dd65b2070 req-e6e6228b-46bc-4bb9-a1f9-5e2684a8ead1 service nova] Releasing lock "refresh_cache-a92bce56-1038-4762-9c1e-19b5a7ff8cef" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:13:39 user nova-compute[74898]: INFO nova.virt.block_device [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Attempting to driver detach volume 8f14d664-36ab-40bb-9008-00165c5d60f1 from mountpoint /dev/vdb
Nov 17 03:13:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Attempting to detach device vdb from instance a92bce56-1038-4762-9c1e-19b5a7ff8cef from the persistent domain config. {{(pid=74898) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 03:13:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:13:39 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:13:39 user nova-compute[74898]:   <source dev="/dev/sde"/>
Nov 17 03:13:39 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:13:39 user nova-compute[74898]:   <serial>8f14d664-36ab-40bb-9008-00165c5d60f1</serial>
Nov 17 03:13:39 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:13:39 user nova-compute[74898]: </disk>
Nov 17 03:13:39 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:13:39 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Successfully detached device vdb from instance a92bce56-1038-4762-9c1e-19b5a7ff8cef from the persistent domain config.
Nov 17 03:13:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a92bce56-1038-4762-9c1e-19b5a7ff8cef from the live domain config. {{(pid=74898) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 03:13:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:13:39 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:13:39 user nova-compute[74898]:   <source dev="/dev/sde"/>
Nov 17 03:13:39 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:13:39 user nova-compute[74898]:   <serial>8f14d664-36ab-40bb-9008-00165c5d60f1</serial>
Nov 17 03:13:39 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:13:39 user nova-compute[74898]: </disk>
Nov 17 03:13:39 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:13:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a92bce56-1038-4762-9c1e-19b5a7ff8cef {{(pid=74898) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 03:13:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:41 user nova-compute[74898]: DEBUG nova.compute.manager [req-473fb677-c2b8-4953-89ba-fe06f66cd341 req-13bd0750-58bc-4ad5-a819-08578cce21ee service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Received event network-changed-423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:13:41 user nova-compute[74898]: DEBUG nova.compute.manager [req-473fb677-c2b8-4953-89ba-fe06f66cd341 req-13bd0750-58bc-4ad5-a819-08578cce21ee service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Refreshing instance network info cache due to event network-changed-423e9165-99d6-4938-a3dc-3406806ce781. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:13:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-473fb677-c2b8-4953-89ba-fe06f66cd341 req-13bd0750-58bc-4ad5-a819-08578cce21ee service nova] Acquiring lock "refresh_cache-a92bce56-1038-4762-9c1e-19b5a7ff8cef" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:13:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-473fb677-c2b8-4953-89ba-fe06f66cd341 req-13bd0750-58bc-4ad5-a819-08578cce21ee service nova] Acquired lock "refresh_cache-a92bce56-1038-4762-9c1e-19b5a7ff8cef" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:13:41 user nova-compute[74898]: DEBUG nova.network.neutron [req-473fb677-c2b8-4953-89ba-fe06f66cd341 req-13bd0750-58bc-4ad5-a819-08578cce21ee service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Refreshing network info cache for port 423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:13:41 user nova-compute[74898]: DEBUG nova.network.neutron [req-473fb677-c2b8-4953-89ba-fe06f66cd341 req-13bd0750-58bc-4ad5-a819-08578cce21ee service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Updated VIF entry in instance network info cache for port 423e9165-99d6-4938-a3dc-3406806ce781. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:13:41 user nova-compute[74898]: DEBUG nova.network.neutron [req-473fb677-c2b8-4953-89ba-fe06f66cd341 req-13bd0750-58bc-4ad5-a819-08578cce21ee service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Updating instance_info_cache with network_info: [{"id": "423e9165-99d6-4938-a3dc-3406806ce781", "address": "fa:16:3e:4a:ec:b4", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423e9165-99", "ovs_interfaceid": "423e9165-99d6-4938-a3dc-3406806ce781", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:13:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-473fb677-c2b8-4953-89ba-fe06f66cd341 req-13bd0750-58bc-4ad5-a819-08578cce21ee service nova] Releasing lock "refresh_cache-a92bce56-1038-4762-9c1e-19b5a7ff8cef" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:13:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:54 user nova-compute[74898]: INFO nova.compute.manager [None req-a680fce9-1b21-480b-9545-6b0ebcc0b338 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Unrescuing
Nov 17 03:13:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a680fce9-1b21-480b-9545-6b0ebcc0b338 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "refresh_cache-24cd7ac4-3724-4189-82a7-ba61ba46097a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:13:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a680fce9-1b21-480b-9545-6b0ebcc0b338 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquired lock "refresh_cache-24cd7ac4-3724-4189-82a7-ba61ba46097a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:13:54 user nova-compute[74898]: DEBUG nova.network.neutron [None req-a680fce9-1b21-480b-9545-6b0ebcc0b338 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:13:55 user nova-compute[74898]: DEBUG nova.network.neutron [None req-a680fce9-1b21-480b-9545-6b0ebcc0b338 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Updating instance_info_cache with network_info: [{"id": "b7880813-a5fe-4eb7-b6aa-f91832114171", "address": "fa:16:3e:da:6b:da", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7880813-a5", "ovs_interfaceid": "b7880813-a5fe-4eb7-b6aa-f91832114171", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:13:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a680fce9-1b21-480b-9545-6b0ebcc0b338 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Releasing lock "refresh_cache-24cd7ac4-3724-4189-82a7-ba61ba46097a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:13:55 user nova-compute[74898]: DEBUG nova.objects.instance [None req-a680fce9-1b21-480b-9545-6b0ebcc0b338 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lazy-loading 'flavor' on Instance uuid 24cd7ac4-3724-4189-82a7-ba61ba46097a {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:13:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:55 user nova-compute[74898]: DEBUG nova.compute.manager [req-8b5c6d64-7079-42b9-8e45-dc8654807f2a req-ac823b2c-cd04-47e1-9a7a-618849ee3041 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Received event network-vif-unplugged-b7880813-a5fe-4eb7-b6aa-f91832114171 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:13:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8b5c6d64-7079-42b9-8e45-dc8654807f2a req-ac823b2c-cd04-47e1-9a7a-618849ee3041 service nova] Acquiring lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:13:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8b5c6d64-7079-42b9-8e45-dc8654807f2a req-ac823b2c-cd04-47e1-9a7a-618849ee3041 service nova] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:13:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8b5c6d64-7079-42b9-8e45-dc8654807f2a req-ac823b2c-cd04-47e1-9a7a-618849ee3041 service nova] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:13:55 user nova-compute[74898]: DEBUG nova.compute.manager [req-8b5c6d64-7079-42b9-8e45-dc8654807f2a req-ac823b2c-cd04-47e1-9a7a-618849ee3041 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] No waiting events found dispatching network-vif-unplugged-b7880813-a5fe-4eb7-b6aa-f91832114171 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:13:55 user nova-compute[74898]: WARNING nova.compute.manager [req-8b5c6d64-7079-42b9-8e45-dc8654807f2a req-ac823b2c-cd04-47e1-9a7a-618849ee3041 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Received unexpected event network-vif-unplugged-b7880813-a5fe-4eb7-b6aa-f91832114171 for instance with vm_state rescued and task_state unrescuing.
Nov 17 03:13:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:55 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Instance destroyed successfully.
Nov 17 03:13:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG nova.compute.manager [req-d254aea5-0248-4a86-a168-c2aaba883484 req-bad764db-33e7-4681-888b-5091d208086f service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Received event network-vif-plugged-b7880813-a5fe-4eb7-b6aa-f91832114171 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d254aea5-0248-4a86-a168-c2aaba883484 req-bad764db-33e7-4681-888b-5091d208086f service nova] Acquiring lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d254aea5-0248-4a86-a168-c2aaba883484 req-bad764db-33e7-4681-888b-5091d208086f service nova] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d254aea5-0248-4a86-a168-c2aaba883484 req-bad764db-33e7-4681-888b-5091d208086f service nova] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG nova.compute.manager [req-d254aea5-0248-4a86-a168-c2aaba883484 req-bad764db-33e7-4681-888b-5091d208086f service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] No waiting events found dispatching network-vif-plugged-b7880813-a5fe-4eb7-b6aa-f91832114171 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:13:57 user nova-compute[74898]: WARNING nova.compute.manager [req-d254aea5-0248-4a86-a168-c2aaba883484 req-bad764db-33e7-4681-888b-5091d208086f service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Received unexpected event network-vif-plugged-b7880813-a5fe-4eb7-b6aa-f91832114171 for instance with vm_state rescued and task_state unrescuing.
Nov 17 03:13:57 user nova-compute[74898]: DEBUG nova.compute.manager [req-d254aea5-0248-4a86-a168-c2aaba883484 req-bad764db-33e7-4681-888b-5091d208086f service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Received event network-vif-plugged-b7880813-a5fe-4eb7-b6aa-f91832114171 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d254aea5-0248-4a86-a168-c2aaba883484 req-bad764db-33e7-4681-888b-5091d208086f service nova] Acquiring lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d254aea5-0248-4a86-a168-c2aaba883484 req-bad764db-33e7-4681-888b-5091d208086f service nova] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d254aea5-0248-4a86-a168-c2aaba883484 req-bad764db-33e7-4681-888b-5091d208086f service nova] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG nova.compute.manager [req-d254aea5-0248-4a86-a168-c2aaba883484 req-bad764db-33e7-4681-888b-5091d208086f service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] No waiting events found dispatching network-vif-plugged-b7880813-a5fe-4eb7-b6aa-f91832114171 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:13:57 user nova-compute[74898]: WARNING nova.compute.manager [req-d254aea5-0248-4a86-a168-c2aaba883484 req-bad764db-33e7-4681-888b-5091d208086f service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Received unexpected event network-vif-plugged-b7880813-a5fe-4eb7-b6aa-f91832114171 for instance with vm_state rescued and task_state unrescuing.
Nov 17 03:13:57 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c49f4ec3-6f9b-4e14-ba29-208aa026301e is timed out.
Nov 17 03:13:57 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Successfully detached device vdb from instance c49f4ec3-6f9b-4e14-ba29-208aa026301e from the live domain config.
Nov 17 03:13:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSFYaLqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:13:57 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:13:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e6c7ce-5292-4fe9-932b-3418551ae22b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:13:57 user nova-compute[74898]: No targets found.
Nov 17 03:13:57 user nova-compute[74898]: iSNS:
Nov 17 03:13:57 user nova-compute[74898]: No targets found.
Nov 17 03:13:57 user nova-compute[74898]: STATIC:
Nov 17 03:13:57 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1
Nov 17 03:13:57 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:13:57 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:13:57 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4
Nov 17 03:13:57 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:13:57 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:13:57 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19
Nov 17 03:13:57 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:13:57 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:13:57 user nova-compute[74898]: FIRMWARE:
Nov 17 03:13:57 user nova-compute[74898]: No targets found.
Nov 17 03:13:57 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:13:57 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:13:57 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[80325d6a-6490-4a41-80a2-46ff8ae467a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b1646c-0b00-4af7-8f92-c310385c707a]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)
Nov 17 03:13:57 user nova-compute[74898]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:13:57 user nova-compute[74898]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)
Nov 17 03:13:57 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)
Nov 17 03:13:57 user nova-compute[74898]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:13:57 user nova-compute[74898]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 (non-flash)
Nov 17 03:13:57 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf869af80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19'): ({'sdb'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Removing single pathed devices sdb {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[79116a02-742e-4968-a635-6cc29cadef8d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ad2446-5b34-4585-8316-88f9964a265b]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Flushing IO for device /dev/sdb {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d73067-91dd-46da-9613-ac52a73175c1]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e8fbea-8f8f-42b6-8f0c-432e98c8b5fd]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ca8007-8fb2-4b46-a609-f6f0071f3e9b]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdc0819-c913-4535-8361-1702a1d500e0]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19, portal: 172.16.0.220,3260]
Nov 17 03:13:57 user nova-compute[74898]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19, portal: 172.16.0.220,3260] successful.
Nov 17 03:13:57 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77b8d623-ac48-40a4-8abe-85631824fc19 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5824577d-14d8-4ab3-9642-5b32ec68301d]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] <== disconnect_volume: return (280ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:13:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:13:58 user nova-compute[74898]: DEBUG nova.objects.instance [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'flavor' on Instance uuid c49f4ec3-6f9b-4e14-ba29-208aa026301e {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:13:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-fe9e4dbe-d4a4-424c-9369-f4893f32512c tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.625s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:13:59 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a680fce9-1b21-480b-9545-6b0ebcc0b338 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:13:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-32255007-2d85-419e-9167-742512520696 req-c99a84d8-22bc-4f2d-aef4-9060723a7636 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Received event network-vif-plugged-b7880813-a5fe-4eb7-b6aa-f91832114171 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:13:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-32255007-2d85-419e-9167-742512520696 req-c99a84d8-22bc-4f2d-aef4-9060723a7636 service nova] Acquiring lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:13:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-32255007-2d85-419e-9167-742512520696 req-c99a84d8-22bc-4f2d-aef4-9060723a7636 service nova] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:13:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-32255007-2d85-419e-9167-742512520696 req-c99a84d8-22bc-4f2d-aef4-9060723a7636 service nova] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:13:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-32255007-2d85-419e-9167-742512520696 req-c99a84d8-22bc-4f2d-aef4-9060723a7636 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] No waiting events found dispatching network-vif-plugged-b7880813-a5fe-4eb7-b6aa-f91832114171 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:13:59 user nova-compute[74898]: WARNING nova.compute.manager [req-32255007-2d85-419e-9167-742512520696 req-c99a84d8-22bc-4f2d-aef4-9060723a7636 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Received unexpected event network-vif-plugged-b7880813-a5fe-4eb7-b6aa-f91832114171 for instance with vm_state active and task_state None.
Nov 17 03:13:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a0c910a8-bda0-43bb-9d02-5163b6a0528a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:13:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a0c910a8-bda0-43bb-9d02-5163b6a0528a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:13:59 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a0c910a8-bda0-43bb-9d02-5163b6a0528a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:13:59 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a0c910a8-bda0-43bb-9d02-5163b6a0528a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74898) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 17 03:13:59 user nova-compute[74898]: DEBUG nova.objects.instance [None req-a0c910a8-bda0-43bb-9d02-5163b6a0528a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'flavor' on Instance uuid c49f4ec3-6f9b-4e14-ba29-208aa026301e {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:13:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:13:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-975b3ba8-79c3-418e-bff7-2f9e03f60bf7 req-311cfbab-d3f7-4f0a-a406-94899f98b5ca service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Received event network-vif-unplugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:13:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-975b3ba8-79c3-418e-bff7-2f9e03f60bf7 req-311cfbab-d3f7-4f0a-a406-94899f98b5ca service nova] Acquiring lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:13:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-975b3ba8-79c3-418e-bff7-2f9e03f60bf7 req-311cfbab-d3f7-4f0a-a406-94899f98b5ca service nova] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:13:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-975b3ba8-79c3-418e-bff7-2f9e03f60bf7 req-311cfbab-d3f7-4f0a-a406-94899f98b5ca service nova] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:13:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-975b3ba8-79c3-418e-bff7-2f9e03f60bf7 req-311cfbab-d3f7-4f0a-a406-94899f98b5ca service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] No waiting events found dispatching network-vif-unplugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:13:59 user nova-compute[74898]: WARNING nova.compute.manager [req-975b3ba8-79c3-418e-bff7-2f9e03f60bf7 req-311cfbab-d3f7-4f0a-a406-94899f98b5ca service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Received unexpected event network-vif-unplugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 for instance with vm_state active and task_state powering-off.
Nov 17 03:14:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:00 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a92bce56-1038-4762-9c1e-19b5a7ff8cef is timed out.
Nov 17 03:14:00 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Successfully detached device vdb from instance a92bce56-1038-4762-9c1e-19b5a7ff8cef from the live domain config.
Nov 17 03:14:00 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kiDJjypO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:14:00 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:14:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[503c70de-543b-4fbb-bb00-39a42211c6ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:14:00 user nova-compute[74898]: No targets found.
Nov 17 03:14:00 user nova-compute[74898]: iSNS:
Nov 17 03:14:00 user nova-compute[74898]: No targets found.
Nov 17 03:14:00 user nova-compute[74898]: STATIC:
Nov 17 03:14:00 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1
Nov 17 03:14:00 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:14:00 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:14:00 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4
Nov 17 03:14:00 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:14:00 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:14:00 user nova-compute[74898]: FIRMWARE:
Nov 17 03:14:00 user nova-compute[74898]: No targets found.
Nov 17 03:14:00 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:14:00 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:14:00 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e2eaec-629b-4461-a08c-12473c475f30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f1d926-cc59-43e4-be44-934c33e43d2c]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)
Nov 17 03:14:00 user nova-compute[74898]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:14:00 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 (non-flash)
Nov 17 03:14:00 user nova-compute[74898]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:14:00 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9c185e8f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1'): ({'sde'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Removing single pathed devices sde {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[59be7a8c-d0d9-4878-901d-63a3ca739bde]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0f4b71-8f62-49ea-9b2e-49ec9cb02b9f]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Flushing IO for device /dev/sde {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:00 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Instance destroyed successfully.
Nov 17 03:14:00 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a0c910a8-bda0-43bb-9d02-5163b6a0528a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3e4db3-5104-49fb-99a6-9638ccdeab82]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a0c910a8-bda0-43bb-9d02-5163b6a0528a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.846s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddaac5a4-3cdf-4686-86b4-a5fcd3f4dec6]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] SCSI volumes sde have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d24ea1f-bb44-4b82-a15b-dadfcef1207d]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc720cf-d233-4ffd-9e40-6f65de7fb41c]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1, portal: 172.16.0.220,3260]
Nov 17 03:14:00 user nova-compute[74898]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1, portal: 172.16.0.220,3260] successful.
Nov 17 03:14:00 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f14d664-36ab-40bb-9008-00165c5d60f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c7520a-1ffe-4e30-9a28-b380838ef5a4]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] <== disconnect_volume: return (300ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:14:00 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:14:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:01 user nova-compute[74898]: DEBUG nova.objects.instance [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lazy-loading 'flavor' on Instance uuid a92bce56-1038-4762-9c1e-19b5a7ff8cef {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:14:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-33e621ff-53cf-447e-ba82-4f2a9248986e tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.580s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:14:01 user nova-compute[74898]: DEBUG nova.compute.manager [req-1d95e8cf-7d4f-49b7-999a-7fd7bf48d60f req-fc3ab5c2-bf1e-449c-8455-0b1b550fe20f service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Received event network-vif-plugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:14:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1d95e8cf-7d4f-49b7-999a-7fd7bf48d60f req-fc3ab5c2-bf1e-449c-8455-0b1b550fe20f service nova] Acquiring lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:14:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1d95e8cf-7d4f-49b7-999a-7fd7bf48d60f req-fc3ab5c2-bf1e-449c-8455-0b1b550fe20f service nova] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:14:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-1d95e8cf-7d4f-49b7-999a-7fd7bf48d60f req-fc3ab5c2-bf1e-449c-8455-0b1b550fe20f service nova] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:14:01 user nova-compute[74898]: DEBUG nova.compute.manager [req-1d95e8cf-7d4f-49b7-999a-7fd7bf48d60f req-fc3ab5c2-bf1e-449c-8455-0b1b550fe20f service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] No waiting events found dispatching network-vif-plugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:14:01 user nova-compute[74898]: WARNING nova.compute.manager [req-1d95e8cf-7d4f-49b7-999a-7fd7bf48d60f req-fc3ab5c2-bf1e-449c-8455-0b1b550fe20f service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Received unexpected event network-vif-plugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 for instance with vm_state stopped and task_state None.
Nov 17 03:14:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:21 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:14:21 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:14:22 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:14:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "3b325f5d-481c-410e-910a-f29df36caec2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:14:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "3b325f5d-481c-410e-910a-f29df36caec2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:14:24 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:14:24 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:14:24 user nova-compute[74898]: DEBUG nova.compute.manager [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:14:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:14:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:14:24 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:14:24 user nova-compute[74898]: INFO nova.compute.claims [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Claim successful on node user
Nov 17 03:14:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG nova.compute.manager [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG nova.compute.manager [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG nova.network.neutron [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:14:25 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:14:25 user nova-compute[74898]: DEBUG nova.compute.manager [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:14:25 user nova-compute[74898]: INFO nova.virt.block_device [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Booting with volume 274f0b23-bf75-4a48-8cb0-462cf98606e5 at /dev/vda
Nov 17 03:14:25 user nova-compute[74898]: DEBUG nova.policy [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '28445b2b2360414bac2607ec94166369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff82629b7d7486a86574994974fabda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG os_brick.utils [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c62da0d-a09b-4099-985c-e3c1f8b23132]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50b50e8-8cdf-48bf-ba26-59df31557c29]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3c4f82-1473-4296-85aa-910e16a2ad8d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71db3c5-9d31-41df-90eb-c748aca4ef9a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:14:25 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:14:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9192075b-a7d1-40e3-9db5-4c542ad8a4fd]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG os_brick.utils [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:14:25 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Updating existing volume attachment record: 444b1507-308c-42a7-b7ab-d6e7fd66ebcf {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:14:26 user nova-compute[74898]: DEBUG nova.network.neutron [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Successfully created port: cc6303d4-2332-4907-a0b1-7a4bf175282d {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:14:26 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:14:26 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:14:26 user nova-compute[74898]: DEBUG nova.network.neutron [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Successfully updated port: cc6303d4-2332-4907-a0b1-7a4bf175282d {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:14:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "refresh_cache-3b325f5d-481c-410e-910a-f29df36caec2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:14:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquired lock "refresh_cache-3b325f5d-481c-410e-910a-f29df36caec2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:14:26 user nova-compute[74898]: DEBUG nova.network.neutron [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:14:26 user nova-compute[74898]: DEBUG nova.compute.manager [req-b800afca-ffb1-4fe1-88ad-afd863b84bb0 req-764d911a-610f-4849-a38d-00ab779929f4 service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Received event network-changed-cc6303d4-2332-4907-a0b1-7a4bf175282d {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:14:26 user nova-compute[74898]: DEBUG nova.compute.manager [req-b800afca-ffb1-4fe1-88ad-afd863b84bb0 req-764d911a-610f-4849-a38d-00ab779929f4 service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Refreshing instance network info cache due to event network-changed-cc6303d4-2332-4907-a0b1-7a4bf175282d. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:14:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b800afca-ffb1-4fe1-88ad-afd863b84bb0 req-764d911a-610f-4849-a38d-00ab779929f4 service nova] Acquiring lock "refresh_cache-3b325f5d-481c-410e-910a-f29df36caec2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:14:26 user nova-compute[74898]: DEBUG nova.network.neutron [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:14:27 user nova-compute[74898]: DEBUG nova.network.neutron [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Updating instance_info_cache with network_info: [{"id": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "address": "fa:16:3e:75:38:b0", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6303d4-23", "ovs_interfaceid": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:14:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Releasing lock "refresh_cache-3b325f5d-481c-410e-910a-f29df36caec2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:14:27 user nova-compute[74898]: DEBUG nova.compute.manager [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Instance network_info: |[{"id": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "address": "fa:16:3e:75:38:b0", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6303d4-23", "ovs_interfaceid": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:14:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b800afca-ffb1-4fe1-88ad-afd863b84bb0 req-764d911a-610f-4849-a38d-00ab779929f4 service nova] Acquired lock "refresh_cache-3b325f5d-481c-410e-910a-f29df36caec2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:14:27 user nova-compute[74898]: DEBUG nova.network.neutron [req-b800afca-ffb1-4fe1-88ad-afd863b84bb0 req-764d911a-610f-4849-a38d-00ab779929f4 service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Refreshing network info cache for port cc6303d4-2332-4907-a0b1-7a4bf175282d {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:14:27 user nova-compute[74898]: DEBUG nova.network.neutron [req-b800afca-ffb1-4fe1-88ad-afd863b84bb0 req-764d911a-610f-4849-a38d-00ab779929f4 service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Updated VIF entry in instance network info cache for port cc6303d4-2332-4907-a0b1-7a4bf175282d. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:14:27 user nova-compute[74898]: DEBUG nova.network.neutron [req-b800afca-ffb1-4fe1-88ad-afd863b84bb0 req-764d911a-610f-4849-a38d-00ab779929f4 service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Updating instance_info_cache with network_info: [{"id": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "address": "fa:16:3e:75:38:b0", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6303d4-23", "ovs_interfaceid": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:14:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b800afca-ffb1-4fe1-88ad-afd863b84bb0 req-764d911a-610f-4849-a38d-00ab779929f4 service nova] Releasing lock "refresh_cache-3b325f5d-481c-410e-910a-f29df36caec2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:14:27 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:14:27 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:14:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-e733574a-56ba-4e24-babd-855bcb5bda61" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:14:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-e733574a-56ba-4e24-babd-855bcb5bda61" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:14:27 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:14:28 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Updating instance_info_cache with network_info: [{"id": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "address": "fa:16:3e:8c:c0:06", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8bd92de-8e", "ovs_interfaceid": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:14:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-e733574a-56ba-4e24-babd-855bcb5bda61" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:14:28 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:14:28 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:14:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:14:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:14:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:14:28 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:14:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-40a1fcb7-3e34-410b-985e-012a29b332db tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-40a1fcb7-3e34-410b-985e-012a29b332db tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-40a1fcb7-3e34-410b-985e-012a29b332db tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-40a1fcb7-3e34-410b-985e-012a29b332db tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-40a1fcb7-3e34-410b-985e-012a29b332db tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:14:30 user nova-compute[74898]: INFO nova.compute.manager [None req-40a1fcb7-3e34-410b-985e-012a29b332db tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Terminating instance
Nov 17 03:14:30 user nova-compute[74898]: DEBUG nova.compute.manager [None req-40a1fcb7-3e34-410b-985e-012a29b332db tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG nova.compute.manager [req-0fe462b8-fc2d-4aac-88d9-435fee5348dc req-34597ff2-773b-4498-837b-5498da770d31 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Received event network-vif-unplugged-423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0fe462b8-fc2d-4aac-88d9-435fee5348dc req-34597ff2-773b-4498-837b-5498da770d31 service nova] Acquiring lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0fe462b8-fc2d-4aac-88d9-435fee5348dc req-34597ff2-773b-4498-837b-5498da770d31 service nova] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0fe462b8-fc2d-4aac-88d9-435fee5348dc req-34597ff2-773b-4498-837b-5498da770d31 service nova] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG nova.compute.manager [req-0fe462b8-fc2d-4aac-88d9-435fee5348dc req-34597ff2-773b-4498-837b-5498da770d31 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] No waiting events found dispatching network-vif-unplugged-423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG nova.compute.manager [req-0fe462b8-fc2d-4aac-88d9-435fee5348dc req-34597ff2-773b-4498-837b-5498da770d31 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Received event network-vif-unplugged-423e9165-99d6-4938-a3dc-3406806ce781 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:30 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Instance destroyed successfully.
Nov 17 03:14:30 user nova-compute[74898]: DEBUG nova.objects.instance [None req-40a1fcb7-3e34-410b-985e-012a29b332db tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lazy-loading 'resources' on Instance uuid a92bce56-1038-4762-9c1e-19b5a7ff8cef {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-40a1fcb7-3e34-410b-985e-012a29b332db tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:07:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-436984245',display_name='tempest-ServerRescueNegativeTestJSON-server-436984245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-436984245',id=24,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECdizGtive531FjE2lZPMidnS/5ohxOOHxeXR9JjL6+VkYLAxgcvmUVOdOq4w6BoU/42JviUPgFmvEUcflkqWaC438sZsa2QOwDlY96HCWN/5Qo9TFTt9fnEk6JUrhY6A==',key_name='tempest-keypair-56723668',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:10:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9ccd434df9e458f80e5524c5c4c7a1f',ramdisk_id='',reservation_id='r-k8x0ez55',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1788589536',owner_user_name='tempest-ServerRescueNegativeTestJSON-1788589536-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:11:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='303dca207b5f4da297e8ab1fc41ff466',uuid=a92bce56-1038-4762-9c1e-19b5a7ff8cef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "423e9165-99d6-4938-a3dc-3406806ce781", "address": "fa:16:3e:4a:ec:b4", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423e9165-99", "ovs_interfaceid": "423e9165-99d6-4938-a3dc-3406806ce781", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-40a1fcb7-3e34-410b-985e-012a29b332db tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Converting VIF {"id": "423e9165-99d6-4938-a3dc-3406806ce781", "address": "fa:16:3e:4a:ec:b4", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap423e9165-99", "ovs_interfaceid": "423e9165-99d6-4938-a3dc-3406806ce781", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-40a1fcb7-3e34-410b-985e-012a29b332db tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:ec:b4,bridge_name='br-int',has_traffic_filtering=True,id=423e9165-99d6-4938-a3dc-3406806ce781,network=Network(c153042b-16a0-4676-b024-f4583be62f74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap423e9165-99') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG os_vif [None req-40a1fcb7-3e34-410b-985e-012a29b332db tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:ec:b4,bridge_name='br-int',has_traffic_filtering=True,id=423e9165-99d6-4938-a3dc-3406806ce781,network=Network(c153042b-16a0-4676-b024-f4583be62f74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap423e9165-99') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap423e9165-99, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=000b9a0f-900a-4143-9271-234737c70cac) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:14:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:30 user nova-compute[74898]: INFO os_vif [None req-40a1fcb7-3e34-410b-985e-012a29b332db tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:ec:b4,bridge_name='br-int',has_traffic_filtering=True,id=423e9165-99d6-4938-a3dc-3406806ce781,network=Network(c153042b-16a0-4676-b024-f4583be62f74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap423e9165-99')
Nov 17 03:14:30 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-40a1fcb7-3e34-410b-985e-012a29b332db tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Deleting instance files /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef_del
Nov 17 03:14:30 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-40a1fcb7-3e34-410b-985e-012a29b332db tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Deletion of /opt/stack/data/nova/instances/a92bce56-1038-4762-9c1e-19b5a7ff8cef_del complete
Nov 17 03:14:31 user nova-compute[74898]: INFO nova.compute.manager [None req-40a1fcb7-3e34-410b-985e-012a29b332db tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 17 03:14:31 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-40a1fcb7-3e34-410b-985e-012a29b332db tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:14:31 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:14:31 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:14:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351b40ac-146d-49e5-b576-726493897945/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351b40ac-146d-49e5-b576-726493897945/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351b40ac-146d-49e5-b576-726493897945/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:31 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:14:32 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Took 0.95 seconds to deallocate network for instance.
Nov 17 03:14:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351b40ac-146d-49e5-b576-726493897945/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:32 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Error from libvirt while getting description of instance-00000018: [Error Code 42] Domain not found: no domain with matching uuid 'a92bce56-1038-4762-9c1e-19b5a7ff8cef' (instance-00000018): libvirt.libvirtError: Domain not found: no domain with matching uuid 'a92bce56-1038-4762-9c1e-19b5a7ff8cef' (instance-00000018)
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-40a1fcb7-3e34-410b-985e-012a29b332db tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-40a1fcb7-3e34-410b-985e-012a29b332db tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:14:32 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:14:32 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=8051MB free_disk=25.204833984375GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.compute.manager [req-276b022e-1cc1-47f2-9bd5-054e5628a8d9 req-5931030b-2174-4d3d-b707-368343fbfd97 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Received event network-vif-plugged-423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-276b022e-1cc1-47f2-9bd5-054e5628a8d9 req-5931030b-2174-4d3d-b707-368343fbfd97 service nova] Acquiring lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-276b022e-1cc1-47f2-9bd5-054e5628a8d9 req-5931030b-2174-4d3d-b707-368343fbfd97 service nova] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-276b022e-1cc1-47f2-9bd5-054e5628a8d9 req-5931030b-2174-4d3d-b707-368343fbfd97 service nova] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.compute.manager [req-276b022e-1cc1-47f2-9bd5-054e5628a8d9 req-5931030b-2174-4d3d-b707-368343fbfd97 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] No waiting events found dispatching network-vif-plugged-423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:14:32 user nova-compute[74898]: WARNING nova.compute.manager [req-276b022e-1cc1-47f2-9bd5-054e5628a8d9 req-5931030b-2174-4d3d-b707-368343fbfd97 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Received unexpected event network-vif-plugged-423e9165-99d6-4938-a3dc-3406806ce781 for instance with vm_state deleted and task_state None.
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.compute.manager [req-276b022e-1cc1-47f2-9bd5-054e5628a8d9 req-5931030b-2174-4d3d-b707-368343fbfd97 service nova] [instance: a92bce56-1038-4762-9c1e-19b5a7ff8cef] Received event network-vif-deleted-423e9165-99d6-4938-a3dc-3406806ce781 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-40a1fcb7-3e34-410b-985e-012a29b332db tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-40a1fcb7-3e34-410b-985e-012a29b332db tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-40a1fcb7-3e34-410b-985e-012a29b332db tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.312s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:14:32 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-40a1fcb7-3e34-410b-985e-012a29b332db tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Deleted allocations for instance a92bce56-1038-4762-9c1e-19b5a7ff8cef
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.compute.manager [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:14:32 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Creating image(s)
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Did not create local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Ensure instance console log exists: /opt/stack/data/nova/instances/3b325f5d-481c-410e-910a-f29df36caec2/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Start _get_guest_xml network_info=[{"id": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "address": "fa:16:3e:75:38:b0", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6303d4-23", "ovs_interfaceid": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVQaZPJS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3b325f5d-481c-410e-910a-f29df36caec2', 'attached_at': '', 'detached_at': '', 'volume_id': '274f0b23-bf75-4a48-8cb0-462cf98606e5', 'serial': '274f0b23-bf75-4a48-8cb0-462cf98606e5'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '444b1507-308c-42a7-b7ab-d6e7fd66ebcf', 'volume_type': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:14:32 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:14:32 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVQaZPJS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:14:32 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:14:32 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:14:32 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:14:32 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:14:32 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance e733574a-56ba-4e24-babd-855bcb5bda61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 42994e39-187a-4fb6-a293-24a4eb57177b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 13449e5c-809b-4db2-af0b-53f5865eb3a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance c49f4ec3-6f9b-4e14-ba29-208aa026301e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance ff69d6dd-bce4-400b-8f03-429068cf32eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 24cd7ac4-3724-4189-82a7-ba61ba46097a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 351b40ac-146d-49e5-b576-726493897945 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 3b325f5d-481c-410e-910a-f29df36caec2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-40a1fcb7-3e34-410b-985e-012a29b332db tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "a92bce56-1038-4762-9c1e-19b5a7ff8cef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.868s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[973e22d9-8834-4567-8c4d-b480f9b657df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:14:32 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd511187-087d-419b-8ab9-4d772796155a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5] added
Nov 17 03:14:32 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:14:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[170924b5-5303-44b5-9e98-85882a8d8e5e]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7235a570-a642-4856-b742-3c81aef26fd9]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nVQaZPJS {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nVQaZPJS" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4543f9-749b-474f-b478-8dc91e85623f]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nVQaZPJS'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcaa30e7-2ca8-4701-9847-73cd80434287]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbeba430-e7bc-49a9-9126-e63f5861088c]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:14:33 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:14:33 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f265753-8553-4d52-bfa4-8e49d8623401]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5, portal: 172.16.0.220,3260]
Nov 17 03:14:33 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5, portal: 172.16.0.220,3260] successful.
Nov 17 03:14:33 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b70fe00-f2e8-45bc-9215-406b208ba460]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9556bac5-e7af-4651-84ae-02972e26a8ed]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:14:33 user nova-compute[74898]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:14:33 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:14:33 user nova-compute[74898]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:14:33 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d67925-f7da-4e6b-ae1d-0d39b8416ac4]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVQaZPJS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:14:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.488s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:14:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:14:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26562303434646365', 'path': '/dev/sdb'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:14:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562303434646365', 'path': '/dev/sdb'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:14:34 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:14:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1434129510',display_name='tempest-ServerActionsTestOtherA-server-1434129510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1434129510',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGXK5tLG9vQRvq8SJwGRy2Vz7FVpdMueKXoroRQhoaTXP+S/vHTHRNXWHjGdbL7ZfWa7nQ7EpuIvdSjNY8pD+Io25QXwMjrtjgT3+jZPylEXHxX7Pj0OQhFvC17oY0/CA==',key_name='tempest-keypair-1226860529',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ff82629b7d7486a86574994974fabda',ramdisk_id='',reservation_id='r-kppu8s8d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-214359699',owner_user_name='tempest-ServerActionsTestOtherA-214359699-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:14:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28445b2b2360414bac2607ec94166369',uuid=3b325f5d-481c-410e-910a-f29df36caec2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "address": "fa:16:3e:75:38:b0", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6303d4-23", "ovs_interfaceid": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:14:34 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Converting VIF {"id": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "address": "fa:16:3e:75:38:b0", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6303d4-23", "ovs_interfaceid": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:14:34 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:38:b0,bridge_name='br-int',has_traffic_filtering=True,id=cc6303d4-2332-4907-a0b1-7a4bf175282d,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc6303d4-23') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:14:34 user nova-compute[74898]: DEBUG nova.objects.instance [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b325f5d-481c-410e-910a-f29df36caec2 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:14:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:14:34 user nova-compute[74898]:   <uuid>3b325f5d-481c-410e-910a-f29df36caec2</uuid>
Nov 17 03:14:34 user nova-compute[74898]:   <name>instance-0000001e</name>
Nov 17 03:14:34 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:14:34 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:14:34 user nova-compute[74898]:   <metadata>
Nov 17 03:14:34 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:14:34 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:14:34 user nova-compute[74898]:       <nova:name>tempest-ServerActionsTestOtherA-server-1434129510</nova:name>
Nov 17 03:14:34 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:14:32</nova:creationTime>
Nov 17 03:14:34 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:14:34 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:14:34 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:14:34 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:14:34 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:14:34 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:14:34 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:14:34 user nova-compute[74898]:       <nova:owner>
Nov 17 03:14:34 user nova-compute[74898]:         <nova:user uuid="28445b2b2360414bac2607ec94166369">tempest-ServerActionsTestOtherA-214359699-project-member</nova:user>
Nov 17 03:14:34 user nova-compute[74898]:         <nova:project uuid="4ff82629b7d7486a86574994974fabda">tempest-ServerActionsTestOtherA-214359699</nova:project>
Nov 17 03:14:34 user nova-compute[74898]:       </nova:owner>
Nov 17 03:14:34 user nova-compute[74898]:       <nova:ports>
Nov 17 03:14:34 user nova-compute[74898]:         <nova:port uuid="cc6303d4-2332-4907-a0b1-7a4bf175282d">
Nov 17 03:14:34 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 17 03:14:34 user nova-compute[74898]:         </nova:port>
Nov 17 03:14:34 user nova-compute[74898]:       </nova:ports>
Nov 17 03:14:34 user nova-compute[74898]:     </nova:instance>
Nov 17 03:14:34 user nova-compute[74898]:   </metadata>
Nov 17 03:14:34 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:14:34 user nova-compute[74898]:     <system>
Nov 17 03:14:34 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:14:34 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:14:34 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:14:34 user nova-compute[74898]:       <entry name="serial">3b325f5d-481c-410e-910a-f29df36caec2</entry>
Nov 17 03:14:34 user nova-compute[74898]:       <entry name="uuid">3b325f5d-481c-410e-910a-f29df36caec2</entry>
Nov 17 03:14:34 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:14:34 user nova-compute[74898]:     </system>
Nov 17 03:14:34 user nova-compute[74898]:   </sysinfo>
Nov 17 03:14:34 user nova-compute[74898]:   <os>
Nov 17 03:14:34 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:14:34 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:14:34 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:14:34 user nova-compute[74898]:   </os>
Nov 17 03:14:34 user nova-compute[74898]:   <features>
Nov 17 03:14:34 user nova-compute[74898]:     <acpi/>
Nov 17 03:14:34 user nova-compute[74898]:     <apic/>
Nov 17 03:14:34 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:14:34 user nova-compute[74898]:   </features>
Nov 17 03:14:34 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:14:34 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:14:34 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:14:34 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:14:34 user nova-compute[74898]:   </clock>
Nov 17 03:14:34 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:14:34 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:14:34 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:14:34 user nova-compute[74898]:   </cpu>
Nov 17 03:14:34 user nova-compute[74898]:   <devices>
Nov 17 03:14:34 user nova-compute[74898]:     <disk type="block" device="disk">
Nov 17 03:14:34 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:14:34 user nova-compute[74898]:       <source dev="/dev/sdb"/>
Nov 17 03:14:34 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:14:34 user nova-compute[74898]:       <serial>274f0b23-bf75-4a48-8cb0-462cf98606e5</serial>
Nov 17 03:14:34 user nova-compute[74898]:     </disk>
Nov 17 03:14:34 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:14:34 user nova-compute[74898]:       <mac address="fa:16:3e:75:38:b0"/>
Nov 17 03:14:34 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:14:34 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:14:34 user nova-compute[74898]:       <target dev="tapcc6303d4-23"/>
Nov 17 03:14:34 user nova-compute[74898]:     </interface>
Nov 17 03:14:34 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:14:34 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/3b325f5d-481c-410e-910a-f29df36caec2/console.log" append="off"/>
Nov 17 03:14:34 user nova-compute[74898]:     </serial>
Nov 17 03:14:34 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:14:34 user nova-compute[74898]:     <video>
Nov 17 03:14:34 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:14:34 user nova-compute[74898]:     </video>
Nov 17 03:14:34 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:14:34 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:14:34 user nova-compute[74898]:     </rng>
Nov 17 03:14:34 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:14:34 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:14:34 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:14:34 user nova-compute[74898]:     </memballoon>
Nov 17 03:14:34 user nova-compute[74898]:   </devices>
Nov 17 03:14:34 user nova-compute[74898]: </domain>
Nov 17 03:14:34 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:14:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1434129510',display_name='tempest-ServerActionsTestOtherA-server-1434129510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1434129510',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGXK5tLG9vQRvq8SJwGRy2Vz7FVpdMueKXoroRQhoaTXP+S/vHTHRNXWHjGdbL7ZfWa7nQ7EpuIvdSjNY8pD+Io25QXwMjrtjgT3+jZPylEXHxX7Pj0OQhFvC17oY0/CA==',key_name='tempest-keypair-1226860529',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ff82629b7d7486a86574994974fabda',ramdisk_id='',reservation_id='r-kppu8s8d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-214359699',owner_user_name='tempest-ServerActionsTestOtherA-214359699-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:14:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28445b2b2360414bac2607ec94166369',uuid=3b325f5d-481c-410e-910a-f29df36caec2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "address": "fa:16:3e:75:38:b0", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6303d4-23", "ovs_interfaceid": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:14:34 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Converting VIF {"id": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "address": "fa:16:3e:75:38:b0", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6303d4-23", "ovs_interfaceid": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:14:34 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:38:b0,bridge_name='br-int',has_traffic_filtering=True,id=cc6303d4-2332-4907-a0b1-7a4bf175282d,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc6303d4-23') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:14:34 user nova-compute[74898]: DEBUG os_vif [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:38:b0,bridge_name='br-int',has_traffic_filtering=True,id=cc6303d4-2332-4907-a0b1-7a4bf175282d,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc6303d4-23') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:14:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:14:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:14:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0778678a-75ef-5279-98fe-7d2559c26f4b', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:14:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:14:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc6303d4-23, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:14:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc6303d4-23, col_values=(('qos', UUID('11222545-9a32-4067-b212-2356da58841e')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:14:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc6303d4-23, col_values=(('external_ids', {'iface-id': 'cc6303d4-2332-4907-a0b1-7a4bf175282d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:38:b0', 'vm-uuid': '3b325f5d-481c-410e-910a-f29df36caec2'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:14:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:14:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:34 user nova-compute[74898]: INFO os_vif [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:38:b0,bridge_name='br-int',has_traffic_filtering=True,id=cc6303d4-2332-4907-a0b1-7a4bf175282d,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc6303d4-23')
Nov 17 03:14:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:14:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] No VIF found with MAC fa:16:3e:75:38:b0, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:14:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:35 user nova-compute[74898]: DEBUG nova.compute.manager [req-e8a0369b-7c0b-4807-adfb-7cbceb3beaff req-607a96d1-6854-4d47-9a68-c8ffca4ac0f0 service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Received event network-vif-plugged-cc6303d4-2332-4907-a0b1-7a4bf175282d {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:14:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e8a0369b-7c0b-4807-adfb-7cbceb3beaff req-607a96d1-6854-4d47-9a68-c8ffca4ac0f0 service nova] Acquiring lock "3b325f5d-481c-410e-910a-f29df36caec2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:14:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e8a0369b-7c0b-4807-adfb-7cbceb3beaff req-607a96d1-6854-4d47-9a68-c8ffca4ac0f0 service nova] Lock "3b325f5d-481c-410e-910a-f29df36caec2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:14:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e8a0369b-7c0b-4807-adfb-7cbceb3beaff req-607a96d1-6854-4d47-9a68-c8ffca4ac0f0 service nova] Lock "3b325f5d-481c-410e-910a-f29df36caec2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:14:35 user nova-compute[74898]: DEBUG nova.compute.manager [req-e8a0369b-7c0b-4807-adfb-7cbceb3beaff req-607a96d1-6854-4d47-9a68-c8ffca4ac0f0 service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] No waiting events found dispatching network-vif-plugged-cc6303d4-2332-4907-a0b1-7a4bf175282d {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:14:35 user nova-compute[74898]: WARNING nova.compute.manager [req-e8a0369b-7c0b-4807-adfb-7cbceb3beaff req-607a96d1-6854-4d47-9a68-c8ffca4ac0f0 service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Received unexpected event network-vif-plugged-cc6303d4-2332-4907-a0b1-7a4bf175282d for instance with vm_state building and task_state spawning.
Nov 17 03:14:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:37 user nova-compute[74898]: DEBUG nova.compute.manager [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:14:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:14:37 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Instance spawned successfully.
Nov 17 03:14:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:14:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:14:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:14:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:14:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:14:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:14:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:14:37 user nova-compute[74898]: INFO nova.compute.manager [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Took 5.12 seconds to spawn the instance on the hypervisor.
Nov 17 03:14:37 user nova-compute[74898]: DEBUG nova.compute.manager [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:14:38 user nova-compute[74898]: DEBUG nova.compute.manager [req-49b94678-e428-414d-8204-7d8bf1187633 req-282af46d-e7dc-4139-9d3d-9053e595912a service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Received event network-vif-plugged-cc6303d4-2332-4907-a0b1-7a4bf175282d {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:14:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-49b94678-e428-414d-8204-7d8bf1187633 req-282af46d-e7dc-4139-9d3d-9053e595912a service nova] Acquiring lock "3b325f5d-481c-410e-910a-f29df36caec2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:14:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-49b94678-e428-414d-8204-7d8bf1187633 req-282af46d-e7dc-4139-9d3d-9053e595912a service nova] Lock "3b325f5d-481c-410e-910a-f29df36caec2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:14:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-49b94678-e428-414d-8204-7d8bf1187633 req-282af46d-e7dc-4139-9d3d-9053e595912a service nova] Lock "3b325f5d-481c-410e-910a-f29df36caec2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:14:38 user nova-compute[74898]: DEBUG nova.compute.manager [req-49b94678-e428-414d-8204-7d8bf1187633 req-282af46d-e7dc-4139-9d3d-9053e595912a service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] No waiting events found dispatching network-vif-plugged-cc6303d4-2332-4907-a0b1-7a4bf175282d {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:14:38 user nova-compute[74898]: WARNING nova.compute.manager [req-49b94678-e428-414d-8204-7d8bf1187633 req-282af46d-e7dc-4139-9d3d-9053e595912a service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Received unexpected event network-vif-plugged-cc6303d4-2332-4907-a0b1-7a4bf175282d for instance with vm_state building and task_state spawning.
Nov 17 03:14:38 user nova-compute[74898]: INFO nova.compute.manager [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Took 13.21 seconds to build instance.
Nov 17 03:14:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-943e4bff-f8e2-4f90-a187-017f8d967630 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "3b325f5d-481c-410e-910a-f29df36caec2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.297s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:14:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:14:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:05 user nova-compute[74898]: DEBUG nova.compute.manager [req-8450b80b-00d5-4006-acdf-329f0dbab6f2 req-b9796964-7b71-46cd-829f-4de9bf3c9683 service nova] [instance: 351b40ac-146d-49e5-b576-726493897945] Received event network-changed-7a94312f-9d65-4b04-874e-21bcdb6750f7 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:15:05 user nova-compute[74898]: DEBUG nova.compute.manager [req-8450b80b-00d5-4006-acdf-329f0dbab6f2 req-b9796964-7b71-46cd-829f-4de9bf3c9683 service nova] [instance: 351b40ac-146d-49e5-b576-726493897945] Refreshing instance network info cache due to event network-changed-7a94312f-9d65-4b04-874e-21bcdb6750f7. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:15:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8450b80b-00d5-4006-acdf-329f0dbab6f2 req-b9796964-7b71-46cd-829f-4de9bf3c9683 service nova] Acquiring lock "refresh_cache-351b40ac-146d-49e5-b576-726493897945" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:15:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8450b80b-00d5-4006-acdf-329f0dbab6f2 req-b9796964-7b71-46cd-829f-4de9bf3c9683 service nova] Acquired lock "refresh_cache-351b40ac-146d-49e5-b576-726493897945" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:15:05 user nova-compute[74898]: DEBUG nova.network.neutron [req-8450b80b-00d5-4006-acdf-329f0dbab6f2 req-b9796964-7b71-46cd-829f-4de9bf3c9683 service nova] [instance: 351b40ac-146d-49e5-b576-726493897945] Refreshing network info cache for port 7a94312f-9d65-4b04-874e-21bcdb6750f7 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:15:06 user nova-compute[74898]: DEBUG nova.network.neutron [req-8450b80b-00d5-4006-acdf-329f0dbab6f2 req-b9796964-7b71-46cd-829f-4de9bf3c9683 service nova] [instance: 351b40ac-146d-49e5-b576-726493897945] Updated VIF entry in instance network info cache for port 7a94312f-9d65-4b04-874e-21bcdb6750f7. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:15:06 user nova-compute[74898]: DEBUG nova.network.neutron [req-8450b80b-00d5-4006-acdf-329f0dbab6f2 req-b9796964-7b71-46cd-829f-4de9bf3c9683 service nova] [instance: 351b40ac-146d-49e5-b576-726493897945] Updating instance_info_cache with network_info: [{"id": "7a94312f-9d65-4b04-874e-21bcdb6750f7", "address": "fa:16:3e:ea:3b:50", "network": {"id": "cf23170a-1954-4a5c-a124-22dc9421cf7a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1758456257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6ad65d3ca604b36926e90f682f95354", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a94312f-9d", "ovs_interfaceid": "7a94312f-9d65-4b04-874e-21bcdb6750f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:15:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8450b80b-00d5-4006-acdf-329f0dbab6f2 req-b9796964-7b71-46cd-829f-4de9bf3c9683 service nova] Releasing lock "refresh_cache-351b40ac-146d-49e5-b576-726493897945" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:15:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Acquiring lock "351b40ac-146d-49e5-b576-726493897945" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:15:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lock "351b40ac-146d-49e5-b576-726493897945" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:15:09 user nova-compute[74898]: DEBUG nova.objects.instance [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lazy-loading 'flavor' on Instance uuid 351b40ac-146d-49e5-b576-726493897945 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:15:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lock "351b40ac-146d-49e5-b576-726493897945" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:15:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Acquiring lock "351b40ac-146d-49e5-b576-726493897945" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:15:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lock "351b40ac-146d-49e5-b576-726493897945" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:15:09 user nova-compute[74898]: INFO nova.compute.manager [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Attaching volume c6d17d0d-c197-42a9-90af-9df87be5bd7d to /dev/vdb
Nov 17 03:15:09 user nova-compute[74898]: DEBUG os_brick.utils [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:15:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e41e46-f58a-4d82-9f4f-e6171c6319d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:15:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[576cee8b-fa11-4279-a2e8-a456c377fcdd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:15:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4436b566-8463-48a0-8ff9-15b15192621b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:15:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f6e743-6707-4621-a294-efdabd94df15]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:15:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:15:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:15:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:15:09 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:15:09 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5995c5e6-776f-4bdc-9c2a-4b90530dc068]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:15:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:15:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:15:09 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:15:09 user nova-compute[74898]: DEBUG os_brick.utils [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:15:09 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Updating existing volume attachment record: 8124f9db-00f8-4d26-b451-d71d742666e0 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:15:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:14 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'igPJodzT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:15:15 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:15:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:15:15 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:15:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:15:15 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e69b6c-5f3a-402e-be8e-e12f1c06b618]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:15:15 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db6d99d-e884-48c1-bf40-f00335a741bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d] added
Nov 17 03:15:15 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e58637-ab93-48fa-b682-f24e476a3ace]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f02e3cf-0caf-426f-a9eb-5643f40dc52c]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v igPJodzT {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v igPJodzT" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fd5d66-b17e-4d1e-ad86-2f948890dc1d]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'igPJodzT'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[123ab2a1-b98c-4f47-8e2f-5a97fed30ac0]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[687cac0b-70f4-45e0-a5b2-363944808752]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:15:15 user nova-compute[74898]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:15:15 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:15:15 user nova-compute[74898]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:15:15 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c980cce3-025c-4456-a22c-3cd4f33c84db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d, portal: 172.16.0.220,3260]
Nov 17 03:15:15 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d, portal: 172.16.0.220,3260] successful.
Nov 17 03:15:15 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f6ee20-a55d-4d74-9006-f1da120bf43e]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ade578-239a-4e8a-a779-b226f8cbe426]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:15:15 user nova-compute[74898]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:15:15 user nova-compute[74898]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d (non-flash)
Nov 17 03:15:15 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:15:15 user nova-compute[74898]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:15:15 user nova-compute[74898]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d (non-flash)
Nov 17 03:15:15 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[083c980a-d5de-49e2-b56b-e2584f7732da]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:15:15 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: None {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:15:16 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:16 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:15:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'igPJodzT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:15:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:15:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '23763386563346662', 'path': '/dev/sdd'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:15:16 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763386563346662', 'path': '/dev/sdd'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:15:16 user nova-compute[74898]: DEBUG nova.objects.instance [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lazy-loading 'flavor' on Instance uuid 351b40ac-146d-49e5-b576-726493897945 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:15:16 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 03:15:16 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:15:16 user nova-compute[74898]:   <source dev="/dev/sdd"/>
Nov 17 03:15:16 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:15:16 user nova-compute[74898]:   <serial>c6d17d0d-c197-42a9-90af-9df87be5bd7d</serial>
Nov 17 03:15:16 user nova-compute[74898]: </disk>
Nov 17 03:15:16 user nova-compute[74898]:  {{(pid=74898) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 03:15:16 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:15:16 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:15:16 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] No VIF found with MAC fa:16:3e:ea:3b:50, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:15:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-89fef2c4-37ce-4e57-aeb0-aa429445e939 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lock "351b40ac-146d-49e5-b576-726493897945" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.188s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:15:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "ecb90e79-877e-4012-b569-53aefd96de38" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:15:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "ecb90e79-877e-4012-b569-53aefd96de38" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:15:17 user nova-compute[74898]: INFO nova.compute.manager [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Unshelving
Nov 17 03:15:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:15:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:15:17 user nova-compute[74898]: DEBUG nova.objects.instance [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lazy-loading 'pci_requests' on Instance uuid ecb90e79-877e-4012-b569-53aefd96de38 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:15:17 user nova-compute[74898]: DEBUG nova.objects.instance [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lazy-loading 'numa_topology' on Instance uuid ecb90e79-877e-4012-b569-53aefd96de38 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:15:17 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:15:17 user nova-compute[74898]: INFO nova.compute.claims [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Claim successful on node user
Nov 17 03:15:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Acquiring lock "351b40ac-146d-49e5-b576-726493897945" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:15:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lock "351b40ac-146d-49e5-b576-726493897945" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:15:17 user nova-compute[74898]: INFO nova.compute.manager [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Detaching volume c6d17d0d-c197-42a9-90af-9df87be5bd7d
Nov 17 03:15:17 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:15:18 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:15:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:15:18 user nova-compute[74898]: INFO nova.virt.block_device [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Attempting to driver detach volume c6d17d0d-c197-42a9-90af-9df87be5bd7d from mountpoint /dev/vdb
Nov 17 03:15:18 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Attempting to detach device vdb from instance 351b40ac-146d-49e5-b576-726493897945 from the persistent domain config. {{(pid=74898) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 03:15:18 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:15:18 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:15:18 user nova-compute[74898]:   <source dev="/dev/sdd"/>
Nov 17 03:15:18 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:15:18 user nova-compute[74898]:   <serial>c6d17d0d-c197-42a9-90af-9df87be5bd7d</serial>
Nov 17 03:15:18 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:15:18 user nova-compute[74898]: </disk>
Nov 17 03:15:18 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:15:18 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Successfully detached device vdb from instance 351b40ac-146d-49e5-b576-726493897945 from the persistent domain config.
Nov 17 03:15:18 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 351b40ac-146d-49e5-b576-726493897945 from the live domain config. {{(pid=74898) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 03:15:18 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:15:18 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:15:18 user nova-compute[74898]:   <source dev="/dev/sdd"/>
Nov 17 03:15:18 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:15:18 user nova-compute[74898]:   <serial>c6d17d0d-c197-42a9-90af-9df87be5bd7d</serial>
Nov 17 03:15:18 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:15:18 user nova-compute[74898]: </disk>
Nov 17 03:15:18 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:15:18 user nova-compute[74898]: INFO nova.network.neutron [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Updating port 794c112e-9370-4bcc-9fc1-51a9c3b692e1 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 17 03:15:18 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 351b40ac-146d-49e5-b576-726493897945 {{(pid=74898) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 03:15:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "refresh_cache-ecb90e79-877e-4012-b569-53aefd96de38" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:15:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquired lock "refresh_cache-ecb90e79-877e-4012-b569-53aefd96de38" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:15:18 user nova-compute[74898]: DEBUG nova.network.neutron [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:15:18 user nova-compute[74898]: DEBUG nova.compute.manager [req-f374f235-bd97-4313-8946-925cd5c31e75 req-e746adae-bf1c-46a9-81d9-c747c6e6575e service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Received event network-changed-794c112e-9370-4bcc-9fc1-51a9c3b692e1 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:15:18 user nova-compute[74898]: DEBUG nova.compute.manager [req-f374f235-bd97-4313-8946-925cd5c31e75 req-e746adae-bf1c-46a9-81d9-c747c6e6575e service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Refreshing instance network info cache due to event network-changed-794c112e-9370-4bcc-9fc1-51a9c3b692e1. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:15:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f374f235-bd97-4313-8946-925cd5c31e75 req-e746adae-bf1c-46a9-81d9-c747c6e6575e service nova] Acquiring lock "refresh_cache-ecb90e79-877e-4012-b569-53aefd96de38" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:15:19 user nova-compute[74898]: DEBUG nova.network.neutron [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Updating instance_info_cache with network_info: [{"id": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "address": "fa:16:3e:bd:21:91", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794c112e-93", "ovs_interfaceid": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:15:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Releasing lock "refresh_cache-ecb90e79-877e-4012-b569-53aefd96de38" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:15:19 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:15:19 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Creating image(s)
Nov 17 03:15:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "/opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:15:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "/opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:15:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "/opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:15:19 user nova-compute[74898]: DEBUG nova.objects.instance [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lazy-loading 'trusted_certs' on Instance uuid ecb90e79-877e-4012-b569-53aefd96de38 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:15:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f374f235-bd97-4313-8946-925cd5c31e75 req-e746adae-bf1c-46a9-81d9-c747c6e6575e service nova] Acquired lock "refresh_cache-ecb90e79-877e-4012-b569-53aefd96de38" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:15:19 user nova-compute[74898]: DEBUG nova.network.neutron [req-f374f235-bd97-4313-8946-925cd5c31e75 req-e746adae-bf1c-46a9-81d9-c747c6e6575e service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Refreshing network info cache for port 794c112e-9370-4bcc-9fc1-51a9c3b692e1 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:15:19 user nova-compute[74898]: DEBUG nova.objects.base [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Object Instance<ecb90e79-877e-4012-b569-53aefd96de38> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:15:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "0929fa02f5f33c5127bc0bd838685689c5957988" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:15:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "0929fa02f5f33c5127bc0bd838685689c5957988" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:15:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0929fa02f5f33c5127bc0bd838685689c5957988.part --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0929fa02f5f33c5127bc0bd838685689c5957988.part --force-share --output=json" returned: 0 in 0.193s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:20 user nova-compute[74898]: DEBUG nova.virt.images [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] 1919d592-85f7-4aaf-bf97-932335eb7de7 was qcow2, converting to raw {{(pid=74898) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 17 03:15:20 user nova-compute[74898]: DEBUG nova.privsep.utils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74898) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 03:15:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0929fa02f5f33c5127bc0bd838685689c5957988.part /opt/stack/data/nova/instances/_base/0929fa02f5f33c5127bc0bd838685689c5957988.converted {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:21 user nova-compute[74898]: DEBUG nova.network.neutron [req-f374f235-bd97-4313-8946-925cd5c31e75 req-e746adae-bf1c-46a9-81d9-c747c6e6575e service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Updated VIF entry in instance network info cache for port 794c112e-9370-4bcc-9fc1-51a9c3b692e1. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:15:21 user nova-compute[74898]: DEBUG nova.network.neutron [req-f374f235-bd97-4313-8946-925cd5c31e75 req-e746adae-bf1c-46a9-81d9-c747c6e6575e service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Updating instance_info_cache with network_info: [{"id": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "address": "fa:16:3e:bd:21:91", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794c112e-93", "ovs_interfaceid": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:15:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f374f235-bd97-4313-8946-925cd5c31e75 req-e746adae-bf1c-46a9-81d9-c747c6e6575e service nova] Releasing lock "refresh_cache-ecb90e79-877e-4012-b569-53aefd96de38" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:15:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0929fa02f5f33c5127bc0bd838685689c5957988.part /opt/stack/data/nova/instances/_base/0929fa02f5f33c5127bc0bd838685689c5957988.converted" returned: 0 in 0.600s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0929fa02f5f33c5127bc0bd838685689c5957988.converted --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0929fa02f5f33c5127bc0bd838685689c5957988.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "0929fa02f5f33c5127bc0bd838685689c5957988" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.242s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:15:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0929fa02f5f33c5127bc0bd838685689c5957988 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0929fa02f5f33c5127bc0bd838685689c5957988 --force-share --output=json" returned: 0 in 0.183s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "0929fa02f5f33c5127bc0bd838685689c5957988" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:15:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "0929fa02f5f33c5127bc0bd838685689c5957988" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:15:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0929fa02f5f33c5127bc0bd838685689c5957988 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0929fa02f5f33c5127bc0bd838685689c5957988 --force-share --output=json" returned: 0 in 0.169s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0929fa02f5f33c5127bc0bd838685689c5957988,backing_fmt=raw /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0929fa02f5f33c5127bc0bd838685689c5957988,backing_fmt=raw /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk 1073741824" returned: 0 in 0.047s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "0929fa02f5f33c5127bc0bd838685689c5957988" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:15:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0929fa02f5f33c5127bc0bd838685689c5957988 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0929fa02f5f33c5127bc0bd838685689c5957988 --force-share --output=json" returned: 0 in 0.175s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:21 user nova-compute[74898]: DEBUG nova.objects.instance [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lazy-loading 'migration_context' on Instance uuid ecb90e79-877e-4012-b569-53aefd96de38 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:15:21 user nova-compute[74898]: DEBUG nova.objects.base [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Object Instance<ecb90e79-877e-4012-b569-53aefd96de38> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:15:21 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Rebasing disk image.
Nov 17 03:15:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.175s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 -F raw /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:22 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:15:22 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:15:23 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 -F raw /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk" returned: 0 in 2.448s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Ensure instance console log exists: /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Start _get_guest_xml network_info=[{"id": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "address": "fa:16:3e:bd:21:91", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794c112e-93", "ovs_interfaceid": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c12a38eabb8a106183bcd59c9579198a',container_format='bare',created_at=2023-11-17T03:13:25Z,direct_url=<?>,disk_format='qcow2',id=1919d592-85f7-4aaf-bf97-932335eb7de7,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2100741292-shelved',owner='3de7d05d475c49f0805f5aab5853a0b2',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-17T03:13:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:15:24 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:15:24 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c12a38eabb8a106183bcd59c9579198a',container_format='bare',created_at=2023-11-17T03:13:25Z,direct_url=<?>,disk_format='qcow2',id=1919d592-85f7-4aaf-bf97-932335eb7de7,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2100741292-shelved',owner='3de7d05d475c49f0805f5aab5853a0b2',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-17T03:13:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.objects.instance [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lazy-loading 'vcpu_model' on Instance uuid ecb90e79-877e-4012-b569-53aefd96de38 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.objects.base [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Object Instance<ecb90e79-877e-4012-b569-53aefd96de38> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-17T03:11:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2100741292',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2100741292',id=28,image_ref='1919d592-85f7-4aaf-bf97-932335eb7de7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-301754943',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:11:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3de7d05d475c49f0805f5aab5853a0b2',ramdisk_id='',reservation_id='r-plwophpo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-940982522',owner_user_name='tempest-AttachVolumeShelveTestJSON-940982522-project-member',shelved_at='2023-11-17T03:13:28.988123',shelved_host='user',shelved_image_id='1919d592-85f7-4aaf-bf97-932335eb7de7'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:15:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='926d8bd27eb24824a71cb9f1969f9c45',uuid=ecb90e79-877e-4012-b569-53aefd96de38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "address": "fa:16:3e:bd:21:91", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794c112e-93", "ovs_interfaceid": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Converting VIF {"id": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "address": "fa:16:3e:bd:21:91", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794c112e-93", "ovs_interfaceid": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:21:91,bridge_name='br-int',has_traffic_filtering=True,id=794c112e-9370-4bcc-9fc1-51a9c3b692e1,network=Network(c92bc72d-7b33-49a8-96e5-ca2ed117fa48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap794c112e-93') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.objects.instance [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lazy-loading 'pci_devices' on Instance uuid ecb90e79-877e-4012-b569-53aefd96de38 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.objects.base [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Object Instance<ecb90e79-877e-4012-b569-53aefd96de38> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:15:24 user nova-compute[74898]:   <uuid>ecb90e79-877e-4012-b569-53aefd96de38</uuid>
Nov 17 03:15:24 user nova-compute[74898]:   <name>instance-0000001c</name>
Nov 17 03:15:24 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:15:24 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:15:24 user nova-compute[74898]:   <metadata>
Nov 17 03:15:24 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:15:24 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:15:24 user nova-compute[74898]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2100741292</nova:name>
Nov 17 03:15:24 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:15:24</nova:creationTime>
Nov 17 03:15:24 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:15:24 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:15:24 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:15:24 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:15:24 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:15:24 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:15:24 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:15:24 user nova-compute[74898]:       <nova:owner>
Nov 17 03:15:24 user nova-compute[74898]:         <nova:user uuid="926d8bd27eb24824a71cb9f1969f9c45">tempest-AttachVolumeShelveTestJSON-940982522-project-member</nova:user>
Nov 17 03:15:24 user nova-compute[74898]:         <nova:project uuid="3de7d05d475c49f0805f5aab5853a0b2">tempest-AttachVolumeShelveTestJSON-940982522</nova:project>
Nov 17 03:15:24 user nova-compute[74898]:       </nova:owner>
Nov 17 03:15:24 user nova-compute[74898]:       <nova:root type="image" uuid="1919d592-85f7-4aaf-bf97-932335eb7de7"/>
Nov 17 03:15:24 user nova-compute[74898]:       <nova:ports>
Nov 17 03:15:24 user nova-compute[74898]:         <nova:port uuid="794c112e-9370-4bcc-9fc1-51a9c3b692e1">
Nov 17 03:15:24 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 17 03:15:24 user nova-compute[74898]:         </nova:port>
Nov 17 03:15:24 user nova-compute[74898]:       </nova:ports>
Nov 17 03:15:24 user nova-compute[74898]:     </nova:instance>
Nov 17 03:15:24 user nova-compute[74898]:   </metadata>
Nov 17 03:15:24 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:15:24 user nova-compute[74898]:     <system>
Nov 17 03:15:24 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:15:24 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:15:24 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:15:24 user nova-compute[74898]:       <entry name="serial">ecb90e79-877e-4012-b569-53aefd96de38</entry>
Nov 17 03:15:24 user nova-compute[74898]:       <entry name="uuid">ecb90e79-877e-4012-b569-53aefd96de38</entry>
Nov 17 03:15:24 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:15:24 user nova-compute[74898]:     </system>
Nov 17 03:15:24 user nova-compute[74898]:   </sysinfo>
Nov 17 03:15:24 user nova-compute[74898]:   <os>
Nov 17 03:15:24 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:15:24 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:15:24 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:15:24 user nova-compute[74898]:   </os>
Nov 17 03:15:24 user nova-compute[74898]:   <features>
Nov 17 03:15:24 user nova-compute[74898]:     <acpi/>
Nov 17 03:15:24 user nova-compute[74898]:     <apic/>
Nov 17 03:15:24 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:15:24 user nova-compute[74898]:   </features>
Nov 17 03:15:24 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:15:24 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:15:24 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:15:24 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:15:24 user nova-compute[74898]:   </clock>
Nov 17 03:15:24 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:15:24 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:15:24 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:15:24 user nova-compute[74898]:   </cpu>
Nov 17 03:15:24 user nova-compute[74898]:   <devices>
Nov 17 03:15:24 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:15:24 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:15:24 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk"/>
Nov 17 03:15:24 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:15:24 user nova-compute[74898]:     </disk>
Nov 17 03:15:24 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:15:24 user nova-compute[74898]:       <mac address="fa:16:3e:bd:21:91"/>
Nov 17 03:15:24 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:15:24 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:15:24 user nova-compute[74898]:       <target dev="tap794c112e-93"/>
Nov 17 03:15:24 user nova-compute[74898]:     </interface>
Nov 17 03:15:24 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:15:24 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/console.log" append="off"/>
Nov 17 03:15:24 user nova-compute[74898]:     </serial>
Nov 17 03:15:24 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:15:24 user nova-compute[74898]:     <video>
Nov 17 03:15:24 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:15:24 user nova-compute[74898]:     </video>
Nov 17 03:15:24 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:15:24 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:15:24 user nova-compute[74898]:     </rng>
Nov 17 03:15:24 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:15:24 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:15:24 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:15:24 user nova-compute[74898]:     </memballoon>
Nov 17 03:15:24 user nova-compute[74898]:   </devices>
Nov 17 03:15:24 user nova-compute[74898]: </domain>
Nov 17 03:15:24 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-17T03:11:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2100741292',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2100741292',id=28,image_ref='1919d592-85f7-4aaf-bf97-932335eb7de7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-301754943',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:11:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3de7d05d475c49f0805f5aab5853a0b2',ramdisk_id='',reservation_id='r-plwophpo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-940982522',owner_user_name='tempest-AttachVolumeShelveTestJSON-940982522-project-member',shelved_at='2023-11-17T03:13:28.988123',shelved_host='user',shelved_image_id='1919d592-85f7-4aaf-bf97-932335eb7de7'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:15:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='926d8bd27eb24824a71cb9f1969f9c45',uuid=ecb90e79-877e-4012-b569-53aefd96de38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "address": "fa:16:3e:bd:21:91", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794c112e-93", "ovs_interfaceid": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Converting VIF {"id": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "address": "fa:16:3e:bd:21:91", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794c112e-93", "ovs_interfaceid": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:21:91,bridge_name='br-int',has_traffic_filtering=True,id=794c112e-9370-4bcc-9fc1-51a9c3b692e1,network=Network(c92bc72d-7b33-49a8-96e5-ca2ed117fa48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap794c112e-93') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG os_vif [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:21:91,bridge_name='br-int',has_traffic_filtering=True,id=794c112e-9370-4bcc-9fc1-51a9c3b692e1,network=Network(c92bc72d-7b33-49a8-96e5-ca2ed117fa48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap794c112e-93') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a2a3e6c-cf85-5f35-8ce1-eccd02d71d00', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap794c112e-93, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap794c112e-93, col_values=(('qos', UUID('24fb3338-6cbc-4be9-adfc-4f96bbc6c392')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap794c112e-93, col_values=(('external_ids', {'iface-id': '794c112e-9370-4bcc-9fc1-51a9c3b692e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:21:91', 'vm-uuid': 'ecb90e79-877e-4012-b569-53aefd96de38'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:24 user nova-compute[74898]: INFO os_vif [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:21:91,bridge_name='br-int',has_traffic_filtering=True,id=794c112e-9370-4bcc-9fc1-51a9c3b692e1,network=Network(c92bc72d-7b33-49a8-96e5-ca2ed117fa48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap794c112e-93')
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:15:24 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] No VIF found with MAC fa:16:3e:bd:21:91, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:15:25 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:15:25 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:15:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:26 user nova-compute[74898]: DEBUG nova.compute.manager [req-8cad30be-9fe5-4a38-92b7-19b6ae8c41e1 req-25438a91-3971-467a-ab81-4b11f9fce713 service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Received event network-vif-plugged-794c112e-9370-4bcc-9fc1-51a9c3b692e1 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:15:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8cad30be-9fe5-4a38-92b7-19b6ae8c41e1 req-25438a91-3971-467a-ab81-4b11f9fce713 service nova] Acquiring lock "ecb90e79-877e-4012-b569-53aefd96de38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:15:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8cad30be-9fe5-4a38-92b7-19b6ae8c41e1 req-25438a91-3971-467a-ab81-4b11f9fce713 service nova] Lock "ecb90e79-877e-4012-b569-53aefd96de38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:15:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8cad30be-9fe5-4a38-92b7-19b6ae8c41e1 req-25438a91-3971-467a-ab81-4b11f9fce713 service nova] Lock "ecb90e79-877e-4012-b569-53aefd96de38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:15:26 user nova-compute[74898]: DEBUG nova.compute.manager [req-8cad30be-9fe5-4a38-92b7-19b6ae8c41e1 req-25438a91-3971-467a-ab81-4b11f9fce713 service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] No waiting events found dispatching network-vif-plugged-794c112e-9370-4bcc-9fc1-51a9c3b692e1 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:15:26 user nova-compute[74898]: WARNING nova.compute.manager [req-8cad30be-9fe5-4a38-92b7-19b6ae8c41e1 req-25438a91-3971-467a-ab81-4b11f9fce713 service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Received unexpected event network-vif-plugged-794c112e-9370-4bcc-9fc1-51a9c3b692e1 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 17 03:15:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:26 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:15:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-cb94272f-8610-4131-9ea1-ea8fd1be7b09 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "e733574a-56ba-4e24-babd-855bcb5bda61" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-cb94272f-8610-4131-9ea1-ea8fd1be7b09 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "e733574a-56ba-4e24-babd-855bcb5bda61" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-cb94272f-8610-4131-9ea1-ea8fd1be7b09 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "e733574a-56ba-4e24-babd-855bcb5bda61-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-cb94272f-8610-4131-9ea1-ea8fd1be7b09 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "e733574a-56ba-4e24-babd-855bcb5bda61-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-cb94272f-8610-4131-9ea1-ea8fd1be7b09 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "e733574a-56ba-4e24-babd-855bcb5bda61-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:15:27 user nova-compute[74898]: INFO nova.compute.manager [None req-cb94272f-8610-4131-9ea1-ea8fd1be7b09 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Terminating instance
Nov 17 03:15:27 user nova-compute[74898]: DEBUG nova.compute.manager [None req-cb94272f-8610-4131-9ea1-ea8fd1be7b09 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG nova.compute.manager [req-0f14812e-ca2c-4da1-b8fb-b907c2042464 req-dec33954-6769-41b4-b9cc-33c0cc3e4611 service nova] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Received event network-vif-unplugged-f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0f14812e-ca2c-4da1-b8fb-b907c2042464 req-dec33954-6769-41b4-b9cc-33c0cc3e4611 service nova] Acquiring lock "e733574a-56ba-4e24-babd-855bcb5bda61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0f14812e-ca2c-4da1-b8fb-b907c2042464 req-dec33954-6769-41b4-b9cc-33c0cc3e4611 service nova] Lock "e733574a-56ba-4e24-babd-855bcb5bda61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0f14812e-ca2c-4da1-b8fb-b907c2042464 req-dec33954-6769-41b4-b9cc-33c0cc3e4611 service nova] Lock "e733574a-56ba-4e24-babd-855bcb5bda61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG nova.compute.manager [req-0f14812e-ca2c-4da1-b8fb-b907c2042464 req-dec33954-6769-41b4-b9cc-33c0cc3e4611 service nova] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] No waiting events found dispatching network-vif-unplugged-f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG nova.compute.manager [req-0f14812e-ca2c-4da1-b8fb-b907c2042464 req-dec33954-6769-41b4-b9cc-33c0cc3e4611 service nova] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Received event network-vif-unplugged-f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:27 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Instance destroyed successfully.
Nov 17 03:15:27 user nova-compute[74898]: DEBUG nova.objects.instance [None req-cb94272f-8610-4131-9ea1-ea8fd1be7b09 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lazy-loading 'resources' on Instance uuid e733574a-56ba-4e24-babd-855bcb5bda61 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-cb94272f-8610-4131-9ea1-ea8fd1be7b09 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1355402387',display_name='tempest-ServerRescueNegativeTestJSON-server-1355402387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1355402387',id=3,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:01:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9ccd434df9e458f80e5524c5c4c7a1f',ramdisk_id='',reservation_id='r-pqa7cvtw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1788589536',owner_user_name='tempest-ServerRescueNegativeTestJSON-1788589536-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:01:18Z,user_data=None,user_id='303dca207b5f4da297e8ab1fc41ff466',uuid=e733574a-56ba-4e24-babd-855bcb5bda61,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "address": "fa:16:3e:8c:c0:06", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8bd92de-8e", "ovs_interfaceid": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-cb94272f-8610-4131-9ea1-ea8fd1be7b09 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Converting VIF {"id": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "address": "fa:16:3e:8c:c0:06", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8bd92de-8e", "ovs_interfaceid": "f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-cb94272f-8610-4131-9ea1-ea8fd1be7b09 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:c0:06,bridge_name='br-int',has_traffic_filtering=True,id=f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75,network=Network(c153042b-16a0-4676-b024-f4583be62f74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8bd92de-8e') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG os_vif [None req-cb94272f-8610-4131-9ea1-ea8fd1be7b09 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:c0:06,bridge_name='br-int',has_traffic_filtering=True,id=f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75,network=Network(c153042b-16a0-4676-b024-f4583be62f74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8bd92de-8e') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8bd92de-8e, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=99acbf7e-d268-4209-8264-b1a51cf87026) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:27 user nova-compute[74898]: INFO os_vif [None req-cb94272f-8610-4131-9ea1-ea8fd1be7b09 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:c0:06,bridge_name='br-int',has_traffic_filtering=True,id=f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75,network=Network(c153042b-16a0-4676-b024-f4583be62f74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8bd92de-8e')
Nov 17 03:15:27 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-cb94272f-8610-4131-9ea1-ea8fd1be7b09 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Deleting instance files /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61_del
Nov 17 03:15:27 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-cb94272f-8610-4131-9ea1-ea8fd1be7b09 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Deletion of /opt/stack/data/nova/instances/e733574a-56ba-4e24-babd-855bcb5bda61_del complete
Nov 17 03:15:27 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:15:27 user nova-compute[74898]: INFO nova.compute.manager [None req-cb94272f-8610-4131-9ea1-ea8fd1be7b09 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 17 03:15:27 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-cb94272f-8610-4131-9ea1-ea8fd1be7b09 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:15:27 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:15:28 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:15:28 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Took 0.48 seconds to deallocate network for instance.
Nov 17 03:15:28 user nova-compute[74898]: DEBUG nova.compute.manager [req-f56b80f4-e997-4a9a-9dab-4d19e61c1af7 req-04b8035d-489d-443e-bc24-4968c5e09e66 service nova] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Received event network-vif-deleted-f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:15:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-cb94272f-8610-4131-9ea1-ea8fd1be7b09 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:15:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-cb94272f-8610-4131-9ea1-ea8fd1be7b09 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:15:28 user nova-compute[74898]: DEBUG nova.compute.manager [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:15:28 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:15:28 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Instance spawned successfully.
Nov 17 03:15:28 user nova-compute[74898]: DEBUG nova.compute.manager [req-27345833-097d-4517-a2f6-b21a21355213 req-c3eda1ca-8b1b-4168-9147-2bb6b02281ca service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Received event network-vif-plugged-794c112e-9370-4bcc-9fc1-51a9c3b692e1 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:15:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-27345833-097d-4517-a2f6-b21a21355213 req-c3eda1ca-8b1b-4168-9147-2bb6b02281ca service nova] Acquiring lock "ecb90e79-877e-4012-b569-53aefd96de38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:15:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-27345833-097d-4517-a2f6-b21a21355213 req-c3eda1ca-8b1b-4168-9147-2bb6b02281ca service nova] Lock "ecb90e79-877e-4012-b569-53aefd96de38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:15:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-27345833-097d-4517-a2f6-b21a21355213 req-c3eda1ca-8b1b-4168-9147-2bb6b02281ca service nova] Lock "ecb90e79-877e-4012-b569-53aefd96de38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:15:28 user nova-compute[74898]: DEBUG nova.compute.manager [req-27345833-097d-4517-a2f6-b21a21355213 req-c3eda1ca-8b1b-4168-9147-2bb6b02281ca service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] No waiting events found dispatching network-vif-plugged-794c112e-9370-4bcc-9fc1-51a9c3b692e1 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:15:28 user nova-compute[74898]: WARNING nova.compute.manager [req-27345833-097d-4517-a2f6-b21a21355213 req-c3eda1ca-8b1b-4168-9147-2bb6b02281ca service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Received unexpected event network-vif-plugged-794c112e-9370-4bcc-9fc1-51a9c3b692e1 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 17 03:15:28 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-cb94272f-8610-4131-9ea1-ea8fd1be7b09 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:15:28 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-cb94272f-8610-4131-9ea1-ea8fd1be7b09 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:15:28 user nova-compute[74898]: DEBUG nova.compute.manager [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:15:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-cb94272f-8610-4131-9ea1-ea8fd1be7b09 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:15:28 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-cb94272f-8610-4131-9ea1-ea8fd1be7b09 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Deleted allocations for instance e733574a-56ba-4e24-babd-855bcb5bda61
Nov 17 03:15:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8ddd5dbd-7487-4d09-b367-ea0be626064f tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "ecb90e79-877e-4012-b569-53aefd96de38" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.218s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:15:28 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:15:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-cb94272f-8610-4131-9ea1-ea8fd1be7b09 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "e733574a-56ba-4e24-babd-855bcb5bda61" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.713s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:15:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:15:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:15:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:15:28 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:15:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:29 user nova-compute[74898]: DEBUG nova.compute.manager [req-185fc0e2-6cd5-4897-9680-f3e6ebb809b2 req-c7ee1fa3-1460-4339-9a9b-aaa46696f089 service nova] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Received event network-vif-plugged-f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:15:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-185fc0e2-6cd5-4897-9680-f3e6ebb809b2 req-c7ee1fa3-1460-4339-9a9b-aaa46696f089 service nova] Acquiring lock "e733574a-56ba-4e24-babd-855bcb5bda61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:15:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-185fc0e2-6cd5-4897-9680-f3e6ebb809b2 req-c7ee1fa3-1460-4339-9a9b-aaa46696f089 service nova] Lock "e733574a-56ba-4e24-babd-855bcb5bda61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:15:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-185fc0e2-6cd5-4897-9680-f3e6ebb809b2 req-c7ee1fa3-1460-4339-9a9b-aaa46696f089 service nova] Lock "e733574a-56ba-4e24-babd-855bcb5bda61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:15:29 user nova-compute[74898]: DEBUG nova.compute.manager [req-185fc0e2-6cd5-4897-9680-f3e6ebb809b2 req-c7ee1fa3-1460-4339-9a9b-aaa46696f089 service nova] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] No waiting events found dispatching network-vif-plugged-f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:15:29 user nova-compute[74898]: WARNING nova.compute.manager [req-185fc0e2-6cd5-4897-9680-f3e6ebb809b2 req-c7ee1fa3-1460-4339-9a9b-aaa46696f089 service nova] [instance: e733574a-56ba-4e24-babd-855bcb5bda61] Received unexpected event network-vif-plugged-f8bd92de-8ec3-45ed-bbda-7eaf4fb6cb75 for instance with vm_state deleted and task_state None.
Nov 17 03:15:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351b40ac-146d-49e5-b576-726493897945/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351b40ac-146d-49e5-b576-726493897945/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351b40ac-146d-49e5-b576-726493897945/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351b40ac-146d-49e5-b576-726493897945/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:15:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:15:32 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:15:32 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:15:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=8095MB free_disk=25.225326538085938GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:15:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:15:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:15:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:15:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 42994e39-187a-4fb6-a293-24a4eb57177b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:15:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 13449e5c-809b-4db2-af0b-53f5865eb3a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:15:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance c49f4ec3-6f9b-4e14-ba29-208aa026301e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:15:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance ff69d6dd-bce4-400b-8f03-429068cf32eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:15:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 24cd7ac4-3724-4189-82a7-ba61ba46097a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:15:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 351b40ac-146d-49e5-b576-726493897945 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:15:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 3b325f5d-481c-410e-910a-f29df36caec2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:15:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance ecb90e79-877e-4012-b569-53aefd96de38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:15:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:15:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:15:32 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Refreshing inventories for resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 17 03:15:32 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Updating ProviderTree inventory for provider b743bdc9-a8bb-467c-98c8-06f1954f87df from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 17 03:15:32 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Updating inventory in ProviderTree for provider b743bdc9-a8bb-467c-98c8-06f1954f87df with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 17 03:15:32 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Refreshing aggregate associations for resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df, aggregates: None {{(pid=74898) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 17 03:15:32 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Refreshing trait associations for resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=74898) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 17 03:15:32 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:15:32 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:15:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:15:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.615s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:15:32 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:15:32 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Cleaning up deleted instances {{(pid=74898) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 17 03:15:32 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] There are 0 instances to clean {{(pid=74898) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 17 03:15:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:33 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:15:33 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:15:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-42994e39-187a-4fb6-a293-24a4eb57177b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:15:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-42994e39-187a-4fb6-a293-24a4eb57177b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:15:33 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:15:34 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Updating instance_info_cache with network_info: [{"id": "92a5885a-8cb1-43f8-906a-97d7fa08eb62", "address": "fa:16:3e:ab:28:fe", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a5885a-8c", "ovs_interfaceid": "92a5885a-8cb1-43f8-906a-97d7fa08eb62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:15:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-42994e39-187a-4fb6-a293-24a4eb57177b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:15:34 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:15:34 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:15:35 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:15:36 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:15:36 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Cleaning up deleted instances with incomplete migration  {{(pid=74898) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 17 03:15:36 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:15:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:15:38 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 351b40ac-146d-49e5-b576-726493897945 is timed out.
Nov 17 03:15:38 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Successfully detached device vdb from instance 351b40ac-146d-49e5-b576-726493897945 from the live domain config.
Nov 17 03:15:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'igPJodzT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:15:38 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:15:38 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e786bf-4902-4000-9e27-25080328cf24]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:15:38 user nova-compute[74898]: No targets found.
Nov 17 03:15:38 user nova-compute[74898]: iSNS:
Nov 17 03:15:38 user nova-compute[74898]: No targets found.
Nov 17 03:15:38 user nova-compute[74898]: STATIC:
Nov 17 03:15:38 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d
Nov 17 03:15:38 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:15:38 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:15:38 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5
Nov 17 03:15:38 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:15:38 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:15:38 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4
Nov 17 03:15:38 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:15:38 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:15:38 user nova-compute[74898]: FIRMWARE:
Nov 17 03:15:38 user nova-compute[74898]: No targets found.
Nov 17 03:15:38 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:15:38 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:15:38 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d215b6ec-2aae-4a4f-84b6-c4ad009b4d2b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2e68fc-9545-4e4b-8b53-36930de89004]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:15:38 user nova-compute[74898]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:15:38 user nova-compute[74898]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d (non-flash)
Nov 17 03:15:38 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:15:38 user nova-compute[74898]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:15:38 user nova-compute[74898]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d (non-flash)
Nov 17 03:15:38 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf86945e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d'): ({'sdd'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Removing single pathed devices sdd {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3ac8ca-b504-4d5f-bbab-64a7cc985561]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03c71ad-3bdc-4085-82ef-3e2bbc19693e]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Flushing IO for device /dev/sdd {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2752ff50-00b7-437f-8a93-cd913972bb73]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0aa027-b5d6-4860-bae7-cfc2a43ca35f]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] SCSI volumes sdd have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc64960-d0f4-44f2-bf13-2a2e20d843cc]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[191ea745-db23-4ce4-9433-242e798bfa78]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d, portal: 172.16.0.220,3260]
Nov 17 03:15:38 user nova-compute[74898]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d, portal: 172.16.0.220,3260] successful.
Nov 17 03:15:38 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6d17d0d-c197-42a9-90af-9df87be5bd7d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fb6810-d8d3-4048-8fbf-82ee7069685c]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] <== disconnect_volume: return (302ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:15:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:15:39 user nova-compute[74898]: DEBUG nova.objects.instance [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lazy-loading 'flavor' on Instance uuid 351b40ac-146d-49e5-b576-726493897945 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:15:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-0282a023-fdcf-41ce-bac9-116f2d6b2a7e tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lock "351b40ac-146d-49e5-b576-726493897945" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.681s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:15:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "6eee4731-60ed-41ab-905e-395aa4d5e568" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:15:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "6eee4731-60ed-41ab-905e-395aa4d5e568" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:15:46 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:15:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:15:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:15:46 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:15:46 user nova-compute[74898]: INFO nova.compute.claims [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Claim successful on node user
Nov 17 03:15:46 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:15:46 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:15:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:15:46 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:15:46 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:15:46 user nova-compute[74898]: DEBUG nova.network.neutron [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:15:46 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:15:47 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:15:47 user nova-compute[74898]: DEBUG nova.policy [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05397a6b586843338aafbc8a17c6e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cd941de23248d8ac93b03f930f565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:15:47 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:15:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:15:47 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Creating image(s)
Nov 17 03:15:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "/opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:15:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "/opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:15:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "/opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:15:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.176s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:15:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:15:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.180s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk 1073741824" returned: 0 in 0.052s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:15:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:47 user nova-compute[74898]: DEBUG nova.network.neutron [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Successfully created port: 88711a2d-c81a-4fb8-991c-9c78fa20755d {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:15:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.185s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:47 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:15:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:47 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Cannot resize image /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:15:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:15:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Ensure instance console log exists: /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:15:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:15:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:15:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.network.neutron [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Successfully updated port: 88711a2d-c81a-4fb8-991c-9c78fa20755d {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "refresh_cache-6eee4731-60ed-41ab-905e-395aa4d5e568" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquired lock "refresh_cache-6eee4731-60ed-41ab-905e-395aa4d5e568" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.network.neutron [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.compute.manager [req-5aa24074-e81e-4904-82de-3dc39ecb8943 req-f4e438ff-b7ec-462b-90f2-4152feada793 service nova] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Received event network-changed-88711a2d-c81a-4fb8-991c-9c78fa20755d {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.compute.manager [req-5aa24074-e81e-4904-82de-3dc39ecb8943 req-f4e438ff-b7ec-462b-90f2-4152feada793 service nova] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Refreshing instance network info cache due to event network-changed-88711a2d-c81a-4fb8-991c-9c78fa20755d. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5aa24074-e81e-4904-82de-3dc39ecb8943 req-f4e438ff-b7ec-462b-90f2-4152feada793 service nova] Acquiring lock "refresh_cache-6eee4731-60ed-41ab-905e-395aa4d5e568" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.network.neutron [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.network.neutron [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Updating instance_info_cache with network_info: [{"id": "88711a2d-c81a-4fb8-991c-9c78fa20755d", "address": "fa:16:3e:5a:2e:19", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88711a2d-c8", "ovs_interfaceid": "88711a2d-c81a-4fb8-991c-9c78fa20755d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Releasing lock "refresh_cache-6eee4731-60ed-41ab-905e-395aa4d5e568" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Instance network_info: |[{"id": "88711a2d-c81a-4fb8-991c-9c78fa20755d", "address": "fa:16:3e:5a:2e:19", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88711a2d-c8", "ovs_interfaceid": "88711a2d-c81a-4fb8-991c-9c78fa20755d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5aa24074-e81e-4904-82de-3dc39ecb8943 req-f4e438ff-b7ec-462b-90f2-4152feada793 service nova] Acquired lock "refresh_cache-6eee4731-60ed-41ab-905e-395aa4d5e568" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.network.neutron [req-5aa24074-e81e-4904-82de-3dc39ecb8943 req-f4e438ff-b7ec-462b-90f2-4152feada793 service nova] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Refreshing network info cache for port 88711a2d-c81a-4fb8-991c-9c78fa20755d {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Start _get_guest_xml network_info=[{"id": "88711a2d-c81a-4fb8-991c-9c78fa20755d", "address": "fa:16:3e:5a:2e:19", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88711a2d-c8", "ovs_interfaceid": "88711a2d-c81a-4fb8-991c-9c78fa20755d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:15:48 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:15:48 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:15:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1559944',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1559944',id=31,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0cd941de23248d8ac93b03f930f565f',ramdisk_id='',reservation_id='r-8o5y8dhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-507656828',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:15:47Z,user_data=None,user_id='05397a6b586843338aafbc8a17c6e42c',uuid=6eee4731-60ed-41ab-905e-395aa4d5e568,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88711a2d-c81a-4fb8-991c-9c78fa20755d", "address": "fa:16:3e:5a:2e:19", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88711a2d-c8", "ovs_interfaceid": "88711a2d-c81a-4fb8-991c-9c78fa20755d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Converting VIF {"id": "88711a2d-c81a-4fb8-991c-9c78fa20755d", "address": "fa:16:3e:5a:2e:19", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88711a2d-c8", "ovs_interfaceid": "88711a2d-c81a-4fb8-991c-9c78fa20755d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:2e:19,bridge_name='br-int',has_traffic_filtering=True,id=88711a2d-c81a-4fb8-991c-9c78fa20755d,network=Network(9302cb9a-12f9-4845-b6cc-905f4bf24b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88711a2d-c8') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.objects.instance [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lazy-loading 'pci_devices' on Instance uuid 6eee4731-60ed-41ab-905e-395aa4d5e568 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:15:48 user nova-compute[74898]:   <uuid>6eee4731-60ed-41ab-905e-395aa4d5e568</uuid>
Nov 17 03:15:48 user nova-compute[74898]:   <name>instance-0000001f</name>
Nov 17 03:15:48 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:15:48 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:15:48 user nova-compute[74898]:   <metadata>
Nov 17 03:15:48 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:15:48 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:15:48 user nova-compute[74898]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1559944</nova:name>
Nov 17 03:15:48 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:15:48</nova:creationTime>
Nov 17 03:15:48 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:15:48 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:15:48 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:15:48 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:15:48 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:15:48 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:15:48 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:15:48 user nova-compute[74898]:       <nova:owner>
Nov 17 03:15:48 user nova-compute[74898]:         <nova:user uuid="05397a6b586843338aafbc8a17c6e42c">tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member</nova:user>
Nov 17 03:15:48 user nova-compute[74898]:         <nova:project uuid="b0cd941de23248d8ac93b03f930f565f">tempest-ServerBootFromVolumeStableRescueTest-507656828</nova:project>
Nov 17 03:15:48 user nova-compute[74898]:       </nova:owner>
Nov 17 03:15:48 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:15:48 user nova-compute[74898]:       <nova:ports>
Nov 17 03:15:48 user nova-compute[74898]:         <nova:port uuid="88711a2d-c81a-4fb8-991c-9c78fa20755d">
Nov 17 03:15:48 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 17 03:15:48 user nova-compute[74898]:         </nova:port>
Nov 17 03:15:48 user nova-compute[74898]:       </nova:ports>
Nov 17 03:15:48 user nova-compute[74898]:     </nova:instance>
Nov 17 03:15:48 user nova-compute[74898]:   </metadata>
Nov 17 03:15:48 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:15:48 user nova-compute[74898]:     <system>
Nov 17 03:15:48 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:15:48 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:15:48 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:15:48 user nova-compute[74898]:       <entry name="serial">6eee4731-60ed-41ab-905e-395aa4d5e568</entry>
Nov 17 03:15:48 user nova-compute[74898]:       <entry name="uuid">6eee4731-60ed-41ab-905e-395aa4d5e568</entry>
Nov 17 03:15:48 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:15:48 user nova-compute[74898]:     </system>
Nov 17 03:15:48 user nova-compute[74898]:   </sysinfo>
Nov 17 03:15:48 user nova-compute[74898]:   <os>
Nov 17 03:15:48 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:15:48 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:15:48 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:15:48 user nova-compute[74898]:   </os>
Nov 17 03:15:48 user nova-compute[74898]:   <features>
Nov 17 03:15:48 user nova-compute[74898]:     <acpi/>
Nov 17 03:15:48 user nova-compute[74898]:     <apic/>
Nov 17 03:15:48 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:15:48 user nova-compute[74898]:   </features>
Nov 17 03:15:48 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:15:48 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:15:48 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:15:48 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:15:48 user nova-compute[74898]:   </clock>
Nov 17 03:15:48 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:15:48 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:15:48 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:15:48 user nova-compute[74898]:   </cpu>
Nov 17 03:15:48 user nova-compute[74898]:   <devices>
Nov 17 03:15:48 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:15:48 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:15:48 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk"/>
Nov 17 03:15:48 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:15:48 user nova-compute[74898]:     </disk>
Nov 17 03:15:48 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:15:48 user nova-compute[74898]:       <mac address="fa:16:3e:5a:2e:19"/>
Nov 17 03:15:48 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:15:48 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:15:48 user nova-compute[74898]:       <target dev="tap88711a2d-c8"/>
Nov 17 03:15:48 user nova-compute[74898]:     </interface>
Nov 17 03:15:48 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:15:48 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/console.log" append="off"/>
Nov 17 03:15:48 user nova-compute[74898]:     </serial>
Nov 17 03:15:48 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:15:48 user nova-compute[74898]:     <video>
Nov 17 03:15:48 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:15:48 user nova-compute[74898]:     </video>
Nov 17 03:15:48 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:15:48 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:15:48 user nova-compute[74898]:     </rng>
Nov 17 03:15:48 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:15:48 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:15:48 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:15:48 user nova-compute[74898]:     </memballoon>
Nov 17 03:15:48 user nova-compute[74898]:   </devices>
Nov 17 03:15:48 user nova-compute[74898]: </domain>
Nov 17 03:15:48 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:15:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1559944',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1559944',id=31,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0cd941de23248d8ac93b03f930f565f',ramdisk_id='',reservation_id='r-8o5y8dhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-507656828',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:15:47Z,user_data=None,user_id='05397a6b586843338aafbc8a17c6e42c',uuid=6eee4731-60ed-41ab-905e-395aa4d5e568,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88711a2d-c81a-4fb8-991c-9c78fa20755d", "address": "fa:16:3e:5a:2e:19", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88711a2d-c8", "ovs_interfaceid": "88711a2d-c81a-4fb8-991c-9c78fa20755d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Converting VIF {"id": "88711a2d-c81a-4fb8-991c-9c78fa20755d", "address": "fa:16:3e:5a:2e:19", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88711a2d-c8", "ovs_interfaceid": "88711a2d-c81a-4fb8-991c-9c78fa20755d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:2e:19,bridge_name='br-int',has_traffic_filtering=True,id=88711a2d-c81a-4fb8-991c-9c78fa20755d,network=Network(9302cb9a-12f9-4845-b6cc-905f4bf24b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88711a2d-c8') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG os_vif [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:2e:19,bridge_name='br-int',has_traffic_filtering=True,id=88711a2d-c81a-4fb8-991c-9c78fa20755d,network=Network(9302cb9a-12f9-4845-b6cc-905f4bf24b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88711a2d-c8') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'edb549b1-6b66-5c81-8496-bbc1e210fc43', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88711a2d-c8, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap88711a2d-c8, col_values=(('qos', UUID('7e34ea71-f6b8-4722-84c4-14b2cfcb416d')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap88711a2d-c8, col_values=(('external_ids', {'iface-id': '88711a2d-c81a-4fb8-991c-9c78fa20755d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:2e:19', 'vm-uuid': '6eee4731-60ed-41ab-905e-395aa4d5e568'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:48 user nova-compute[74898]: INFO os_vif [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:2e:19,bridge_name='br-int',has_traffic_filtering=True,id=88711a2d-c81a-4fb8-991c-9c78fa20755d,network=Network(9302cb9a-12f9-4845-b6cc-905f4bf24b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88711a2d-c8')
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:15:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] No VIF found with MAC fa:16:3e:5a:2e:19, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:15:49 user nova-compute[74898]: DEBUG nova.network.neutron [req-5aa24074-e81e-4904-82de-3dc39ecb8943 req-f4e438ff-b7ec-462b-90f2-4152feada793 service nova] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Updated VIF entry in instance network info cache for port 88711a2d-c81a-4fb8-991c-9c78fa20755d. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:15:49 user nova-compute[74898]: DEBUG nova.network.neutron [req-5aa24074-e81e-4904-82de-3dc39ecb8943 req-f4e438ff-b7ec-462b-90f2-4152feada793 service nova] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Updating instance_info_cache with network_info: [{"id": "88711a2d-c81a-4fb8-991c-9c78fa20755d", "address": "fa:16:3e:5a:2e:19", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88711a2d-c8", "ovs_interfaceid": "88711a2d-c81a-4fb8-991c-9c78fa20755d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:15:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5aa24074-e81e-4904-82de-3dc39ecb8943 req-f4e438ff-b7ec-462b-90f2-4152feada793 service nova] Releasing lock "refresh_cache-6eee4731-60ed-41ab-905e-395aa4d5e568" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:15:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:50 user nova-compute[74898]: DEBUG nova.objects.instance [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'flavor' on Instance uuid c49f4ec3-6f9b-4e14-ba29-208aa026301e {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:15:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "refresh_cache-c49f4ec3-6f9b-4e14-ba29-208aa026301e" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:15:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquired lock "refresh_cache-c49f4ec3-6f9b-4e14-ba29-208aa026301e" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:15:50 user nova-compute[74898]: DEBUG nova.network.neutron [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:15:50 user nova-compute[74898]: DEBUG nova.objects.instance [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'info_cache' on Instance uuid c49f4ec3-6f9b-4e14-ba29-208aa026301e {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:15:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:50 user nova-compute[74898]: DEBUG nova.objects.base [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Object Instance<c49f4ec3-6f9b-4e14-ba29-208aa026301e> lazy-loaded attributes: flavor,info_cache {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:15:50 user nova-compute[74898]: DEBUG nova.compute.manager [req-31410bb5-f276-4c1d-8031-1abf4ac0a855 req-9664d9a2-6561-4e47-a436-f9eb314391e8 service nova] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Received event network-vif-plugged-88711a2d-c81a-4fb8-991c-9c78fa20755d {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:15:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-31410bb5-f276-4c1d-8031-1abf4ac0a855 req-9664d9a2-6561-4e47-a436-f9eb314391e8 service nova] Acquiring lock "6eee4731-60ed-41ab-905e-395aa4d5e568-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:15:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-31410bb5-f276-4c1d-8031-1abf4ac0a855 req-9664d9a2-6561-4e47-a436-f9eb314391e8 service nova] Lock "6eee4731-60ed-41ab-905e-395aa4d5e568-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:15:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-31410bb5-f276-4c1d-8031-1abf4ac0a855 req-9664d9a2-6561-4e47-a436-f9eb314391e8 service nova] Lock "6eee4731-60ed-41ab-905e-395aa4d5e568-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:15:50 user nova-compute[74898]: DEBUG nova.compute.manager [req-31410bb5-f276-4c1d-8031-1abf4ac0a855 req-9664d9a2-6561-4e47-a436-f9eb314391e8 service nova] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] No waiting events found dispatching network-vif-plugged-88711a2d-c81a-4fb8-991c-9c78fa20755d {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:15:50 user nova-compute[74898]: WARNING nova.compute.manager [req-31410bb5-f276-4c1d-8031-1abf4ac0a855 req-9664d9a2-6561-4e47-a436-f9eb314391e8 service nova] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Received unexpected event network-vif-plugged-88711a2d-c81a-4fb8-991c-9c78fa20755d for instance with vm_state building and task_state spawning.
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.network.neutron [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Updating instance_info_cache with network_info: [{"id": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "address": "fa:16:3e:7d:3c:56", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89cfa577-9a", "ovs_interfaceid": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Releasing lock "refresh_cache-c49f4ec3-6f9b-4e14-ba29-208aa026301e" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:51 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Instance destroyed successfully.
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.objects.instance [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'resources' on Instance uuid c49f4ec3-6f9b-4e14-ba29-208aa026301e {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.objects.base [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Object Instance<c49f4ec3-6f9b-4e14-ba29-208aa026301e> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-559848382',display_name='tempest-AttachVolumeTestJSON-server-559848382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-559848382',id=23,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbyIJI2eENCayym7wJaTE5mkfjBea5My/OAyGGxTUZlk7cC9WDtXyYqwoAMcoNPQD8MTCjcX10bj1aNkxQk64CCPBoHWZhGjVWIxFCC/x0O8IS9lweYLOVUWDQLxxg2Nw==',key_name='tempest-keypair-1028377093',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:07:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='08b13b86a294437da9a38ca4fd9b98e1',ramdisk_id='',reservation_id='r-ctvf81kq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1097544794',owner_user_name='tempest-AttachVolumeTestJSON-1097544794-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:14:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f67341bd3d3a47698364dcfc7a7c8a9a',uuid=c49f4ec3-6f9b-4e14-ba29-208aa026301e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "address": "fa:16:3e:7d:3c:56", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89cfa577-9a", "ovs_interfaceid": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Converting VIF {"id": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "address": "fa:16:3e:7d:3c:56", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89cfa577-9a", "ovs_interfaceid": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:3c:56,bridge_name='br-int',has_traffic_filtering=True,id=89cfa577-9add-4c3b-81be-59ddb7e34d59,network=Network(b4bcd1f2-7a46-421a-8979-8ba9aca50ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89cfa577-9a') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG os_vif [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:3c:56,bridge_name='br-int',has_traffic_filtering=True,id=89cfa577-9add-4c3b-81be-59ddb7e34d59,network=Network(b4bcd1f2-7a46-421a-8979-8ba9aca50ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89cfa577-9a') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89cfa577-9a, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cb31e014-1bc0-4ecc-934a-e9fd76b24765) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:51 user nova-compute[74898]: INFO os_vif [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:3c:56,bridge_name='br-int',has_traffic_filtering=True,id=89cfa577-9add-4c3b-81be-59ddb7e34d59,network=Network(b4bcd1f2-7a46-421a-8979-8ba9aca50ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89cfa577-9a')
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Start _get_guest_xml network_info=[{"id": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "address": "fa:16:3e:7d:3c:56", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89cfa577-9a", "ovs_interfaceid": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.objects.instance [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'numa_topology' on Instance uuid c49f4ec3-6f9b-4e14-ba29-208aa026301e {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.objects.base [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Object Instance<c49f4ec3-6f9b-4e14-ba29-208aa026301e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:15:51 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:15:51 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.objects.instance [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'vcpu_model' on Instance uuid c49f4ec3-6f9b-4e14-ba29-208aa026301e {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.objects.base [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Object Instance<c49f4ec3-6f9b-4e14-ba29-208aa026301e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-559848382',display_name='tempest-AttachVolumeTestJSON-server-559848382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-559848382',id=23,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbyIJI2eENCayym7wJaTE5mkfjBea5My/OAyGGxTUZlk7cC9WDtXyYqwoAMcoNPQD8MTCjcX10bj1aNkxQk64CCPBoHWZhGjVWIxFCC/x0O8IS9lweYLOVUWDQLxxg2Nw==',key_name='tempest-keypair-1028377093',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:07:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='08b13b86a294437da9a38ca4fd9b98e1',ramdisk_id='',reservation_id='r-ctvf81kq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1097544794',owner_user_name='tempest-AttachVolumeTestJSON-1097544794-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:14:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f67341bd3d3a47698364dcfc7a7c8a9a',uuid=c49f4ec3-6f9b-4e14-ba29-208aa026301e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "address": "fa:16:3e:7d:3c:56", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89cfa577-9a", "ovs_interfaceid": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Converting VIF {"id": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "address": "fa:16:3e:7d:3c:56", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89cfa577-9a", "ovs_interfaceid": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:3c:56,bridge_name='br-int',has_traffic_filtering=True,id=89cfa577-9add-4c3b-81be-59ddb7e34d59,network=Network(b4bcd1f2-7a46-421a-8979-8ba9aca50ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89cfa577-9a') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.objects.instance [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'pci_devices' on Instance uuid c49f4ec3-6f9b-4e14-ba29-208aa026301e {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.objects.base [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Object Instance<c49f4ec3-6f9b-4e14-ba29-208aa026301e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:15:51 user nova-compute[74898]:   <uuid>c49f4ec3-6f9b-4e14-ba29-208aa026301e</uuid>
Nov 17 03:15:51 user nova-compute[74898]:   <name>instance-00000017</name>
Nov 17 03:15:51 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:15:51 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:15:51 user nova-compute[74898]:   <metadata>
Nov 17 03:15:51 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:15:51 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:15:51 user nova-compute[74898]:       <nova:name>tempest-AttachVolumeTestJSON-server-559848382</nova:name>
Nov 17 03:15:51 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:15:51</nova:creationTime>
Nov 17 03:15:51 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:15:51 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:15:51 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:15:51 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:15:51 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:15:51 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:15:51 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:15:51 user nova-compute[74898]:       <nova:owner>
Nov 17 03:15:51 user nova-compute[74898]:         <nova:user uuid="f67341bd3d3a47698364dcfc7a7c8a9a">tempest-AttachVolumeTestJSON-1097544794-project-member</nova:user>
Nov 17 03:15:51 user nova-compute[74898]:         <nova:project uuid="08b13b86a294437da9a38ca4fd9b98e1">tempest-AttachVolumeTestJSON-1097544794</nova:project>
Nov 17 03:15:51 user nova-compute[74898]:       </nova:owner>
Nov 17 03:15:51 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:15:51 user nova-compute[74898]:       <nova:ports>
Nov 17 03:15:51 user nova-compute[74898]:         <nova:port uuid="89cfa577-9add-4c3b-81be-59ddb7e34d59">
Nov 17 03:15:51 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 17 03:15:51 user nova-compute[74898]:         </nova:port>
Nov 17 03:15:51 user nova-compute[74898]:       </nova:ports>
Nov 17 03:15:51 user nova-compute[74898]:     </nova:instance>
Nov 17 03:15:51 user nova-compute[74898]:   </metadata>
Nov 17 03:15:51 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:15:51 user nova-compute[74898]:     <system>
Nov 17 03:15:51 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:15:51 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:15:51 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:15:51 user nova-compute[74898]:       <entry name="serial">c49f4ec3-6f9b-4e14-ba29-208aa026301e</entry>
Nov 17 03:15:51 user nova-compute[74898]:       <entry name="uuid">c49f4ec3-6f9b-4e14-ba29-208aa026301e</entry>
Nov 17 03:15:51 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:15:51 user nova-compute[74898]:     </system>
Nov 17 03:15:51 user nova-compute[74898]:   </sysinfo>
Nov 17 03:15:51 user nova-compute[74898]:   <os>
Nov 17 03:15:51 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:15:51 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:15:51 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:15:51 user nova-compute[74898]:   </os>
Nov 17 03:15:51 user nova-compute[74898]:   <features>
Nov 17 03:15:51 user nova-compute[74898]:     <acpi/>
Nov 17 03:15:51 user nova-compute[74898]:     <apic/>
Nov 17 03:15:51 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:15:51 user nova-compute[74898]:   </features>
Nov 17 03:15:51 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:15:51 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:15:51 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:15:51 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:15:51 user nova-compute[74898]:   </clock>
Nov 17 03:15:51 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:15:51 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:15:51 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:15:51 user nova-compute[74898]:   </cpu>
Nov 17 03:15:51 user nova-compute[74898]:   <devices>
Nov 17 03:15:51 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:15:51 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:15:51 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk"/>
Nov 17 03:15:51 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:15:51 user nova-compute[74898]:     </disk>
Nov 17 03:15:51 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:15:51 user nova-compute[74898]:       <mac address="fa:16:3e:7d:3c:56"/>
Nov 17 03:15:51 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:15:51 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:15:51 user nova-compute[74898]:       <target dev="tap89cfa577-9a"/>
Nov 17 03:15:51 user nova-compute[74898]:     </interface>
Nov 17 03:15:51 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:15:51 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/console.log" append="off"/>
Nov 17 03:15:51 user nova-compute[74898]:     </serial>
Nov 17 03:15:51 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:15:51 user nova-compute[74898]:     <video>
Nov 17 03:15:51 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:15:51 user nova-compute[74898]:     </video>
Nov 17 03:15:51 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:15:51 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:15:51 user nova-compute[74898]:     </rng>
Nov 17 03:15:51 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:15:51 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:15:51 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:15:51 user nova-compute[74898]:     </memballoon>
Nov 17 03:15:51 user nova-compute[74898]:   </devices>
Nov 17 03:15:51 user nova-compute[74898]: </domain>
Nov 17 03:15:51 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.objects.instance [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'trusted_certs' on Instance uuid c49f4ec3-6f9b-4e14-ba29-208aa026301e {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.objects.base [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Object Instance<c49f4ec3-6f9b-4e14-ba29-208aa026301e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.165s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:15:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Cannot resize image /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG nova.objects.instance [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'migration_context' on Instance uuid c49f4ec3-6f9b-4e14-ba29-208aa026301e {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG nova.objects.base [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Object Instance<c49f4ec3-6f9b-4e14-ba29-208aa026301e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-559848382',display_name='tempest-AttachVolumeTestJSON-server-559848382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-559848382',id=23,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbyIJI2eENCayym7wJaTE5mkfjBea5My/OAyGGxTUZlk7cC9WDtXyYqwoAMcoNPQD8MTCjcX10bj1aNkxQk64CCPBoHWZhGjVWIxFCC/x0O8IS9lweYLOVUWDQLxxg2Nw==',key_name='tempest-keypair-1028377093',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:07:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='08b13b86a294437da9a38ca4fd9b98e1',ramdisk_id='',reservation_id='r-ctvf81kq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1097544794',owner_user_name='tempest-AttachVolumeTestJSON-1097544794-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:14:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f67341bd3d3a47698364dcfc7a7c8a9a',uuid=c49f4ec3-6f9b-4e14-ba29-208aa026301e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "address": "fa:16:3e:7d:3c:56", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89cfa577-9a", "ovs_interfaceid": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Converting VIF {"id": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "address": "fa:16:3e:7d:3c:56", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89cfa577-9a", "ovs_interfaceid": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:3c:56,bridge_name='br-int',has_traffic_filtering=True,id=89cfa577-9add-4c3b-81be-59ddb7e34d59,network=Network(b4bcd1f2-7a46-421a-8979-8ba9aca50ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89cfa577-9a') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG os_vif [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:3c:56,bridge_name='br-int',has_traffic_filtering=True,id=89cfa577-9add-4c3b-81be-59ddb7e34d59,network=Network(b4bcd1f2-7a46-421a-8979-8ba9aca50ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89cfa577-9a') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5092eaa1-7329-5a46-b318-86d1f893c038', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89cfa577-9a, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89cfa577-9a, col_values=(('qos', UUID('fed8d515-2a2d-45e6-95af-d09e13e81ca8')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89cfa577-9a, col_values=(('external_ids', {'iface-id': '89cfa577-9add-4c3b-81be-59ddb7e34d59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:3c:56', 'vm-uuid': 'c49f4ec3-6f9b-4e14-ba29-208aa026301e'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:52 user nova-compute[74898]: INFO os_vif [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:3c:56,bridge_name='br-int',has_traffic_filtering=True,id=89cfa577-9add-4c3b-81be-59ddb7e34d59,network=Network(b4bcd1f2-7a46-421a-8979-8ba9aca50ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89cfa577-9a')
Nov 17 03:15:52 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:15:52 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Instance spawned successfully.
Nov 17 03:15:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:15:52 user nova-compute[74898]: INFO nova.compute.manager [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Took 5.15 seconds to spawn the instance on the hypervisor.
Nov 17 03:15:52 user nova-compute[74898]: DEBUG nova.compute.manager [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:15:52 user nova-compute[74898]: INFO nova.compute.manager [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Took 5.91 seconds to build instance.
Nov 17 03:15:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a6094a54-78e2-4d44-9dca-3b3013c2b0ae tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "6eee4731-60ed-41ab-905e-395aa4d5e568" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.999s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG nova.compute.manager [req-51ed07ea-e43f-4de8-b27e-7e423057abee req-066820b1-3016-4f87-b782-4a3bd2e40022 service nova] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Received event network-vif-plugged-88711a2d-c81a-4fb8-991c-9c78fa20755d {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-51ed07ea-e43f-4de8-b27e-7e423057abee req-066820b1-3016-4f87-b782-4a3bd2e40022 service nova] Acquiring lock "6eee4731-60ed-41ab-905e-395aa4d5e568-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-51ed07ea-e43f-4de8-b27e-7e423057abee req-066820b1-3016-4f87-b782-4a3bd2e40022 service nova] Lock "6eee4731-60ed-41ab-905e-395aa4d5e568-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-51ed07ea-e43f-4de8-b27e-7e423057abee req-066820b1-3016-4f87-b782-4a3bd2e40022 service nova] Lock "6eee4731-60ed-41ab-905e-395aa4d5e568-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:15:52 user nova-compute[74898]: DEBUG nova.compute.manager [req-51ed07ea-e43f-4de8-b27e-7e423057abee req-066820b1-3016-4f87-b782-4a3bd2e40022 service nova] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] No waiting events found dispatching network-vif-plugged-88711a2d-c81a-4fb8-991c-9c78fa20755d {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:15:52 user nova-compute[74898]: WARNING nova.compute.manager [req-51ed07ea-e43f-4de8-b27e-7e423057abee req-066820b1-3016-4f87-b782-4a3bd2e40022 service nova] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Received unexpected event network-vif-plugged-88711a2d-c81a-4fb8-991c-9c78fa20755d for instance with vm_state active and task_state None.
Nov 17 03:15:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:53 user nova-compute[74898]: DEBUG nova.compute.manager [req-5e40f909-2ed9-4ea4-b205-640a72a6d3c5 req-99f03899-8bf5-4ea3-999a-38eb130b8e36 service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Received event network-vif-plugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:15:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5e40f909-2ed9-4ea4-b205-640a72a6d3c5 req-99f03899-8bf5-4ea3-999a-38eb130b8e36 service nova] Acquiring lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:15:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5e40f909-2ed9-4ea4-b205-640a72a6d3c5 req-99f03899-8bf5-4ea3-999a-38eb130b8e36 service nova] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:15:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5e40f909-2ed9-4ea4-b205-640a72a6d3c5 req-99f03899-8bf5-4ea3-999a-38eb130b8e36 service nova] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:15:53 user nova-compute[74898]: DEBUG nova.compute.manager [req-5e40f909-2ed9-4ea4-b205-640a72a6d3c5 req-99f03899-8bf5-4ea3-999a-38eb130b8e36 service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] No waiting events found dispatching network-vif-plugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:15:53 user nova-compute[74898]: WARNING nova.compute.manager [req-5e40f909-2ed9-4ea4-b205-640a72a6d3c5 req-99f03899-8bf5-4ea3-999a-38eb130b8e36 service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Received unexpected event network-vif-plugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 for instance with vm_state stopped and task_state powering-on.
Nov 17 03:15:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:55 user nova-compute[74898]: DEBUG nova.compute.manager [req-44d5e864-cf51-4cae-b557-fbc7b8456013 req-53e20aa0-4391-4656-bba0-7887f99ce9d0 service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Received event network-vif-plugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:15:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-44d5e864-cf51-4cae-b557-fbc7b8456013 req-53e20aa0-4391-4656-bba0-7887f99ce9d0 service nova] Acquiring lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:15:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-44d5e864-cf51-4cae-b557-fbc7b8456013 req-53e20aa0-4391-4656-bba0-7887f99ce9d0 service nova] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:15:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-44d5e864-cf51-4cae-b557-fbc7b8456013 req-53e20aa0-4391-4656-bba0-7887f99ce9d0 service nova] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:15:55 user nova-compute[74898]: DEBUG nova.compute.manager [req-44d5e864-cf51-4cae-b557-fbc7b8456013 req-53e20aa0-4391-4656-bba0-7887f99ce9d0 service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] No waiting events found dispatching network-vif-plugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:15:55 user nova-compute[74898]: WARNING nova.compute.manager [req-44d5e864-cf51-4cae-b557-fbc7b8456013 req-53e20aa0-4391-4656-bba0-7887f99ce9d0 service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Received unexpected event network-vif-plugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 for instance with vm_state stopped and task_state powering-on.
Nov 17 03:15:55 user nova-compute[74898]: DEBUG nova.compute.manager [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:15:55 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Instance rebooted successfully.
Nov 17 03:15:55 user nova-compute[74898]: DEBUG nova.compute.manager [None req-f08a0147-c572-482b-9022-0cc98b108092 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:15:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:15:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3f01147e-b6cd-4b26-b09d-e61c544d2d6b tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Acquiring lock "351b40ac-146d-49e5-b576-726493897945" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:16:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3f01147e-b6cd-4b26-b09d-e61c544d2d6b tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lock "351b40ac-146d-49e5-b576-726493897945" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:16:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3f01147e-b6cd-4b26-b09d-e61c544d2d6b tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Acquiring lock "351b40ac-146d-49e5-b576-726493897945-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:16:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3f01147e-b6cd-4b26-b09d-e61c544d2d6b tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lock "351b40ac-146d-49e5-b576-726493897945-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:16:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3f01147e-b6cd-4b26-b09d-e61c544d2d6b tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lock "351b40ac-146d-49e5-b576-726493897945-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:16:10 user nova-compute[74898]: INFO nova.compute.manager [None req-3f01147e-b6cd-4b26-b09d-e61c544d2d6b tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Terminating instance
Nov 17 03:16:10 user nova-compute[74898]: DEBUG nova.compute.manager [None req-3f01147e-b6cd-4b26-b09d-e61c544d2d6b tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:16:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:10 user nova-compute[74898]: DEBUG nova.compute.manager [req-a89e221b-38d5-4ff4-9e18-bf87f83dfb7c req-c3ce0d26-3cc3-4f6a-be30-dbd8c2a580cd service nova] [instance: 351b40ac-146d-49e5-b576-726493897945] Received event network-vif-unplugged-7a94312f-9d65-4b04-874e-21bcdb6750f7 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:16:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a89e221b-38d5-4ff4-9e18-bf87f83dfb7c req-c3ce0d26-3cc3-4f6a-be30-dbd8c2a580cd service nova] Acquiring lock "351b40ac-146d-49e5-b576-726493897945-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:16:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a89e221b-38d5-4ff4-9e18-bf87f83dfb7c req-c3ce0d26-3cc3-4f6a-be30-dbd8c2a580cd service nova] Lock "351b40ac-146d-49e5-b576-726493897945-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:16:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a89e221b-38d5-4ff4-9e18-bf87f83dfb7c req-c3ce0d26-3cc3-4f6a-be30-dbd8c2a580cd service nova] Lock "351b40ac-146d-49e5-b576-726493897945-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:16:10 user nova-compute[74898]: DEBUG nova.compute.manager [req-a89e221b-38d5-4ff4-9e18-bf87f83dfb7c req-c3ce0d26-3cc3-4f6a-be30-dbd8c2a580cd service nova] [instance: 351b40ac-146d-49e5-b576-726493897945] No waiting events found dispatching network-vif-unplugged-7a94312f-9d65-4b04-874e-21bcdb6750f7 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:16:10 user nova-compute[74898]: DEBUG nova.compute.manager [req-a89e221b-38d5-4ff4-9e18-bf87f83dfb7c req-c3ce0d26-3cc3-4f6a-be30-dbd8c2a580cd service nova] [instance: 351b40ac-146d-49e5-b576-726493897945] Received event network-vif-unplugged-7a94312f-9d65-4b04-874e-21bcdb6750f7 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:11 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 351b40ac-146d-49e5-b576-726493897945] Instance destroyed successfully.
Nov 17 03:16:11 user nova-compute[74898]: DEBUG nova.objects.instance [None req-3f01147e-b6cd-4b26-b09d-e61c544d2d6b tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lazy-loading 'resources' on Instance uuid 351b40ac-146d-49e5-b576-726493897945 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-3f01147e-b6cd-4b26-b09d-e61c544d2d6b tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:13:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-356559055',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-356559055',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3565590',id=29,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIHf2Q6Q6Veg5Qs18OTxqnheTgdmo0HiooLXbDcFDKXLRY0/P8RWczMfwJaUdH2jOeFpkgAWfJhBEc+0sEzyCFv1/QbJB5LJCpEZWpn/WjTiLxBcTiA1ZXARECLRpBUUw==',key_name='tempest-keypair-607587357',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:13:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6ad65d3ca604b36926e90f682f95354',ramdisk_id='',reservation_id='r-rknltgxp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1162503167',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:13:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc353ba522a54aab95a1be8e8a0a6aff',uuid=351b40ac-146d-49e5-b576-726493897945,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a94312f-9d65-4b04-874e-21bcdb6750f7", "address": "fa:16:3e:ea:3b:50", "network": {"id": "cf23170a-1954-4a5c-a124-22dc9421cf7a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1758456257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6ad65d3ca604b36926e90f682f95354", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a94312f-9d", "ovs_interfaceid": "7a94312f-9d65-4b04-874e-21bcdb6750f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3f01147e-b6cd-4b26-b09d-e61c544d2d6b tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Converting VIF {"id": "7a94312f-9d65-4b04-874e-21bcdb6750f7", "address": "fa:16:3e:ea:3b:50", "network": {"id": "cf23170a-1954-4a5c-a124-22dc9421cf7a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1758456257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6ad65d3ca604b36926e90f682f95354", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a94312f-9d", "ovs_interfaceid": "7a94312f-9d65-4b04-874e-21bcdb6750f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3f01147e-b6cd-4b26-b09d-e61c544d2d6b tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:3b:50,bridge_name='br-int',has_traffic_filtering=True,id=7a94312f-9d65-4b04-874e-21bcdb6750f7,network=Network(cf23170a-1954-4a5c-a124-22dc9421cf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a94312f-9d') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG os_vif [None req-3f01147e-b6cd-4b26-b09d-e61c544d2d6b tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:3b:50,bridge_name='br-int',has_traffic_filtering=True,id=7a94312f-9d65-4b04-874e-21bcdb6750f7,network=Network(cf23170a-1954-4a5c-a124-22dc9421cf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a94312f-9d') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a94312f-9d, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0cd4539a-1185-443c-8151-3491910a3715) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:16:11 user nova-compute[74898]: INFO os_vif [None req-3f01147e-b6cd-4b26-b09d-e61c544d2d6b tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:3b:50,bridge_name='br-int',has_traffic_filtering=True,id=7a94312f-9d65-4b04-874e-21bcdb6750f7,network=Network(cf23170a-1954-4a5c-a124-22dc9421cf7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a94312f-9d')
Nov 17 03:16:11 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-3f01147e-b6cd-4b26-b09d-e61c544d2d6b tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Deleting instance files /opt/stack/data/nova/instances/351b40ac-146d-49e5-b576-726493897945_del
Nov 17 03:16:11 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-3f01147e-b6cd-4b26-b09d-e61c544d2d6b tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Deletion of /opt/stack/data/nova/instances/351b40ac-146d-49e5-b576-726493897945_del complete
Nov 17 03:16:11 user nova-compute[74898]: INFO nova.compute.manager [None req-3f01147e-b6cd-4b26-b09d-e61c544d2d6b tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] [instance: 351b40ac-146d-49e5-b576-726493897945] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 17 03:16:11 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-3f01147e-b6cd-4b26-b09d-e61c544d2d6b tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: 351b40ac-146d-49e5-b576-726493897945] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 351b40ac-146d-49e5-b576-726493897945] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._sync_power_states {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:16:11 user nova-compute[74898]: WARNING nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Nov 17 03:16:11 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Triggering sync for uuid 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb {{(pid=74898) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Triggering sync for uuid 42994e39-187a-4fb6-a293-24a4eb57177b {{(pid=74898) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Triggering sync for uuid 13449e5c-809b-4db2-af0b-53f5865eb3a4 {{(pid=74898) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Triggering sync for uuid c49f4ec3-6f9b-4e14-ba29-208aa026301e {{(pid=74898) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Triggering sync for uuid ff69d6dd-bce4-400b-8f03-429068cf32eb {{(pid=74898) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Triggering sync for uuid 24cd7ac4-3724-4189-82a7-ba61ba46097a {{(pid=74898) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Triggering sync for uuid ecb90e79-877e-4012-b569-53aefd96de38 {{(pid=74898) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Triggering sync for uuid 351b40ac-146d-49e5-b576-726493897945 {{(pid=74898) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Triggering sync for uuid 3b325f5d-481c-410e-910a-f29df36caec2 {{(pid=74898) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Triggering sync for uuid 6eee4731-60ed-41ab-905e-395aa4d5e568 {{(pid=74898) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "42994e39-187a-4fb6-a293-24a4eb57177b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "42994e39-187a-4fb6-a293-24a4eb57177b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "13449e5c-809b-4db2-af0b-53f5865eb3a4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "13449e5c-809b-4db2-af0b-53f5865eb3a4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "ff69d6dd-bce4-400b-8f03-429068cf32eb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "ff69d6dd-bce4-400b-8f03-429068cf32eb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "24cd7ac4-3724-4189-82a7-ba61ba46097a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "ecb90e79-877e-4012-b569-53aefd96de38" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "ecb90e79-877e-4012-b569-53aefd96de38" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "351b40ac-146d-49e5-b576-726493897945" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "3b325f5d-481c-410e-910a-f29df36caec2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "3b325f5d-481c-410e-910a-f29df36caec2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.007s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "6eee4731-60ed-41ab-905e-395aa4d5e568" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "6eee4731-60ed-41ab-905e-395aa4d5e568" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "13449e5c-809b-4db2-af0b-53f5865eb3a4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "42994e39-187a-4fb6-a293-24a4eb57177b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "ff69d6dd-bce4-400b-8f03-429068cf32eb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "ecb90e79-877e-4012-b569-53aefd96de38" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "3b325f5d-481c-410e-910a-f29df36caec2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:16:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "6eee4731-60ed-41ab-905e-395aa4d5e568" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:16:12 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 351b40ac-146d-49e5-b576-726493897945] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:16:12 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: 351b40ac-146d-49e5-b576-726493897945] Took 0.66 seconds to deallocate network for instance.
Nov 17 03:16:12 user nova-compute[74898]: DEBUG nova.compute.manager [req-5d4a5e81-04d4-479e-9a0c-c128532c9313 req-54a39c20-45f2-470b-b838-86145f0598d5 service nova] [instance: 351b40ac-146d-49e5-b576-726493897945] Received event network-vif-deleted-7a94312f-9d65-4b04-874e-21bcdb6750f7 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:16:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3f01147e-b6cd-4b26-b09d-e61c544d2d6b tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:16:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3f01147e-b6cd-4b26-b09d-e61c544d2d6b tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:16:12 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-3f01147e-b6cd-4b26-b09d-e61c544d2d6b tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:16:12 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-3f01147e-b6cd-4b26-b09d-e61c544d2d6b tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:16:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3f01147e-b6cd-4b26-b09d-e61c544d2d6b tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:16:12 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-3f01147e-b6cd-4b26-b09d-e61c544d2d6b tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Deleted allocations for instance 351b40ac-146d-49e5-b576-726493897945
Nov 17 03:16:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3f01147e-b6cd-4b26-b09d-e61c544d2d6b tempest-TestServerVolumeAttachScenarioOldVersion-1162503167 tempest-TestServerVolumeAttachScenarioOldVersion-1162503167-project-member] Lock "351b40ac-146d-49e5-b576-726493897945" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.016s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:16:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "351b40ac-146d-49e5-b576-726493897945" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.717s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:16:12 user nova-compute[74898]: INFO nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 351b40ac-146d-49e5-b576-726493897945] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 17 03:16:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "351b40ac-146d-49e5-b576-726493897945" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:16:12 user nova-compute[74898]: DEBUG nova.compute.manager [req-a7746933-3429-4a2e-abd1-212c2cf7f5a7 req-71b93901-4ece-4a4d-82d2-e9ed3ce6e9ac service nova] [instance: 351b40ac-146d-49e5-b576-726493897945] Received event network-vif-plugged-7a94312f-9d65-4b04-874e-21bcdb6750f7 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:16:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a7746933-3429-4a2e-abd1-212c2cf7f5a7 req-71b93901-4ece-4a4d-82d2-e9ed3ce6e9ac service nova] Acquiring lock "351b40ac-146d-49e5-b576-726493897945-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:16:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a7746933-3429-4a2e-abd1-212c2cf7f5a7 req-71b93901-4ece-4a4d-82d2-e9ed3ce6e9ac service nova] Lock "351b40ac-146d-49e5-b576-726493897945-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:16:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a7746933-3429-4a2e-abd1-212c2cf7f5a7 req-71b93901-4ece-4a4d-82d2-e9ed3ce6e9ac service nova] Lock "351b40ac-146d-49e5-b576-726493897945-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:16:12 user nova-compute[74898]: DEBUG nova.compute.manager [req-a7746933-3429-4a2e-abd1-212c2cf7f5a7 req-71b93901-4ece-4a4d-82d2-e9ed3ce6e9ac service nova] [instance: 351b40ac-146d-49e5-b576-726493897945] No waiting events found dispatching network-vif-plugged-7a94312f-9d65-4b04-874e-21bcdb6750f7 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:16:12 user nova-compute[74898]: WARNING nova.compute.manager [req-a7746933-3429-4a2e-abd1-212c2cf7f5a7 req-71b93901-4ece-4a4d-82d2-e9ed3ce6e9ac service nova] [instance: 351b40ac-146d-49e5-b576-726493897945] Received unexpected event network-vif-plugged-7a94312f-9d65-4b04-874e-21bcdb6750f7 for instance with vm_state deleted and task_state None.
Nov 17 03:16:16 user nova-compute[74898]: DEBUG nova.compute.manager [req-081c4320-d78f-44f1-91dc-7aaceb1af32a req-22ec5786-8c54-4d7f-9ec2-cc2d4102eee3 service nova] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Received event network-changed-92a5885a-8cb1-43f8-906a-97d7fa08eb62 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:16:16 user nova-compute[74898]: DEBUG nova.compute.manager [req-081c4320-d78f-44f1-91dc-7aaceb1af32a req-22ec5786-8c54-4d7f-9ec2-cc2d4102eee3 service nova] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Refreshing instance network info cache due to event network-changed-92a5885a-8cb1-43f8-906a-97d7fa08eb62. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:16:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-081c4320-d78f-44f1-91dc-7aaceb1af32a req-22ec5786-8c54-4d7f-9ec2-cc2d4102eee3 service nova] Acquiring lock "refresh_cache-42994e39-187a-4fb6-a293-24a4eb57177b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:16:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-081c4320-d78f-44f1-91dc-7aaceb1af32a req-22ec5786-8c54-4d7f-9ec2-cc2d4102eee3 service nova] Acquired lock "refresh_cache-42994e39-187a-4fb6-a293-24a4eb57177b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:16:16 user nova-compute[74898]: DEBUG nova.network.neutron [req-081c4320-d78f-44f1-91dc-7aaceb1af32a req-22ec5786-8c54-4d7f-9ec2-cc2d4102eee3 service nova] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Refreshing network info cache for port 92a5885a-8cb1-43f8-906a-97d7fa08eb62 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:16:16 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:16 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:16 user nova-compute[74898]: DEBUG nova.network.neutron [req-081c4320-d78f-44f1-91dc-7aaceb1af32a req-22ec5786-8c54-4d7f-9ec2-cc2d4102eee3 service nova] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Updated VIF entry in instance network info cache for port 92a5885a-8cb1-43f8-906a-97d7fa08eb62. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:16:16 user nova-compute[74898]: DEBUG nova.network.neutron [req-081c4320-d78f-44f1-91dc-7aaceb1af32a req-22ec5786-8c54-4d7f-9ec2-cc2d4102eee3 service nova] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Updating instance_info_cache with network_info: [{"id": "92a5885a-8cb1-43f8-906a-97d7fa08eb62", "address": "fa:16:3e:ab:28:fe", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a5885a-8c", "ovs_interfaceid": "92a5885a-8cb1-43f8-906a-97d7fa08eb62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:16:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-081c4320-d78f-44f1-91dc-7aaceb1af32a req-22ec5786-8c54-4d7f-9ec2-cc2d4102eee3 service nova] Releasing lock "refresh_cache-42994e39-187a-4fb6-a293-24a4eb57177b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:16:17 user nova-compute[74898]: DEBUG nova.compute.manager [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Stashing vm_state: active {{(pid=74898) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 17 03:16:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:16:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:16:17 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:16:17 user nova-compute[74898]: INFO nova.compute.claims [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Claim successful on node user
Nov 17 03:16:17 user nova-compute[74898]: INFO nova.compute.resource_tracker [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Updating resource usage from migration 4acb6081-4ad6-47ef-80b1-fd374e3e3ef2
Nov 17 03:16:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-95877d8b-ef4e-462e-810c-2bfbe1260223 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:16:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-95877d8b-ef4e-462e-810c-2bfbe1260223 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:16:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-95877d8b-ef4e-462e-810c-2bfbe1260223 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:16:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-95877d8b-ef4e-462e-810c-2bfbe1260223 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:16:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-95877d8b-ef4e-462e-810c-2bfbe1260223 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:16:17 user nova-compute[74898]: INFO nova.compute.manager [None req-95877d8b-ef4e-462e-810c-2bfbe1260223 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Terminating instance
Nov 17 03:16:17 user nova-compute[74898]: DEBUG nova.compute.manager [None req-95877d8b-ef4e-462e-810c-2bfbe1260223 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:16:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:17 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:16:17 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:16:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.448s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:16:17 user nova-compute[74898]: INFO nova.compute.manager [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Migrating
Nov 17 03:16:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "refresh_cache-3b325f5d-481c-410e-910a-f29df36caec2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:16:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquired lock "refresh_cache-3b325f5d-481c-410e-910a-f29df36caec2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:16:17 user nova-compute[74898]: DEBUG nova.network.neutron [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:16:18 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Instance destroyed successfully.
Nov 17 03:16:18 user nova-compute[74898]: DEBUG nova.objects.instance [None req-95877d8b-ef4e-462e-810c-2bfbe1260223 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lazy-loading 'resources' on Instance uuid 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:16:18 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-95877d8b-ef4e-462e-810c-2bfbe1260223 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:59:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-575888772',display_name='tempest-ServerRescueNegativeTestJSON-server-575888772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-575888772',id=2,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:04:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9ccd434df9e458f80e5524c5c4c7a1f',ramdisk_id='',reservation_id='r-cyrur8za',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1788589536',owner_user_name='tempest-ServerRescueNegativeTestJSON-1788589536-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:06:03Z,user_data=None,user_id='303dca207b5f4da297e8ab1fc41ff466',uuid=5b5d13c5-5d82-440a-9346-6a4c9ee63bfb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78bdfbfa-3578-4ef5-b499-decd609cba62", "address": "fa:16:3e:b1:55:61", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78bdfbfa-35", "ovs_interfaceid": "78bdfbfa-3578-4ef5-b499-decd609cba62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:16:18 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-95877d8b-ef4e-462e-810c-2bfbe1260223 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Converting VIF {"id": "78bdfbfa-3578-4ef5-b499-decd609cba62", "address": "fa:16:3e:b1:55:61", "network": {"id": "c153042b-16a0-4676-b024-f4583be62f74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401353237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9ccd434df9e458f80e5524c5c4c7a1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78bdfbfa-35", "ovs_interfaceid": "78bdfbfa-3578-4ef5-b499-decd609cba62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:16:18 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-95877d8b-ef4e-462e-810c-2bfbe1260223 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:55:61,bridge_name='br-int',has_traffic_filtering=True,id=78bdfbfa-3578-4ef5-b499-decd609cba62,network=Network(c153042b-16a0-4676-b024-f4583be62f74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78bdfbfa-35') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:16:18 user nova-compute[74898]: DEBUG os_vif [None req-95877d8b-ef4e-462e-810c-2bfbe1260223 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:55:61,bridge_name='br-int',has_traffic_filtering=True,id=78bdfbfa-3578-4ef5-b499-decd609cba62,network=Network(c153042b-16a0-4676-b024-f4583be62f74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78bdfbfa-35') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:16:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78bdfbfa-35, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:16:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:16:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=170457fc-c7ff-4026-a886-24393736dd63) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:16:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:18 user nova-compute[74898]: DEBUG nova.compute.manager [req-2e76b322-fc52-4dea-8a53-169926b0dfbe req-d622a5b3-9fbb-447c-821d-3a208bdaa79d service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Received event network-changed-cc6303d4-2332-4907-a0b1-7a4bf175282d {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:16:18 user nova-compute[74898]: DEBUG nova.compute.manager [req-2e76b322-fc52-4dea-8a53-169926b0dfbe req-d622a5b3-9fbb-447c-821d-3a208bdaa79d service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Refreshing instance network info cache due to event network-changed-cc6303d4-2332-4907-a0b1-7a4bf175282d. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:16:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-2e76b322-fc52-4dea-8a53-169926b0dfbe req-d622a5b3-9fbb-447c-821d-3a208bdaa79d service nova] Acquiring lock "refresh_cache-3b325f5d-481c-410e-910a-f29df36caec2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:16:18 user nova-compute[74898]: INFO os_vif [None req-95877d8b-ef4e-462e-810c-2bfbe1260223 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:55:61,bridge_name='br-int',has_traffic_filtering=True,id=78bdfbfa-3578-4ef5-b499-decd609cba62,network=Network(c153042b-16a0-4676-b024-f4583be62f74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78bdfbfa-35')
Nov 17 03:16:18 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-95877d8b-ef4e-462e-810c-2bfbe1260223 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Deleting instance files /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb_del
Nov 17 03:16:18 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-95877d8b-ef4e-462e-810c-2bfbe1260223 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Deletion of /opt/stack/data/nova/instances/5b5d13c5-5d82-440a-9346-6a4c9ee63bfb_del complete
Nov 17 03:16:18 user nova-compute[74898]: INFO nova.compute.manager [None req-95877d8b-ef4e-462e-810c-2bfbe1260223 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 17 03:16:18 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-95877d8b-ef4e-462e-810c-2bfbe1260223 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:16:18 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:16:18 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:16:18 user nova-compute[74898]: DEBUG nova.network.neutron [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Updating instance_info_cache with network_info: [{"id": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "address": "fa:16:3e:75:38:b0", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6303d4-23", "ovs_interfaceid": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:16:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Releasing lock "refresh_cache-3b325f5d-481c-410e-910a-f29df36caec2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:16:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-2e76b322-fc52-4dea-8a53-169926b0dfbe req-d622a5b3-9fbb-447c-821d-3a208bdaa79d service nova] Acquired lock "refresh_cache-3b325f5d-481c-410e-910a-f29df36caec2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:16:18 user nova-compute[74898]: DEBUG nova.network.neutron [req-2e76b322-fc52-4dea-8a53-169926b0dfbe req-d622a5b3-9fbb-447c-821d-3a208bdaa79d service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Refreshing network info cache for port cc6303d4-2332-4907-a0b1-7a4bf175282d {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:16:18 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Starting migrate_disk_and_power_off {{(pid=74898) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 17 03:16:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG nova.network.neutron [req-2e76b322-fc52-4dea-8a53-169926b0dfbe req-d622a5b3-9fbb-447c-821d-3a208bdaa79d service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Updated VIF entry in instance network info cache for port cc6303d4-2332-4907-a0b1-7a4bf175282d. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG nova.network.neutron [req-2e76b322-fc52-4dea-8a53-169926b0dfbe req-d622a5b3-9fbb-447c-821d-3a208bdaa79d service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Updating instance_info_cache with network_info: [{"id": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "address": "fa:16:3e:75:38:b0", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6303d4-23", "ovs_interfaceid": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-2e76b322-fc52-4dea-8a53-169926b0dfbe req-d622a5b3-9fbb-447c-821d-3a208bdaa79d service nova] Releasing lock "refresh_cache-3b325f5d-481c-410e-910a-f29df36caec2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:16:19 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Took 0.82 seconds to deallocate network for instance.
Nov 17 03:16:19 user nova-compute[74898]: DEBUG nova.compute.manager [req-f93663f4-d5fe-4288-9e74-fa87d3247fcb req-c345c50a-6b32-482d-a22c-76ca3ac887c1 service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received event network-vif-deleted-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-95877d8b-ef4e-462e-810c-2bfbe1260223 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-95877d8b-ef4e-462e-810c-2bfbe1260223 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:16:19 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Instance destroyed successfully.
Nov 17 03:16:19 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1434129510',display_name='tempest-ServerActionsTestOtherA-server-1434129510',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1434129510',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGXK5tLG9vQRvq8SJwGRy2Vz7FVpdMueKXoroRQhoaTXP+S/vHTHRNXWHjGdbL7ZfWa7nQ7EpuIvdSjNY8pD+Io25QXwMjrtjgT3+jZPylEXHxX7Pj0OQhFvC17oY0/CA==',key_name='tempest-keypair-1226860529',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:14:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4ff82629b7d7486a86574994974fabda',ramdisk_id='',reservation_id='r-kppu8s8d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-214359699',owner_user_name='tempest-ServerActionsTestOtherA-214359699-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:16:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28445b2b2360414bac2607ec94166369',uuid=3b325f5d-481c-410e-910a-f29df36caec2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "address": "fa:16:3e:75:38:b0", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-216048622-network", "vif_mac": "fa:16:3e:75:38:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6303d4-23", "ovs_interfaceid": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Converting VIF {"id": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "address": "fa:16:3e:75:38:b0", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-216048622-network", "vif_mac": "fa:16:3e:75:38:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6303d4-23", "ovs_interfaceid": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:38:b0,bridge_name='br-int',has_traffic_filtering=True,id=cc6303d4-2332-4907-a0b1-7a4bf175282d,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc6303d4-23') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG os_vif [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:38:b0,bridge_name='br-int',has_traffic_filtering=True,id=cc6303d4-2332-4907-a0b1-7a4bf175282d,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc6303d4-23') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc6303d4-23, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11222545-9a32-4067-b212-2356da58841e) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:19 user nova-compute[74898]: INFO os_vif [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:38:b0,bridge_name='br-int',has_traffic_filtering=True,id=cc6303d4-2332-4907-a0b1-7a4bf175282d,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc6303d4-23')
Nov 17 03:16:19 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVQaZPJS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:16:19 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:16:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e9c4ca-bc35-45d9-a4b9-8f49aabd3503]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:16:19 user nova-compute[74898]: No targets found.
Nov 17 03:16:19 user nova-compute[74898]: iSNS:
Nov 17 03:16:19 user nova-compute[74898]: No targets found.
Nov 17 03:16:19 user nova-compute[74898]: STATIC:
Nov 17 03:16:19 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5
Nov 17 03:16:19 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:16:19 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:16:19 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4
Nov 17 03:16:19 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:16:19 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:16:19 user nova-compute[74898]: FIRMWARE:
Nov 17 03:16:19 user nova-compute[74898]: No targets found.
Nov 17 03:16:19 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:16:19 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:16:19 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ba3e70-2105-495d-8cd6-934179d7f11a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57984ba-ea1d-4c7c-99fe-9a3d197e1627]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:16:19 user nova-compute[74898]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:16:19 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:16:19 user nova-compute[74898]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:16:19 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9c18458940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5'): ({'sdb'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Removing single pathed devices sdb {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47e4975-02e0-486a-940b-c316d2bf2b96]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d4a766-e83d-474d-857c-d74343a2a4c2]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Flushing IO for device /dev/sdb {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-95877d8b-ef4e-462e-810c-2bfbe1260223 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[09765e16-580b-41c6-9346-35259ae51466]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-95877d8b-ef4e-462e-810c-2bfbe1260223 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-95877d8b-ef4e-462e-810c-2bfbe1260223 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cb0962-70b4-4319-b54c-5f71b12c8e82]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_9a3796a8', '/dev/disk/by-id/scsi-1SCST_BIO9a3796a8-eb044dce1104f04e', '/dev/disk/by-id/scsi-26562303434646365') {{(pid=86021) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08a2d1e-8e12-40b9-bf95-d2094b78518b]: (4, None) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8dd146-007f-4854-9db2-99c0e87dc6b3]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:19 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-95877d8b-ef4e-462e-810c-2bfbe1260223 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Deleted allocations for instance 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a642ff46-4526-463f-94c4-3a717824446a]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5, portal: 172.16.0.220,3260]
Nov 17 03:16:19 user nova-compute[74898]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5, portal: 172.16.0.220,3260] successful.
Nov 17 03:16:19 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[81209205-ab2d-47c4-a2ac-5876a6193d8d]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] <== disconnect_volume: return (326ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-95877d8b-ef4e-462e-810c-2bfbe1260223 tempest-ServerRescueNegativeTestJSON-1788589536 tempest-ServerRescueNegativeTestJSON-1788589536-project-member] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.160s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:16:19 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:16:20 user nova-compute[74898]: DEBUG nova.compute.manager [req-7915427a-e595-4e28-936b-edaa8bd4c3f6 req-b9ee543f-940c-4173-823a-616170d949b7 service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received event network-vif-unplugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:16:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7915427a-e595-4e28-936b-edaa8bd4c3f6 req-b9ee543f-940c-4173-823a-616170d949b7 service nova] Acquiring lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:16:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7915427a-e595-4e28-936b-edaa8bd4c3f6 req-b9ee543f-940c-4173-823a-616170d949b7 service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:16:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7915427a-e595-4e28-936b-edaa8bd4c3f6 req-b9ee543f-940c-4173-823a-616170d949b7 service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:16:20 user nova-compute[74898]: DEBUG nova.compute.manager [req-7915427a-e595-4e28-936b-edaa8bd4c3f6 req-b9ee543f-940c-4173-823a-616170d949b7 service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] No waiting events found dispatching network-vif-unplugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:16:20 user nova-compute[74898]: WARNING nova.compute.manager [req-7915427a-e595-4e28-936b-edaa8bd4c3f6 req-b9ee543f-940c-4173-823a-616170d949b7 service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received unexpected event network-vif-unplugged-78bdfbfa-3578-4ef5-b499-decd609cba62 for instance with vm_state deleted and task_state None.
Nov 17 03:16:20 user nova-compute[74898]: DEBUG nova.compute.manager [req-7915427a-e595-4e28-936b-edaa8bd4c3f6 req-b9ee543f-940c-4173-823a-616170d949b7 service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received event network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:16:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7915427a-e595-4e28-936b-edaa8bd4c3f6 req-b9ee543f-940c-4173-823a-616170d949b7 service nova] Acquiring lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:16:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7915427a-e595-4e28-936b-edaa8bd4c3f6 req-b9ee543f-940c-4173-823a-616170d949b7 service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:16:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7915427a-e595-4e28-936b-edaa8bd4c3f6 req-b9ee543f-940c-4173-823a-616170d949b7 service nova] Lock "5b5d13c5-5d82-440a-9346-6a4c9ee63bfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:16:20 user nova-compute[74898]: DEBUG nova.compute.manager [req-7915427a-e595-4e28-936b-edaa8bd4c3f6 req-b9ee543f-940c-4173-823a-616170d949b7 service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] No waiting events found dispatching network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:16:20 user nova-compute[74898]: WARNING nova.compute.manager [req-7915427a-e595-4e28-936b-edaa8bd4c3f6 req-b9ee543f-940c-4173-823a-616170d949b7 service nova] [instance: 5b5d13c5-5d82-440a-9346-6a4c9ee63bfb] Received unexpected event network-vif-plugged-78bdfbfa-3578-4ef5-b499-decd609cba62 for instance with vm_state deleted and task_state None.
Nov 17 03:16:20 user nova-compute[74898]: DEBUG nova.compute.manager [req-7915427a-e595-4e28-936b-edaa8bd4c3f6 req-b9ee543f-940c-4173-823a-616170d949b7 service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Received event network-vif-unplugged-cc6303d4-2332-4907-a0b1-7a4bf175282d {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:16:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7915427a-e595-4e28-936b-edaa8bd4c3f6 req-b9ee543f-940c-4173-823a-616170d949b7 service nova] Acquiring lock "3b325f5d-481c-410e-910a-f29df36caec2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:16:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7915427a-e595-4e28-936b-edaa8bd4c3f6 req-b9ee543f-940c-4173-823a-616170d949b7 service nova] Lock "3b325f5d-481c-410e-910a-f29df36caec2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:16:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7915427a-e595-4e28-936b-edaa8bd4c3f6 req-b9ee543f-940c-4173-823a-616170d949b7 service nova] Lock "3b325f5d-481c-410e-910a-f29df36caec2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:16:20 user nova-compute[74898]: DEBUG nova.compute.manager [req-7915427a-e595-4e28-936b-edaa8bd4c3f6 req-b9ee543f-940c-4173-823a-616170d949b7 service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] No waiting events found dispatching network-vif-unplugged-cc6303d4-2332-4907-a0b1-7a4bf175282d {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:16:20 user nova-compute[74898]: WARNING nova.compute.manager [req-7915427a-e595-4e28-936b-edaa8bd4c3f6 req-b9ee543f-940c-4173-823a-616170d949b7 service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Received unexpected event network-vif-unplugged-cc6303d4-2332-4907-a0b1-7a4bf175282d for instance with vm_state active and task_state resize_migrating.
Nov 17 03:16:20 user nova-compute[74898]: DEBUG nova.compute.manager [req-7915427a-e595-4e28-936b-edaa8bd4c3f6 req-b9ee543f-940c-4173-823a-616170d949b7 service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Received event network-vif-plugged-cc6303d4-2332-4907-a0b1-7a4bf175282d {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:16:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7915427a-e595-4e28-936b-edaa8bd4c3f6 req-b9ee543f-940c-4173-823a-616170d949b7 service nova] Acquiring lock "3b325f5d-481c-410e-910a-f29df36caec2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:16:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7915427a-e595-4e28-936b-edaa8bd4c3f6 req-b9ee543f-940c-4173-823a-616170d949b7 service nova] Lock "3b325f5d-481c-410e-910a-f29df36caec2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:16:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7915427a-e595-4e28-936b-edaa8bd4c3f6 req-b9ee543f-940c-4173-823a-616170d949b7 service nova] Lock "3b325f5d-481c-410e-910a-f29df36caec2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:16:20 user nova-compute[74898]: DEBUG nova.compute.manager [req-7915427a-e595-4e28-936b-edaa8bd4c3f6 req-b9ee543f-940c-4173-823a-616170d949b7 service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] No waiting events found dispatching network-vif-plugged-cc6303d4-2332-4907-a0b1-7a4bf175282d {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:16:20 user nova-compute[74898]: WARNING nova.compute.manager [req-7915427a-e595-4e28-936b-edaa8bd4c3f6 req-b9ee543f-940c-4173-823a-616170d949b7 service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Received unexpected event network-vif-plugged-cc6303d4-2332-4907-a0b1-7a4bf175282d for instance with vm_state active and task_state resize_migrating.
Nov 17 03:16:20 user nova-compute[74898]: DEBUG nova.network.neutron [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Port cc6303d4-2332-4907-a0b1-7a4bf175282d binding to destination host user is already ACTIVE {{(pid=74898) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 17 03:16:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "3b325f5d-481c-410e-910a-f29df36caec2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:16:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "3b325f5d-481c-410e-910a-f29df36caec2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:16:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "3b325f5d-481c-410e-910a-f29df36caec2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:16:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "refresh_cache-3b325f5d-481c-410e-910a-f29df36caec2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:16:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquired lock "refresh_cache-3b325f5d-481c-410e-910a-f29df36caec2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:16:20 user nova-compute[74898]: DEBUG nova.network.neutron [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:16:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:21 user nova-compute[74898]: DEBUG nova.network.neutron [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Updating instance_info_cache with network_info: [{"id": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "address": "fa:16:3e:75:38:b0", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6303d4-23", "ovs_interfaceid": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:16:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Releasing lock "refresh_cache-3b325f5d-481c-410e-910a-f29df36caec2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:16:21 user nova-compute[74898]: DEBUG os_brick.utils [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:16:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e655442f-d624-4cbf-8c2c-2d1dd4a8f761]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:16:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8bb0eb-0aca-44c9-8636-8d50baf7d935]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:16:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab62965-0f9d-4d13-a01e-ae80b6a4a4c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:16:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e7d6c7-f670-40e9-bb7e-6fdd023e6acb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:16:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:16:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:16:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:16:21 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:16:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1e90b7-d3d7-4fbd-a5ed-dc09a2062613]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:16:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:16:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:16:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:16:21 user nova-compute[74898]: DEBUG os_brick.utils [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:16:23 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:16:23 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:16:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:25 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:16:25 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Starting finish_migration {{(pid=74898) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Instance directory exists: not creating {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 17 03:16:26 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Creating image(s)
Nov 17 03:16:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Did not create local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Ensure instance console log exists: /opt/stack/data/nova/instances/3b325f5d-481c-410e-910a-f29df36caec2/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Start _get_guest_xml network_info=[{"id": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "address": "fa:16:3e:75:38:b0", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-216048622-network", "vif_mac": "fa:16:3e:75:38:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6303d4-23", "ovs_interfaceid": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVQaZPJS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '3b325f5d-481c-410e-910a-f29df36caec2', 'attached_at': '2023-11-17T03:16:27.000000', 'detached_at': '', 'volume_id': '274f0b23-bf75-4a48-8cb0-462cf98606e5', 'serial': '274f0b23-bf75-4a48-8cb0-462cf98606e5'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '8cc2e210-2984-4694-9119-1e3c009535b4', 'volume_type': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:16:26 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:16:26 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:16:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVQaZPJS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:16:26 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:16:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:16:26 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:16:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:16:26 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:16:26 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3616ff9a-207a-45d0-a222-762fa9d397fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:16:26 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7665e1-b811-4ab8-9e1f-1dfdbaab3e0b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5] added
Nov 17 03:16:26 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[02960318-72c1-4b49-b893-bdd025efcd45]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bfe95c-9f46-49cb-860c-daeff77c50af]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nVQaZPJS {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nVQaZPJS" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[12294404-04ad-43f7-9cf2-27fa0faee2bf]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nVQaZPJS'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbaefbb-93da-4c77-ac64-d6a3346fc849]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f43623-d355-40bc-97b8-eeaddd6af843]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:16:26 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:16:26 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:16:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9d5d34-9817-49e8-91d4-ec1ce5ec6f7e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:16:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5, portal: 172.16.0.220,3260]
Nov 17 03:16:27 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5, portal: 172.16.0.220,3260] successful.
Nov 17 03:16:27 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:16:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f363f1-c3a5-4184-990e-142345f713b3]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:16:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:16:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f263b8d-ccd9-4963-ad03-8a3267b355e9]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:16:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:16:27 user nova-compute[74898]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:16:27 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:16:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:16:27 user nova-compute[74898]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:16:27 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:16:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:16:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:16:27 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:16:27 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:16:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[02633716-e98f-42c9-ab6a-9bc7e296babd]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:16:27 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: None {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:16:28 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:16:28 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVQaZPJS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:16:28 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:16:28 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26562303434646365', 'path': '/dev/sdb'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:16:28 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562303434646365', 'path': '/dev/sdb'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:16:28 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1434129510',display_name='tempest-ServerActionsTestOtherA-server-1434129510',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1434129510',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGXK5tLG9vQRvq8SJwGRy2Vz7FVpdMueKXoroRQhoaTXP+S/vHTHRNXWHjGdbL7ZfWa7nQ7EpuIvdSjNY8pD+Io25QXwMjrtjgT3+jZPylEXHxX7Pj0OQhFvC17oY0/CA==',key_name='tempest-keypair-1226860529',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:14:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4ff82629b7d7486a86574994974fabda',ramdisk_id='',reservation_id='r-kppu8s8d',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-214359699',owner_user_name='tempest-ServerActionsTestOtherA-214359699-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28445b2b2360414bac2607ec94166369',uuid=3b325f5d-481c-410e-910a-f29df36caec2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "address": "fa:16:3e:75:38:b0", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-216048622-network", "vif_mac": "fa:16:3e:75:38:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6303d4-23", "ovs_interfaceid": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:16:28 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Converting VIF {"id": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "address": "fa:16:3e:75:38:b0", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-216048622-network", "vif_mac": "fa:16:3e:75:38:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6303d4-23", "ovs_interfaceid": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:16:28 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:38:b0,bridge_name='br-int',has_traffic_filtering=True,id=cc6303d4-2332-4907-a0b1-7a4bf175282d,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc6303d4-23') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:16:28 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:16:28 user nova-compute[74898]:   <uuid>3b325f5d-481c-410e-910a-f29df36caec2</uuid>
Nov 17 03:16:28 user nova-compute[74898]:   <name>instance-0000001e</name>
Nov 17 03:16:28 user nova-compute[74898]:   <memory>2097152</memory>
Nov 17 03:16:28 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:16:28 user nova-compute[74898]:   <metadata>
Nov 17 03:16:28 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:16:28 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:16:28 user nova-compute[74898]:       <nova:name>tempest-ServerActionsTestOtherA-server-1434129510</nova:name>
Nov 17 03:16:28 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:16:26</nova:creationTime>
Nov 17 03:16:28 user nova-compute[74898]:       <nova:flavor name="m1.small">
Nov 17 03:16:28 user nova-compute[74898]:         <nova:memory>2048</nova:memory>
Nov 17 03:16:28 user nova-compute[74898]:         <nova:disk>20</nova:disk>
Nov 17 03:16:28 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:16:28 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:16:28 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:16:28 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:16:28 user nova-compute[74898]:       <nova:owner>
Nov 17 03:16:28 user nova-compute[74898]:         <nova:user uuid="28445b2b2360414bac2607ec94166369">tempest-ServerActionsTestOtherA-214359699-project-member</nova:user>
Nov 17 03:16:28 user nova-compute[74898]:         <nova:project uuid="4ff82629b7d7486a86574994974fabda">tempest-ServerActionsTestOtherA-214359699</nova:project>
Nov 17 03:16:28 user nova-compute[74898]:       </nova:owner>
Nov 17 03:16:28 user nova-compute[74898]:       <nova:ports>
Nov 17 03:16:28 user nova-compute[74898]:         <nova:port uuid="cc6303d4-2332-4907-a0b1-7a4bf175282d">
Nov 17 03:16:28 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 17 03:16:28 user nova-compute[74898]:         </nova:port>
Nov 17 03:16:28 user nova-compute[74898]:       </nova:ports>
Nov 17 03:16:28 user nova-compute[74898]:     </nova:instance>
Nov 17 03:16:28 user nova-compute[74898]:   </metadata>
Nov 17 03:16:28 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:16:28 user nova-compute[74898]:     <system>
Nov 17 03:16:28 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:16:28 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:16:28 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:16:28 user nova-compute[74898]:       <entry name="serial">3b325f5d-481c-410e-910a-f29df36caec2</entry>
Nov 17 03:16:28 user nova-compute[74898]:       <entry name="uuid">3b325f5d-481c-410e-910a-f29df36caec2</entry>
Nov 17 03:16:28 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:16:28 user nova-compute[74898]:     </system>
Nov 17 03:16:28 user nova-compute[74898]:   </sysinfo>
Nov 17 03:16:28 user nova-compute[74898]:   <os>
Nov 17 03:16:28 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:16:28 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:16:28 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:16:28 user nova-compute[74898]:   </os>
Nov 17 03:16:28 user nova-compute[74898]:   <features>
Nov 17 03:16:28 user nova-compute[74898]:     <acpi/>
Nov 17 03:16:28 user nova-compute[74898]:     <apic/>
Nov 17 03:16:28 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:16:28 user nova-compute[74898]:   </features>
Nov 17 03:16:28 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:16:28 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:16:28 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:16:28 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:16:28 user nova-compute[74898]:   </clock>
Nov 17 03:16:28 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:16:28 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:16:28 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:16:28 user nova-compute[74898]:   </cpu>
Nov 17 03:16:28 user nova-compute[74898]:   <devices>
Nov 17 03:16:28 user nova-compute[74898]:     <disk type="block" device="disk">
Nov 17 03:16:28 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:16:28 user nova-compute[74898]:       <source dev="/dev/sdb"/>
Nov 17 03:16:28 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:16:28 user nova-compute[74898]:       <serial>274f0b23-bf75-4a48-8cb0-462cf98606e5</serial>
Nov 17 03:16:28 user nova-compute[74898]:     </disk>
Nov 17 03:16:28 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:16:28 user nova-compute[74898]:       <mac address="fa:16:3e:75:38:b0"/>
Nov 17 03:16:28 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:16:28 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:16:28 user nova-compute[74898]:       <target dev="tapcc6303d4-23"/>
Nov 17 03:16:28 user nova-compute[74898]:     </interface>
Nov 17 03:16:28 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:16:28 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/3b325f5d-481c-410e-910a-f29df36caec2/console.log" append="off"/>
Nov 17 03:16:28 user nova-compute[74898]:     </serial>
Nov 17 03:16:28 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:16:28 user nova-compute[74898]:     <video>
Nov 17 03:16:28 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:16:28 user nova-compute[74898]:     </video>
Nov 17 03:16:28 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:16:28 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:16:28 user nova-compute[74898]:     </rng>
Nov 17 03:16:28 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:16:28 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:16:28 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:16:28 user nova-compute[74898]:     </memballoon>
Nov 17 03:16:28 user nova-compute[74898]:   </devices>
Nov 17 03:16:28 user nova-compute[74898]: </domain>
Nov 17 03:16:28 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:16:28 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1434129510',display_name='tempest-ServerActionsTestOtherA-server-1434129510',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1434129510',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGXK5tLG9vQRvq8SJwGRy2Vz7FVpdMueKXoroRQhoaTXP+S/vHTHRNXWHjGdbL7ZfWa7nQ7EpuIvdSjNY8pD+Io25QXwMjrtjgT3+jZPylEXHxX7Pj0OQhFvC17oY0/CA==',key_name='tempest-keypair-1226860529',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:14:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4ff82629b7d7486a86574994974fabda',ramdisk_id='',reservation_id='r-kppu8s8d',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-214359699',owner_user_name='tempest-ServerActionsTestOtherA-214359699-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28445b2b2360414bac2607ec94166369',uuid=3b325f5d-481c-410e-910a-f29df36caec2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "address": "fa:16:3e:75:38:b0", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-216048622-network", "vif_mac": "fa:16:3e:75:38:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6303d4-23", "ovs_interfaceid": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:16:28 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Converting VIF {"id": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "address": "fa:16:3e:75:38:b0", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-216048622-network", "vif_mac": "fa:16:3e:75:38:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6303d4-23", "ovs_interfaceid": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:16:28 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:38:b0,bridge_name='br-int',has_traffic_filtering=True,id=cc6303d4-2332-4907-a0b1-7a4bf175282d,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc6303d4-23') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:16:28 user nova-compute[74898]: DEBUG os_vif [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:38:b0,bridge_name='br-int',has_traffic_filtering=True,id=cc6303d4-2332-4907-a0b1-7a4bf175282d,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc6303d4-23') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:16:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:16:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:16:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0778678a-75ef-5279-98fe-7d2559c26f4b', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:16:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:16:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc6303d4-23, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:16:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc6303d4-23, col_values=(('qos', UUID('d19965a8-1874-420d-96a2-3d94d70fe532')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:16:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc6303d4-23, col_values=(('external_ids', {'iface-id': 'cc6303d4-2332-4907-a0b1-7a4bf175282d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:38:b0', 'vm-uuid': '3b325f5d-481c-410e-910a-f29df36caec2'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:16:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:16:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:28 user nova-compute[74898]: INFO os_vif [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:38:b0,bridge_name='br-int',has_traffic_filtering=True,id=cc6303d4-2332-4907-a0b1-7a4bf175282d,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc6303d4-23')
Nov 17 03:16:28 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:16:28 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] No VIF found with MAC fa:16:3e:75:38:b0, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:16:28 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:16:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:29 user nova-compute[74898]: DEBUG nova.compute.manager [req-c9fd81e6-f4d4-4951-8bd3-b6ab327f5af6 req-881e6fc1-d550-4890-9a68-944d359c84bb service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Received event network-vif-plugged-cc6303d4-2332-4907-a0b1-7a4bf175282d {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:16:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c9fd81e6-f4d4-4951-8bd3-b6ab327f5af6 req-881e6fc1-d550-4890-9a68-944d359c84bb service nova] Acquiring lock "3b325f5d-481c-410e-910a-f29df36caec2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:16:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c9fd81e6-f4d4-4951-8bd3-b6ab327f5af6 req-881e6fc1-d550-4890-9a68-944d359c84bb service nova] Lock "3b325f5d-481c-410e-910a-f29df36caec2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:16:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c9fd81e6-f4d4-4951-8bd3-b6ab327f5af6 req-881e6fc1-d550-4890-9a68-944d359c84bb service nova] Lock "3b325f5d-481c-410e-910a-f29df36caec2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:16:29 user nova-compute[74898]: DEBUG nova.compute.manager [req-c9fd81e6-f4d4-4951-8bd3-b6ab327f5af6 req-881e6fc1-d550-4890-9a68-944d359c84bb service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] No waiting events found dispatching network-vif-plugged-cc6303d4-2332-4907-a0b1-7a4bf175282d {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:16:29 user nova-compute[74898]: WARNING nova.compute.manager [req-c9fd81e6-f4d4-4951-8bd3-b6ab327f5af6 req-881e6fc1-d550-4890-9a68-944d359c84bb service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Received unexpected event network-vif-plugged-cc6303d4-2332-4907-a0b1-7a4bf175282d for instance with vm_state active and task_state resize_finish.
Nov 17 03:16:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:30 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:16:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:16:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:16:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:16:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:16:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:31 user nova-compute[74898]: DEBUG nova.compute.manager [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:16:31 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Instance running successfully.
Nov 17 03:16:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Failed to set time: agent not configured {{(pid=74898) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 17 03:16:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-638b2a8e-1050-453b-b58a-8ffaaddf0f11 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] finish_migration finished successfully. {{(pid=74898) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 17 03:16:31 user nova-compute[74898]: DEBUG nova.compute.manager [req-92708596-5813-4cd4-92a7-f82aec405db2 req-798556d7-0483-45d8-91b8-d7f23455d704 service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Received event network-vif-plugged-cc6303d4-2332-4907-a0b1-7a4bf175282d {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:16:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-92708596-5813-4cd4-92a7-f82aec405db2 req-798556d7-0483-45d8-91b8-d7f23455d704 service nova] Acquiring lock "3b325f5d-481c-410e-910a-f29df36caec2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:16:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-92708596-5813-4cd4-92a7-f82aec405db2 req-798556d7-0483-45d8-91b8-d7f23455d704 service nova] Lock "3b325f5d-481c-410e-910a-f29df36caec2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:16:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-92708596-5813-4cd4-92a7-f82aec405db2 req-798556d7-0483-45d8-91b8-d7f23455d704 service nova] Lock "3b325f5d-481c-410e-910a-f29df36caec2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:16:31 user nova-compute[74898]: DEBUG nova.compute.manager [req-92708596-5813-4cd4-92a7-f82aec405db2 req-798556d7-0483-45d8-91b8-d7f23455d704 service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] No waiting events found dispatching network-vif-plugged-cc6303d4-2332-4907-a0b1-7a4bf175282d {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:16:31 user nova-compute[74898]: WARNING nova.compute.manager [req-92708596-5813-4cd4-92a7-f82aec405db2 req-798556d7-0483-45d8-91b8-d7f23455d704 service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Received unexpected event network-vif-plugged-cc6303d4-2332-4907-a0b1-7a4bf175282d for instance with vm_state active and task_state resize_finish.
Nov 17 03:16:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:16:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:16:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:16:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:16:34 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:16:34 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:16:34 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=7935MB free_disk=25.24954605102539GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:16:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:16:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:16:34 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Applying migration context for instance 3b325f5d-481c-410e-910a-f29df36caec2 as it has an incoming, in-progress migration 4acb6081-4ad6-47ef-80b1-fd374e3e3ef2. Migration status is finished {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 17 03:16:34 user nova-compute[74898]: INFO nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Updating resource usage from migration 4acb6081-4ad6-47ef-80b1-fd374e3e3ef2
Nov 17 03:16:34 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 42994e39-187a-4fb6-a293-24a4eb57177b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:16:34 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 13449e5c-809b-4db2-af0b-53f5865eb3a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:16:34 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance c49f4ec3-6f9b-4e14-ba29-208aa026301e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:16:34 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance ff69d6dd-bce4-400b-8f03-429068cf32eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:16:34 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 24cd7ac4-3724-4189-82a7-ba61ba46097a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:16:34 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance ecb90e79-877e-4012-b569-53aefd96de38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:16:34 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 6eee4731-60ed-41ab-905e-395aa4d5e568 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:16:34 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Migration 4acb6081-4ad6-47ef-80b1-fd374e3e3ef2 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 17 03:16:34 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 3b325f5d-481c-410e-910a-f29df36caec2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:16:34 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:16:34 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:16:34 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:16:34 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:16:34 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:16:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.433s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:16:35 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:16:35 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:16:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-13449e5c-809b-4db2-af0b-53f5865eb3a4" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:16:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-13449e5c-809b-4db2-af0b-53f5865eb3a4" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:16:36 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:16:36 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Updating instance_info_cache with network_info: [{"id": "2bdfdbe2-b457-4078-b4be-979a51ba442a", "address": "fa:16:3e:a1:96:f0", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdfdbe2-b4", "ovs_interfaceid": "2bdfdbe2-b457-4078-b4be-979a51ba442a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:16:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-13449e5c-809b-4db2-af0b-53f5865eb3a4" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:16:36 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:16:36 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:16:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:16:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:16:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:16:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:16:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:16:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:16:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:16:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:16:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:16:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-434f48dc-3972-41d3-b3c9-ec73d11776fb tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "ecb90e79-877e-4012-b569-53aefd96de38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:17:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-434f48dc-3972-41d3-b3c9-ec73d11776fb tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "ecb90e79-877e-4012-b569-53aefd96de38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:17:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-434f48dc-3972-41d3-b3c9-ec73d11776fb tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "ecb90e79-877e-4012-b569-53aefd96de38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:17:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-434f48dc-3972-41d3-b3c9-ec73d11776fb tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "ecb90e79-877e-4012-b569-53aefd96de38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:17:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-434f48dc-3972-41d3-b3c9-ec73d11776fb tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "ecb90e79-877e-4012-b569-53aefd96de38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:17:07 user nova-compute[74898]: INFO nova.compute.manager [None req-434f48dc-3972-41d3-b3c9-ec73d11776fb tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Terminating instance
Nov 17 03:17:07 user nova-compute[74898]: DEBUG nova.compute.manager [None req-434f48dc-3972-41d3-b3c9-ec73d11776fb tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:17:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:08 user nova-compute[74898]: DEBUG nova.compute.manager [req-4c4a400b-c7c5-4b76-8d6a-2a60994809a7 req-d5efba75-5728-4458-8ad7-f4e310c1b965 service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Received event network-vif-unplugged-794c112e-9370-4bcc-9fc1-51a9c3b692e1 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:17:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4c4a400b-c7c5-4b76-8d6a-2a60994809a7 req-d5efba75-5728-4458-8ad7-f4e310c1b965 service nova] Acquiring lock "ecb90e79-877e-4012-b569-53aefd96de38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:17:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4c4a400b-c7c5-4b76-8d6a-2a60994809a7 req-d5efba75-5728-4458-8ad7-f4e310c1b965 service nova] Lock "ecb90e79-877e-4012-b569-53aefd96de38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:17:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4c4a400b-c7c5-4b76-8d6a-2a60994809a7 req-d5efba75-5728-4458-8ad7-f4e310c1b965 service nova] Lock "ecb90e79-877e-4012-b569-53aefd96de38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:17:08 user nova-compute[74898]: DEBUG nova.compute.manager [req-4c4a400b-c7c5-4b76-8d6a-2a60994809a7 req-d5efba75-5728-4458-8ad7-f4e310c1b965 service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] No waiting events found dispatching network-vif-unplugged-794c112e-9370-4bcc-9fc1-51a9c3b692e1 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:17:08 user nova-compute[74898]: DEBUG nova.compute.manager [req-4c4a400b-c7c5-4b76-8d6a-2a60994809a7 req-d5efba75-5728-4458-8ad7-f4e310c1b965 service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Received event network-vif-unplugged-794c112e-9370-4bcc-9fc1-51a9c3b692e1 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:17:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:08 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Instance destroyed successfully.
Nov 17 03:17:08 user nova-compute[74898]: DEBUG nova.objects.instance [None req-434f48dc-3972-41d3-b3c9-ec73d11776fb tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lazy-loading 'resources' on Instance uuid ecb90e79-877e-4012-b569-53aefd96de38 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:17:08 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-434f48dc-3972-41d3-b3c9-ec73d11776fb tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-17T03:11:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2100741292',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2100741292',id=28,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtbu5U3PmGex6+l+d2xQitFVFUhTB/42hBUcwFM3rFddUybYVm/HJa1SSl7ynLj16o3HC8Me2Uv8377M/7TJKq0m1jfyBGUoyNiWj576PEY80BEbiklEpgOviDozZNNhg==',key_name='tempest-keypair-301754943',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:15:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3de7d05d475c49f0805f5aab5853a0b2',ramdisk_id='',reservation_id='r-plwophpo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-940982522',owner_user_name='tempest-AttachVolumeShelveTestJSON-940982522-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:15:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='926d8bd27eb24824a71cb9f1969f9c45',uuid=ecb90e79-877e-4012-b569-53aefd96de38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "address": "fa:16:3e:bd:21:91", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794c112e-93", "ovs_interfaceid": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:17:08 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-434f48dc-3972-41d3-b3c9-ec73d11776fb tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Converting VIF {"id": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "address": "fa:16:3e:bd:21:91", "network": {"id": "c92bc72d-7b33-49a8-96e5-ca2ed117fa48", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1109992531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de7d05d475c49f0805f5aab5853a0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap794c112e-93", "ovs_interfaceid": "794c112e-9370-4bcc-9fc1-51a9c3b692e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:17:08 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-434f48dc-3972-41d3-b3c9-ec73d11776fb tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:21:91,bridge_name='br-int',has_traffic_filtering=True,id=794c112e-9370-4bcc-9fc1-51a9c3b692e1,network=Network(c92bc72d-7b33-49a8-96e5-ca2ed117fa48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap794c112e-93') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:17:08 user nova-compute[74898]: DEBUG os_vif [None req-434f48dc-3972-41d3-b3c9-ec73d11776fb tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:21:91,bridge_name='br-int',has_traffic_filtering=True,id=794c112e-9370-4bcc-9fc1-51a9c3b692e1,network=Network(c92bc72d-7b33-49a8-96e5-ca2ed117fa48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap794c112e-93') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:17:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap794c112e-93, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:17:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:17:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=24fb3338-6cbc-4be9-adfc-4f96bbc6c392) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:17:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:08 user nova-compute[74898]: INFO os_vif [None req-434f48dc-3972-41d3-b3c9-ec73d11776fb tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:21:91,bridge_name='br-int',has_traffic_filtering=True,id=794c112e-9370-4bcc-9fc1-51a9c3b692e1,network=Network(c92bc72d-7b33-49a8-96e5-ca2ed117fa48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap794c112e-93')
Nov 17 03:17:08 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-434f48dc-3972-41d3-b3c9-ec73d11776fb tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Deleting instance files /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38_del
Nov 17 03:17:08 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-434f48dc-3972-41d3-b3c9-ec73d11776fb tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Deletion of /opt/stack/data/nova/instances/ecb90e79-877e-4012-b569-53aefd96de38_del complete
Nov 17 03:17:08 user nova-compute[74898]: INFO nova.compute.manager [None req-434f48dc-3972-41d3-b3c9-ec73d11776fb tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 17 03:17:08 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-434f48dc-3972-41d3-b3c9-ec73d11776fb tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:17:08 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:17:08 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: ecb90e79-877e-4012-b569-53aefd96de38] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:17:09 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:17:09 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Took 0.80 seconds to deallocate network for instance.
Nov 17 03:17:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-434f48dc-3972-41d3-b3c9-ec73d11776fb tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:17:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-434f48dc-3972-41d3-b3c9-ec73d11776fb tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:17:09 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-434f48dc-3972-41d3-b3c9-ec73d11776fb tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:17:09 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-434f48dc-3972-41d3-b3c9-ec73d11776fb tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:17:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-434f48dc-3972-41d3-b3c9-ec73d11776fb tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:17:09 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-434f48dc-3972-41d3-b3c9-ec73d11776fb tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Deleted allocations for instance ecb90e79-877e-4012-b569-53aefd96de38
Nov 17 03:17:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-434f48dc-3972-41d3-b3c9-ec73d11776fb tempest-AttachVolumeShelveTestJSON-940982522 tempest-AttachVolumeShelveTestJSON-940982522-project-member] Lock "ecb90e79-877e-4012-b569-53aefd96de38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.194s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:17:10 user nova-compute[74898]: DEBUG nova.compute.manager [req-f8e1cd3d-407f-44ea-bd66-e9990d4a8968 req-5f2190e2-1430-449d-9ccf-96b47018464c service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Received event network-vif-plugged-794c112e-9370-4bcc-9fc1-51a9c3b692e1 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:17:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f8e1cd3d-407f-44ea-bd66-e9990d4a8968 req-5f2190e2-1430-449d-9ccf-96b47018464c service nova] Acquiring lock "ecb90e79-877e-4012-b569-53aefd96de38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:17:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f8e1cd3d-407f-44ea-bd66-e9990d4a8968 req-5f2190e2-1430-449d-9ccf-96b47018464c service nova] Lock "ecb90e79-877e-4012-b569-53aefd96de38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:17:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f8e1cd3d-407f-44ea-bd66-e9990d4a8968 req-5f2190e2-1430-449d-9ccf-96b47018464c service nova] Lock "ecb90e79-877e-4012-b569-53aefd96de38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:17:10 user nova-compute[74898]: DEBUG nova.compute.manager [req-f8e1cd3d-407f-44ea-bd66-e9990d4a8968 req-5f2190e2-1430-449d-9ccf-96b47018464c service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] No waiting events found dispatching network-vif-plugged-794c112e-9370-4bcc-9fc1-51a9c3b692e1 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:17:10 user nova-compute[74898]: WARNING nova.compute.manager [req-f8e1cd3d-407f-44ea-bd66-e9990d4a8968 req-5f2190e2-1430-449d-9ccf-96b47018464c service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Received unexpected event network-vif-plugged-794c112e-9370-4bcc-9fc1-51a9c3b692e1 for instance with vm_state deleted and task_state None.
Nov 17 03:17:10 user nova-compute[74898]: DEBUG nova.compute.manager [req-f8e1cd3d-407f-44ea-bd66-e9990d4a8968 req-5f2190e2-1430-449d-9ccf-96b47018464c service nova] [instance: ecb90e79-877e-4012-b569-53aefd96de38] Received event network-vif-deleted-794c112e-9370-4bcc-9fc1-51a9c3b692e1 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:17:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:17:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:17:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:17:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:17:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:23 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:17:23 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:17:26 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:17:27 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:17:27 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:17:27 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:17:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:17:28 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:17:30 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:17:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:17:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:17:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:17:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:17:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:17:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:17:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:17:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:17:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:17:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:17:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:17:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:17:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:17:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:17:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:17:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:17:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:17:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:17:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:17:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:17:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:17:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:17:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:17:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:17:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:17:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:17:33 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:17:33 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:17:33 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=8180MB free_disk=25.26659393310547GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:17:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:17:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:17:33 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Applying migration context for instance 3b325f5d-481c-410e-910a-f29df36caec2 as it has an incoming, in-progress migration 4acb6081-4ad6-47ef-80b1-fd374e3e3ef2. Migration status is finished {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 17 03:17:33 user nova-compute[74898]: INFO nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Updating resource usage from migration 4acb6081-4ad6-47ef-80b1-fd374e3e3ef2
Nov 17 03:17:33 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 42994e39-187a-4fb6-a293-24a4eb57177b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:17:33 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 13449e5c-809b-4db2-af0b-53f5865eb3a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:17:33 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance c49f4ec3-6f9b-4e14-ba29-208aa026301e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:17:33 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance ff69d6dd-bce4-400b-8f03-429068cf32eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:17:33 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 24cd7ac4-3724-4189-82a7-ba61ba46097a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:17:33 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 6eee4731-60ed-41ab-905e-395aa4d5e568 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:17:33 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Migration 4acb6081-4ad6-47ef-80b1-fd374e3e3ef2 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 17 03:17:33 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 3b325f5d-481c-410e-910a-f29df36caec2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:17:33 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:17:33 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:17:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:17:33 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:17:33 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:17:33 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:17:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.417s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:17:34 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:17:34 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:17:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-c49f4ec3-6f9b-4e14-ba29-208aa026301e" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:17:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-c49f4ec3-6f9b-4e14-ba29-208aa026301e" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:17:34 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:17:35 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Updating instance_info_cache with network_info: [{"id": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "address": "fa:16:3e:7d:3c:56", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89cfa577-9a", "ovs_interfaceid": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:17:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-c49f4ec3-6f9b-4e14-ba29-208aa026301e" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:17:35 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:17:35 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:17:37 user nova-compute[74898]: DEBUG nova.compute.manager [None req-3b7deb10-87d9-4513-864c-274c514ce164 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:17:37 user nova-compute[74898]: INFO nova.compute.manager [None req-3b7deb10-87d9-4513-864c-274c514ce164 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] instance snapshotting
Nov 17 03:17:37 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-3b7deb10-87d9-4513-864c-274c514ce164 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Beginning live snapshot process
Nov 17 03:17:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3b7deb10-87d9-4513-864c-274c514ce164 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json -f qcow2 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:17:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3b7deb10-87d9-4513-864c-274c514ce164 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:17:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3b7deb10-87d9-4513-864c-274c514ce164 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json -f qcow2 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:17:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3b7deb10-87d9-4513-864c-274c514ce164 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:17:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3b7deb10-87d9-4513-864c-274c514ce164 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:17:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3b7deb10-87d9-4513-864c-274c514ce164 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.180s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:17:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3b7deb10-87d9-4513-864c-274c514ce164 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpj2g4g_c9/6756f3c04b9c4af7a9d9e03a820b9d5c.delta 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:17:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3b7deb10-87d9-4513-864c-274c514ce164 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpj2g4g_c9/6756f3c04b9c4af7a9d9e03a820b9d5c.delta 1073741824" returned: 0 in 0.048s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:17:38 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-3b7deb10-87d9-4513-864c-274c514ce164 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 17 03:17:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:17:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:17:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:17:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:17:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-3b7deb10-87d9-4513-864c-274c514ce164 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74898) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 03:17:39 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:17:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-3b7deb10-87d9-4513-864c-274c514ce164 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74898) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 03:17:39 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-3b7deb10-87d9-4513-864c-274c514ce164 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 17 03:17:39 user nova-compute[74898]: DEBUG nova.privsep.utils [None req-3b7deb10-87d9-4513-864c-274c514ce164 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74898) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 03:17:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3b7deb10-87d9-4513-864c-274c514ce164 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpj2g4g_c9/6756f3c04b9c4af7a9d9e03a820b9d5c.delta /opt/stack/data/nova/instances/snapshots/tmpj2g4g_c9/6756f3c04b9c4af7a9d9e03a820b9d5c {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:17:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3b7deb10-87d9-4513-864c-274c514ce164 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpj2g4g_c9/6756f3c04b9c4af7a9d9e03a820b9d5c.delta /opt/stack/data/nova/instances/snapshots/tmpj2g4g_c9/6756f3c04b9c4af7a9d9e03a820b9d5c" returned: 0 in 0.725s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:17:40 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-3b7deb10-87d9-4513-864c-274c514ce164 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Snapshot extracted, beginning image upload
Nov 17 03:17:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ac38cc18-ad7f-4d9d-a110-846fc3e2dca2 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:17:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ac38cc18-ad7f-4d9d-a110-846fc3e2dca2 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:17:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ac38cc18-ad7f-4d9d-a110-846fc3e2dca2 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:17:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ac38cc18-ad7f-4d9d-a110-846fc3e2dca2 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:17:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ac38cc18-ad7f-4d9d-a110-846fc3e2dca2 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:17:41 user nova-compute[74898]: INFO nova.compute.manager [None req-ac38cc18-ad7f-4d9d-a110-846fc3e2dca2 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Terminating instance
Nov 17 03:17:41 user nova-compute[74898]: DEBUG nova.compute.manager [None req-ac38cc18-ad7f-4d9d-a110-846fc3e2dca2 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:17:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:41 user nova-compute[74898]: DEBUG nova.compute.manager [req-b65cab6a-d777-42c5-ac7f-84e9f48cc7af req-7fd94f9d-571b-445f-b5ac-f86137fb9682 service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Received event network-vif-unplugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:17:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b65cab6a-d777-42c5-ac7f-84e9f48cc7af req-7fd94f9d-571b-445f-b5ac-f86137fb9682 service nova] Acquiring lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:17:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b65cab6a-d777-42c5-ac7f-84e9f48cc7af req-7fd94f9d-571b-445f-b5ac-f86137fb9682 service nova] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:17:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b65cab6a-d777-42c5-ac7f-84e9f48cc7af req-7fd94f9d-571b-445f-b5ac-f86137fb9682 service nova] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:17:41 user nova-compute[74898]: DEBUG nova.compute.manager [req-b65cab6a-d777-42c5-ac7f-84e9f48cc7af req-7fd94f9d-571b-445f-b5ac-f86137fb9682 service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] No waiting events found dispatching network-vif-unplugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:17:41 user nova-compute[74898]: DEBUG nova.compute.manager [req-b65cab6a-d777-42c5-ac7f-84e9f48cc7af req-7fd94f9d-571b-445f-b5ac-f86137fb9682 service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Received event network-vif-unplugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:17:42 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Instance destroyed successfully.
Nov 17 03:17:42 user nova-compute[74898]: DEBUG nova.objects.instance [None req-ac38cc18-ad7f-4d9d-a110-846fc3e2dca2 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'resources' on Instance uuid c49f4ec3-6f9b-4e14-ba29-208aa026301e {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:17:42 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-ac38cc18-ad7f-4d9d-a110-846fc3e2dca2 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-559848382',display_name='tempest-AttachVolumeTestJSON-server-559848382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-559848382',id=23,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbyIJI2eENCayym7wJaTE5mkfjBea5My/OAyGGxTUZlk7cC9WDtXyYqwoAMcoNPQD8MTCjcX10bj1aNkxQk64CCPBoHWZhGjVWIxFCC/x0O8IS9lweYLOVUWDQLxxg2Nw==',key_name='tempest-keypair-1028377093',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:07:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08b13b86a294437da9a38ca4fd9b98e1',ramdisk_id='',reservation_id='r-ctvf81kq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1097544794',owner_user_name='tempest-AttachVolumeTestJSON-1097544794-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:15:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f67341bd3d3a47698364dcfc7a7c8a9a',uuid=c49f4ec3-6f9b-4e14-ba29-208aa026301e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "address": "fa:16:3e:7d:3c:56", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89cfa577-9a", "ovs_interfaceid": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:17:42 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-ac38cc18-ad7f-4d9d-a110-846fc3e2dca2 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Converting VIF {"id": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "address": "fa:16:3e:7d:3c:56", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89cfa577-9a", "ovs_interfaceid": "89cfa577-9add-4c3b-81be-59ddb7e34d59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:17:42 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-ac38cc18-ad7f-4d9d-a110-846fc3e2dca2 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:3c:56,bridge_name='br-int',has_traffic_filtering=True,id=89cfa577-9add-4c3b-81be-59ddb7e34d59,network=Network(b4bcd1f2-7a46-421a-8979-8ba9aca50ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89cfa577-9a') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:17:42 user nova-compute[74898]: DEBUG os_vif [None req-ac38cc18-ad7f-4d9d-a110-846fc3e2dca2 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:3c:56,bridge_name='br-int',has_traffic_filtering=True,id=89cfa577-9add-4c3b-81be-59ddb7e34d59,network=Network(b4bcd1f2-7a46-421a-8979-8ba9aca50ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89cfa577-9a') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:17:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89cfa577-9a, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:17:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:17:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fed8d515-2a2d-45e6-95af-d09e13e81ca8) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:17:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:42 user nova-compute[74898]: INFO os_vif [None req-ac38cc18-ad7f-4d9d-a110-846fc3e2dca2 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:3c:56,bridge_name='br-int',has_traffic_filtering=True,id=89cfa577-9add-4c3b-81be-59ddb7e34d59,network=Network(b4bcd1f2-7a46-421a-8979-8ba9aca50ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89cfa577-9a')
Nov 17 03:17:42 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-ac38cc18-ad7f-4d9d-a110-846fc3e2dca2 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Deleting instance files /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e_del
Nov 17 03:17:42 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-ac38cc18-ad7f-4d9d-a110-846fc3e2dca2 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Deletion of /opt/stack/data/nova/instances/c49f4ec3-6f9b-4e14-ba29-208aa026301e_del complete
Nov 17 03:17:42 user nova-compute[74898]: INFO nova.compute.manager [None req-ac38cc18-ad7f-4d9d-a110-846fc3e2dca2 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 17 03:17:42 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-ac38cc18-ad7f-4d9d-a110-846fc3e2dca2 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:17:42 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:17:42 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:17:43 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-3b7deb10-87d9-4513-864c-274c514ce164 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Snapshot image upload complete
Nov 17 03:17:43 user nova-compute[74898]: INFO nova.compute.manager [None req-3b7deb10-87d9-4513-864c-274c514ce164 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Took 5.41 seconds to snapshot the instance on the hypervisor.
Nov 17 03:17:43 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:17:43 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Took 0.91 seconds to deallocate network for instance.
Nov 17 03:17:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ac38cc18-ad7f-4d9d-a110-846fc3e2dca2 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:17:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ac38cc18-ad7f-4d9d-a110-846fc3e2dca2 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:17:43 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-ac38cc18-ad7f-4d9d-a110-846fc3e2dca2 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:17:43 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-ac38cc18-ad7f-4d9d-a110-846fc3e2dca2 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:17:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ac38cc18-ad7f-4d9d-a110-846fc3e2dca2 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.277s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:17:43 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-ac38cc18-ad7f-4d9d-a110-846fc3e2dca2 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Deleted allocations for instance c49f4ec3-6f9b-4e14-ba29-208aa026301e
Nov 17 03:17:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ac38cc18-ad7f-4d9d-a110-846fc3e2dca2 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.271s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:17:43 user nova-compute[74898]: DEBUG nova.compute.manager [req-be586265-7a45-4778-ad0a-5e9deda597ea req-f381fef8-183e-4e78-8239-ee62f5b57438 service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Received event network-vif-plugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:17:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-be586265-7a45-4778-ad0a-5e9deda597ea req-f381fef8-183e-4e78-8239-ee62f5b57438 service nova] Acquiring lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:17:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-be586265-7a45-4778-ad0a-5e9deda597ea req-f381fef8-183e-4e78-8239-ee62f5b57438 service nova] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:17:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-be586265-7a45-4778-ad0a-5e9deda597ea req-f381fef8-183e-4e78-8239-ee62f5b57438 service nova] Lock "c49f4ec3-6f9b-4e14-ba29-208aa026301e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:17:43 user nova-compute[74898]: DEBUG nova.compute.manager [req-be586265-7a45-4778-ad0a-5e9deda597ea req-f381fef8-183e-4e78-8239-ee62f5b57438 service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] No waiting events found dispatching network-vif-plugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:17:43 user nova-compute[74898]: WARNING nova.compute.manager [req-be586265-7a45-4778-ad0a-5e9deda597ea req-f381fef8-183e-4e78-8239-ee62f5b57438 service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Received unexpected event network-vif-plugged-89cfa577-9add-4c3b-81be-59ddb7e34d59 for instance with vm_state deleted and task_state None.
Nov 17 03:17:43 user nova-compute[74898]: DEBUG nova.compute.manager [req-be586265-7a45-4778-ad0a-5e9deda597ea req-f381fef8-183e-4e78-8239-ee62f5b57438 service nova] [instance: c49f4ec3-6f9b-4e14-ba29-208aa026301e] Received event network-vif-deleted-89cfa577-9add-4c3b-81be-59ddb7e34d59 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:17:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b525d96a-004b-4f5f-b7d4-ec2e5957d6c2 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Acquiring lock "ff69d6dd-bce4-400b-8f03-429068cf32eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:17:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b525d96a-004b-4f5f-b7d4-ec2e5957d6c2 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "ff69d6dd-bce4-400b-8f03-429068cf32eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:17:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b525d96a-004b-4f5f-b7d4-ec2e5957d6c2 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Acquiring lock "ff69d6dd-bce4-400b-8f03-429068cf32eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:17:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b525d96a-004b-4f5f-b7d4-ec2e5957d6c2 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "ff69d6dd-bce4-400b-8f03-429068cf32eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:17:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b525d96a-004b-4f5f-b7d4-ec2e5957d6c2 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "ff69d6dd-bce4-400b-8f03-429068cf32eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:17:54 user nova-compute[74898]: INFO nova.compute.manager [None req-b525d96a-004b-4f5f-b7d4-ec2e5957d6c2 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Terminating instance
Nov 17 03:17:54 user nova-compute[74898]: DEBUG nova.compute.manager [None req-b525d96a-004b-4f5f-b7d4-ec2e5957d6c2 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:17:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:54 user nova-compute[74898]: DEBUG nova.compute.manager [req-09890312-d5be-479a-9e68-68a5f1457de7 req-5ff6bb05-d334-4082-b3d2-25c60d43a057 service nova] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Received event network-vif-unplugged-4416778f-d8de-4b5e-bf50-fd2ccb987f26 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:17:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-09890312-d5be-479a-9e68-68a5f1457de7 req-5ff6bb05-d334-4082-b3d2-25c60d43a057 service nova] Acquiring lock "ff69d6dd-bce4-400b-8f03-429068cf32eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:17:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-09890312-d5be-479a-9e68-68a5f1457de7 req-5ff6bb05-d334-4082-b3d2-25c60d43a057 service nova] Lock "ff69d6dd-bce4-400b-8f03-429068cf32eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:17:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-09890312-d5be-479a-9e68-68a5f1457de7 req-5ff6bb05-d334-4082-b3d2-25c60d43a057 service nova] Lock "ff69d6dd-bce4-400b-8f03-429068cf32eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:17:54 user nova-compute[74898]: DEBUG nova.compute.manager [req-09890312-d5be-479a-9e68-68a5f1457de7 req-5ff6bb05-d334-4082-b3d2-25c60d43a057 service nova] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] No waiting events found dispatching network-vif-unplugged-4416778f-d8de-4b5e-bf50-fd2ccb987f26 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:17:54 user nova-compute[74898]: DEBUG nova.compute.manager [req-09890312-d5be-479a-9e68-68a5f1457de7 req-5ff6bb05-d334-4082-b3d2-25c60d43a057 service nova] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Received event network-vif-unplugged-4416778f-d8de-4b5e-bf50-fd2ccb987f26 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:17:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:55 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Instance destroyed successfully.
Nov 17 03:17:55 user nova-compute[74898]: DEBUG nova.objects.instance [None req-b525d96a-004b-4f5f-b7d4-ec2e5957d6c2 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lazy-loading 'resources' on Instance uuid ff69d6dd-bce4-400b-8f03-429068cf32eb {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:17:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-b525d96a-004b-4f5f-b7d4-ec2e5957d6c2 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:09:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1501098137',display_name='tempest-ServersNegativeTestJSON-server-1501098137',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1501098137',id=25,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:09:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f68ad714a1e48a4aac171700c25db18',ramdisk_id='',reservation_id='r-evmkpn1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-945120285',owner_user_name='tempest-ServersNegativeTestJSON-945120285-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:09:17Z,user_data=None,user_id='ebb3c9e75a2d4e858116fb214b411d8d',uuid=ff69d6dd-bce4-400b-8f03-429068cf32eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4416778f-d8de-4b5e-bf50-fd2ccb987f26", "address": "fa:16:3e:38:65:e3", "network": {"id": "9a342d69-a890-4e6d-af91-66e71d4a1ea8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1591686450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f68ad714a1e48a4aac171700c25db18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4416778f-d8", "ovs_interfaceid": "4416778f-d8de-4b5e-bf50-fd2ccb987f26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:17:55 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-b525d96a-004b-4f5f-b7d4-ec2e5957d6c2 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Converting VIF {"id": "4416778f-d8de-4b5e-bf50-fd2ccb987f26", "address": "fa:16:3e:38:65:e3", "network": {"id": "9a342d69-a890-4e6d-af91-66e71d4a1ea8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1591686450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f68ad714a1e48a4aac171700c25db18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4416778f-d8", "ovs_interfaceid": "4416778f-d8de-4b5e-bf50-fd2ccb987f26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:17:55 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-b525d96a-004b-4f5f-b7d4-ec2e5957d6c2 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:65:e3,bridge_name='br-int',has_traffic_filtering=True,id=4416778f-d8de-4b5e-bf50-fd2ccb987f26,network=Network(9a342d69-a890-4e6d-af91-66e71d4a1ea8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4416778f-d8') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:17:55 user nova-compute[74898]: DEBUG os_vif [None req-b525d96a-004b-4f5f-b7d4-ec2e5957d6c2 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:65:e3,bridge_name='br-int',has_traffic_filtering=True,id=4416778f-d8de-4b5e-bf50-fd2ccb987f26,network=Network(9a342d69-a890-4e6d-af91-66e71d4a1ea8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4416778f-d8') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:17:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4416778f-d8, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:17:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:17:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1567fc70-e1ac-4fce-a7dd-17e5c3e93f23) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:17:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:17:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:17:55 user nova-compute[74898]: INFO os_vif [None req-b525d96a-004b-4f5f-b7d4-ec2e5957d6c2 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:65:e3,bridge_name='br-int',has_traffic_filtering=True,id=4416778f-d8de-4b5e-bf50-fd2ccb987f26,network=Network(9a342d69-a890-4e6d-af91-66e71d4a1ea8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4416778f-d8')
Nov 17 03:17:55 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-b525d96a-004b-4f5f-b7d4-ec2e5957d6c2 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Deleting instance files /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb_del
Nov 17 03:17:55 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-b525d96a-004b-4f5f-b7d4-ec2e5957d6c2 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Deletion of /opt/stack/data/nova/instances/ff69d6dd-bce4-400b-8f03-429068cf32eb_del complete
Nov 17 03:17:55 user nova-compute[74898]: INFO nova.compute.manager [None req-b525d96a-004b-4f5f-b7d4-ec2e5957d6c2 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 17 03:17:55 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-b525d96a-004b-4f5f-b7d4-ec2e5957d6c2 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:17:55 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:17:55 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:17:55 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:17:55 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Took 0.77 seconds to deallocate network for instance.
Nov 17 03:17:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b525d96a-004b-4f5f-b7d4-ec2e5957d6c2 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:17:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b525d96a-004b-4f5f-b7d4-ec2e5957d6c2 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:17:56 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-b525d96a-004b-4f5f-b7d4-ec2e5957d6c2 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:17:56 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-b525d96a-004b-4f5f-b7d4-ec2e5957d6c2 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:17:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b525d96a-004b-4f5f-b7d4-ec2e5957d6c2 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:17:56 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-b525d96a-004b-4f5f-b7d4-ec2e5957d6c2 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Deleted allocations for instance ff69d6dd-bce4-400b-8f03-429068cf32eb
Nov 17 03:17:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b525d96a-004b-4f5f-b7d4-ec2e5957d6c2 tempest-ServersNegativeTestJSON-945120285 tempest-ServersNegativeTestJSON-945120285-project-member] Lock "ff69d6dd-bce4-400b-8f03-429068cf32eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.149s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:17:56 user nova-compute[74898]: DEBUG nova.compute.manager [req-29c7ccfb-2135-4ea4-bdf8-301b6fbf6728 req-89e26e8d-b8c7-47a9-b499-96e5aac7ed17 service nova] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Received event network-vif-plugged-4416778f-d8de-4b5e-bf50-fd2ccb987f26 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:17:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-29c7ccfb-2135-4ea4-bdf8-301b6fbf6728 req-89e26e8d-b8c7-47a9-b499-96e5aac7ed17 service nova] Acquiring lock "ff69d6dd-bce4-400b-8f03-429068cf32eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:17:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-29c7ccfb-2135-4ea4-bdf8-301b6fbf6728 req-89e26e8d-b8c7-47a9-b499-96e5aac7ed17 service nova] Lock "ff69d6dd-bce4-400b-8f03-429068cf32eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:17:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-29c7ccfb-2135-4ea4-bdf8-301b6fbf6728 req-89e26e8d-b8c7-47a9-b499-96e5aac7ed17 service nova] Lock "ff69d6dd-bce4-400b-8f03-429068cf32eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:17:56 user nova-compute[74898]: DEBUG nova.compute.manager [req-29c7ccfb-2135-4ea4-bdf8-301b6fbf6728 req-89e26e8d-b8c7-47a9-b499-96e5aac7ed17 service nova] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] No waiting events found dispatching network-vif-plugged-4416778f-d8de-4b5e-bf50-fd2ccb987f26 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:17:56 user nova-compute[74898]: WARNING nova.compute.manager [req-29c7ccfb-2135-4ea4-bdf8-301b6fbf6728 req-89e26e8d-b8c7-47a9-b499-96e5aac7ed17 service nova] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Received unexpected event network-vif-plugged-4416778f-d8de-4b5e-bf50-fd2ccb987f26 for instance with vm_state deleted and task_state None.
Nov 17 03:17:56 user nova-compute[74898]: DEBUG nova.compute.manager [req-29c7ccfb-2135-4ea4-bdf8-301b6fbf6728 req-89e26e8d-b8c7-47a9-b499-96e5aac7ed17 service nova] [instance: ff69d6dd-bce4-400b-8f03-429068cf32eb] Received event network-vif-deleted-4416778f-d8de-4b5e-bf50-fd2ccb987f26 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:18:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-271f8db9-c701-4299-ae3e-d912e8409f03 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "3b325f5d-481c-410e-910a-f29df36caec2" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:18:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-271f8db9-c701-4299-ae3e-d912e8409f03 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "3b325f5d-481c-410e-910a-f29df36caec2" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:18:07 user nova-compute[74898]: DEBUG nova.compute.manager [None req-271f8db9-c701-4299-ae3e-d912e8409f03 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Going to confirm migration 2 {{(pid=74898) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 17 03:18:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-271f8db9-c701-4299-ae3e-d912e8409f03 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "refresh_cache-3b325f5d-481c-410e-910a-f29df36caec2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:18:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-271f8db9-c701-4299-ae3e-d912e8409f03 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquired lock "refresh_cache-3b325f5d-481c-410e-910a-f29df36caec2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:18:07 user nova-compute[74898]: DEBUG nova.network.neutron [None req-271f8db9-c701-4299-ae3e-d912e8409f03 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:18:07 user nova-compute[74898]: DEBUG nova.objects.instance [None req-271f8db9-c701-4299-ae3e-d912e8409f03 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lazy-loading 'info_cache' on Instance uuid 3b325f5d-481c-410e-910a-f29df36caec2 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:18:08 user nova-compute[74898]: DEBUG nova.network.neutron [None req-271f8db9-c701-4299-ae3e-d912e8409f03 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Updating instance_info_cache with network_info: [{"id": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "address": "fa:16:3e:75:38:b0", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6303d4-23", "ovs_interfaceid": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:18:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-271f8db9-c701-4299-ae3e-d912e8409f03 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Releasing lock "refresh_cache-3b325f5d-481c-410e-910a-f29df36caec2" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:18:08 user nova-compute[74898]: DEBUG nova.objects.instance [None req-271f8db9-c701-4299-ae3e-d912e8409f03 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lazy-loading 'migration_context' on Instance uuid 3b325f5d-481c-410e-910a-f29df36caec2 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:18:08 user nova-compute[74898]: DEBUG nova.objects.base [None req-271f8db9-c701-4299-ae3e-d912e8409f03 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Object Instance<3b325f5d-481c-410e-910a-f29df36caec2> lazy-loaded attributes: info_cache,migration_context {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:18:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-271f8db9-c701-4299-ae3e-d912e8409f03 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:18:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-271f8db9-c701-4299-ae3e-d912e8409f03 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:18:08 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-271f8db9-c701-4299-ae3e-d912e8409f03 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:18:08 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-271f8db9-c701-4299-ae3e-d912e8409f03 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:18:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-271f8db9-c701-4299-ae3e-d912e8409f03 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.262s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:18:08 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-271f8db9-c701-4299-ae3e-d912e8409f03 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Deleted allocation for migration 4acb6081-4ad6-47ef-80b1-fd374e3e3ef2
Nov 17 03:18:08 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-271f8db9-c701-4299-ae3e-d912e8409f03 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "3b325f5d-481c-410e-910a-f29df36caec2" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.235s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:18:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:25 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:18:25 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:18:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:26 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:18:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:27 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:18:28 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:18:29 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:18:29 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:18:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:30 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:18:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:18:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:18:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:18:30 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:18:30 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:18:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:18:32 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:18:32 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:18:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=8504MB free_disk=25.269317626953125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:18:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:18:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:18:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 42994e39-187a-4fb6-a293-24a4eb57177b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:18:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 13449e5c-809b-4db2-af0b-53f5865eb3a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:18:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 24cd7ac4-3724-4189-82a7-ba61ba46097a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:18:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 6eee4731-60ed-41ab-905e-395aa4d5e568 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:18:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 3b325f5d-481c-410e-910a-f29df36caec2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:18:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:18:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:18:32 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:18:32 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:18:33 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:18:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.424s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:18:34 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:18:34 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:18:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-24cd7ac4-3724-4189-82a7-ba61ba46097a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:18:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-24cd7ac4-3724-4189-82a7-ba61ba46097a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:18:35 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:18:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "a162dc24-084d-4612-95d8-67d23f8f6d29" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:18:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "a162dc24-084d-4612-95d8-67d23f8f6d29" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:18:35 user nova-compute[74898]: DEBUG nova.compute.manager [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:18:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:18:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:18:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:18:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:18:35 user nova-compute[74898]: DEBUG nova.compute.manager [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:18:35 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:18:35 user nova-compute[74898]: INFO nova.compute.claims [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Claim successful on node user
Nov 17 03:18:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:18:35 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Updating instance_info_cache with network_info: [{"id": "b7880813-a5fe-4eb7-b6aa-f91832114171", "address": "fa:16:3e:da:6b:da", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7880813-a5", "ovs_interfaceid": "b7880813-a5fe-4eb7-b6aa-f91832114171", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:18:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-24cd7ac4-3724-4189-82a7-ba61ba46097a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:18:35 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:18:35 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:18:35 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:18:35 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:18:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:18:35 user nova-compute[74898]: DEBUG nova.compute.manager [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:18:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.258s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:18:35 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:18:35 user nova-compute[74898]: INFO nova.compute.claims [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Claim successful on node user
Nov 17 03:18:35 user nova-compute[74898]: DEBUG nova.compute.manager [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:18:35 user nova-compute[74898]: DEBUG nova.network.neutron [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:18:35 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:18:35 user nova-compute[74898]: DEBUG nova.compute.manager [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:18:35 user nova-compute[74898]: DEBUG nova.policy [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa779a5f98394629b6b9fa9d04233e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d36087cc8e842c0bfcae89553fb9841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:18:35 user nova-compute[74898]: INFO nova.virt.block_device [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Booting with volume snapshot 21a4ffe2-f5a9-478b-b701-e1a5a9d8aaf0 at /dev/vda
Nov 17 03:18:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:36 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:18:36 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:18:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.610s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:18:36 user nova-compute[74898]: DEBUG nova.compute.manager [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:18:36 user nova-compute[74898]: DEBUG nova.compute.manager [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:18:36 user nova-compute[74898]: DEBUG nova.network.neutron [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:18:36 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:18:36 user nova-compute[74898]: DEBUG nova.compute.manager [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:18:36 user nova-compute[74898]: DEBUG nova.compute.manager [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:18:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:18:36 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Creating image(s)
Nov 17 03:18:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "/opt/stack/data/nova/instances/3fbd19c4-82c5-4c69-a236-1b3fda1e0a75/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:18:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "/opt/stack/data/nova/instances/3fbd19c4-82c5-4c69-a236-1b3fda1e0a75/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:18:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "/opt/stack/data/nova/instances/3fbd19c4-82c5-4c69-a236-1b3fda1e0a75/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:18:36 user nova-compute[74898]: DEBUG nova.policy [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f67341bd3d3a47698364dcfc7a7c8a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b13b86a294437da9a38ca4fd9b98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:18:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:36 user nova-compute[74898]: DEBUG nova.network.neutron [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Successfully created port: 3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:18:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.238s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:18:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:18:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.345s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/3fbd19c4-82c5-4c69-a236-1b3fda1e0a75/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/3fbd19c4-82c5-4c69-a236-1b3fda1e0a75/disk 1073741824" returned: 0 in 0.079s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.434s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:18:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.208s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:37 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3fbd19c4-82c5-4c69-a236-1b3fda1e0a75/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:18:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbd19c4-82c5-4c69-a236-1b3fda1e0a75/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbd19c4-82c5-4c69-a236-1b3fda1e0a75/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:37 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Cannot resize image /opt/stack/data/nova/instances/3fbd19c4-82c5-4c69-a236-1b3fda1e0a75/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:18:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:18:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Ensure instance console log exists: /opt/stack/data/nova/instances/3fbd19c4-82c5-4c69-a236-1b3fda1e0a75/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:18:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:18:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:18:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:18:37 user nova-compute[74898]: DEBUG nova.network.neutron [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Successfully created port: bc143a47-d472-467b-a6a7-59523c7c3f0b {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:18:37 user nova-compute[74898]: DEBUG nova.network.neutron [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Successfully updated port: 3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:18:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "refresh_cache-a162dc24-084d-4612-95d8-67d23f8f6d29" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:18:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquired lock "refresh_cache-a162dc24-084d-4612-95d8-67d23f8f6d29" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:18:37 user nova-compute[74898]: DEBUG nova.network.neutron [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:18:37 user nova-compute[74898]: DEBUG nova.compute.manager [req-78c5bb71-5b3e-4e13-afbe-d8a5379776f4 req-4d2d1b37-bb92-4891-9cd3-bc22fd45fb6e service nova] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Received event network-changed-3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:18:37 user nova-compute[74898]: DEBUG nova.compute.manager [req-78c5bb71-5b3e-4e13-afbe-d8a5379776f4 req-4d2d1b37-bb92-4891-9cd3-bc22fd45fb6e service nova] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Refreshing instance network info cache due to event network-changed-3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:18:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-78c5bb71-5b3e-4e13-afbe-d8a5379776f4 req-4d2d1b37-bb92-4891-9cd3-bc22fd45fb6e service nova] Acquiring lock "refresh_cache-a162dc24-084d-4612-95d8-67d23f8f6d29" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:18:38 user nova-compute[74898]: DEBUG nova.network.neutron [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:18:38 user nova-compute[74898]: DEBUG nova.network.neutron [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Updating instance_info_cache with network_info: [{"id": "3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7", "address": "fa:16:3e:67:ba:f1", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b11bc7b-8f", "ovs_interfaceid": "3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:18:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Releasing lock "refresh_cache-a162dc24-084d-4612-95d8-67d23f8f6d29" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:18:38 user nova-compute[74898]: DEBUG nova.compute.manager [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Instance network_info: |[{"id": "3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7", "address": "fa:16:3e:67:ba:f1", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b11bc7b-8f", "ovs_interfaceid": "3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:18:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-78c5bb71-5b3e-4e13-afbe-d8a5379776f4 req-4d2d1b37-bb92-4891-9cd3-bc22fd45fb6e service nova] Acquired lock "refresh_cache-a162dc24-084d-4612-95d8-67d23f8f6d29" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:18:38 user nova-compute[74898]: DEBUG nova.network.neutron [req-78c5bb71-5b3e-4e13-afbe-d8a5379776f4 req-4d2d1b37-bb92-4891-9cd3-bc22fd45fb6e service nova] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Refreshing network info cache for port 3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:18:38 user nova-compute[74898]: DEBUG nova.network.neutron [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Successfully updated port: bc143a47-d472-467b-a6a7-59523c7c3f0b {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:18:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "refresh_cache-3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:18:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquired lock "refresh_cache-3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:18:38 user nova-compute[74898]: DEBUG nova.network.neutron [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:18:38 user nova-compute[74898]: DEBUG nova.compute.manager [req-61013d25-80e8-4673-a9a2-0ed79fa1fb47 req-f5adbe31-3582-463d-9b94-aa38ee9179b7 service nova] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Received event network-changed-bc143a47-d472-467b-a6a7-59523c7c3f0b {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:18:38 user nova-compute[74898]: DEBUG nova.compute.manager [req-61013d25-80e8-4673-a9a2-0ed79fa1fb47 req-f5adbe31-3582-463d-9b94-aa38ee9179b7 service nova] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Refreshing instance network info cache due to event network-changed-bc143a47-d472-467b-a6a7-59523c7c3f0b. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:18:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-61013d25-80e8-4673-a9a2-0ed79fa1fb47 req-f5adbe31-3582-463d-9b94-aa38ee9179b7 service nova] Acquiring lock "refresh_cache-3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:18:38 user nova-compute[74898]: DEBUG nova.network.neutron [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:18:38 user nova-compute[74898]: DEBUG nova.network.neutron [req-78c5bb71-5b3e-4e13-afbe-d8a5379776f4 req-4d2d1b37-bb92-4891-9cd3-bc22fd45fb6e service nova] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Updated VIF entry in instance network info cache for port 3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:18:38 user nova-compute[74898]: DEBUG nova.network.neutron [req-78c5bb71-5b3e-4e13-afbe-d8a5379776f4 req-4d2d1b37-bb92-4891-9cd3-bc22fd45fb6e service nova] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Updating instance_info_cache with network_info: [{"id": "3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7", "address": "fa:16:3e:67:ba:f1", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b11bc7b-8f", "ovs_interfaceid": "3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-78c5bb71-5b3e-4e13-afbe-d8a5379776f4 req-4d2d1b37-bb92-4891-9cd3-bc22fd45fb6e service nova] Releasing lock "refresh_cache-a162dc24-084d-4612-95d8-67d23f8f6d29" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.network.neutron [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Updating instance_info_cache with network_info: [{"id": "bc143a47-d472-467b-a6a7-59523c7c3f0b", "address": "fa:16:3e:e3:34:2a", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc143a47-d4", "ovs_interfaceid": "bc143a47-d472-467b-a6a7-59523c7c3f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Releasing lock "refresh_cache-3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.compute.manager [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Instance network_info: |[{"id": "bc143a47-d472-467b-a6a7-59523c7c3f0b", "address": "fa:16:3e:e3:34:2a", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc143a47-d4", "ovs_interfaceid": "bc143a47-d472-467b-a6a7-59523c7c3f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-61013d25-80e8-4673-a9a2-0ed79fa1fb47 req-f5adbe31-3582-463d-9b94-aa38ee9179b7 service nova] Acquired lock "refresh_cache-3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.network.neutron [req-61013d25-80e8-4673-a9a2-0ed79fa1fb47 req-f5adbe31-3582-463d-9b94-aa38ee9179b7 service nova] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Refreshing network info cache for port bc143a47-d472-467b-a6a7-59523c7c3f0b {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Start _get_guest_xml network_info=[{"id": "bc143a47-d472-467b-a6a7-59523c7c3f0b", "address": "fa:16:3e:e3:34:2a", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc143a47-d4", "ovs_interfaceid": "bc143a47-d472-467b-a6a7-59523c7c3f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:18:39 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:18:39 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:18:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-440730337',display_name='tempest-AttachVolumeTestJSON-server-440730337',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-440730337',id=33,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJy0/eL2ms1WVq2yYJ6Ajg5L5vGylcmeEEEGpSFVF9VCRO9fpOBZR/n/zWa2GV3Snqi94ZVaAwK1bKkXfemaEi1iwwXNwl1AD142SFiPmtlMYf9QLErpZF6sCPjAvWZTjg==',key_name='tempest-keypair-1333753592',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08b13b86a294437da9a38ca4fd9b98e1',ramdisk_id='',reservation_id='r-9945lqvw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1097544794',owner_user_name='tempest-AttachVolumeTestJSON-1097544794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:18:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f67341bd3d3a47698364dcfc7a7c8a9a',uuid=3fbd19c4-82c5-4c69-a236-1b3fda1e0a75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc143a47-d472-467b-a6a7-59523c7c3f0b", "address": "fa:16:3e:e3:34:2a", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc143a47-d4", "ovs_interfaceid": "bc143a47-d472-467b-a6a7-59523c7c3f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Converting VIF {"id": "bc143a47-d472-467b-a6a7-59523c7c3f0b", "address": "fa:16:3e:e3:34:2a", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc143a47-d4", "ovs_interfaceid": "bc143a47-d472-467b-a6a7-59523c7c3f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:34:2a,bridge_name='br-int',has_traffic_filtering=True,id=bc143a47-d472-467b-a6a7-59523c7c3f0b,network=Network(b4bcd1f2-7a46-421a-8979-8ba9aca50ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc143a47-d4') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.objects.instance [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'pci_devices' on Instance uuid 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:18:39 user nova-compute[74898]:   <uuid>3fbd19c4-82c5-4c69-a236-1b3fda1e0a75</uuid>
Nov 17 03:18:39 user nova-compute[74898]:   <name>instance-00000021</name>
Nov 17 03:18:39 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:18:39 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:18:39 user nova-compute[74898]:   <metadata>
Nov 17 03:18:39 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:18:39 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:18:39 user nova-compute[74898]:       <nova:name>tempest-AttachVolumeTestJSON-server-440730337</nova:name>
Nov 17 03:18:39 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:18:39</nova:creationTime>
Nov 17 03:18:39 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:18:39 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:18:39 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:18:39 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:18:39 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:18:39 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:18:39 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:18:39 user nova-compute[74898]:       <nova:owner>
Nov 17 03:18:39 user nova-compute[74898]:         <nova:user uuid="f67341bd3d3a47698364dcfc7a7c8a9a">tempest-AttachVolumeTestJSON-1097544794-project-member</nova:user>
Nov 17 03:18:39 user nova-compute[74898]:         <nova:project uuid="08b13b86a294437da9a38ca4fd9b98e1">tempest-AttachVolumeTestJSON-1097544794</nova:project>
Nov 17 03:18:39 user nova-compute[74898]:       </nova:owner>
Nov 17 03:18:39 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:18:39 user nova-compute[74898]:       <nova:ports>
Nov 17 03:18:39 user nova-compute[74898]:         <nova:port uuid="bc143a47-d472-467b-a6a7-59523c7c3f0b">
Nov 17 03:18:39 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 17 03:18:39 user nova-compute[74898]:         </nova:port>
Nov 17 03:18:39 user nova-compute[74898]:       </nova:ports>
Nov 17 03:18:39 user nova-compute[74898]:     </nova:instance>
Nov 17 03:18:39 user nova-compute[74898]:   </metadata>
Nov 17 03:18:39 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:18:39 user nova-compute[74898]:     <system>
Nov 17 03:18:39 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:18:39 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:18:39 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:18:39 user nova-compute[74898]:       <entry name="serial">3fbd19c4-82c5-4c69-a236-1b3fda1e0a75</entry>
Nov 17 03:18:39 user nova-compute[74898]:       <entry name="uuid">3fbd19c4-82c5-4c69-a236-1b3fda1e0a75</entry>
Nov 17 03:18:39 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:18:39 user nova-compute[74898]:     </system>
Nov 17 03:18:39 user nova-compute[74898]:   </sysinfo>
Nov 17 03:18:39 user nova-compute[74898]:   <os>
Nov 17 03:18:39 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:18:39 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:18:39 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:18:39 user nova-compute[74898]:   </os>
Nov 17 03:18:39 user nova-compute[74898]:   <features>
Nov 17 03:18:39 user nova-compute[74898]:     <acpi/>
Nov 17 03:18:39 user nova-compute[74898]:     <apic/>
Nov 17 03:18:39 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:18:39 user nova-compute[74898]:   </features>
Nov 17 03:18:39 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:18:39 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:18:39 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:18:39 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:18:39 user nova-compute[74898]:   </clock>
Nov 17 03:18:39 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:18:39 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:18:39 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:18:39 user nova-compute[74898]:   </cpu>
Nov 17 03:18:39 user nova-compute[74898]:   <devices>
Nov 17 03:18:39 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:18:39 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:18:39 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/3fbd19c4-82c5-4c69-a236-1b3fda1e0a75/disk"/>
Nov 17 03:18:39 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:18:39 user nova-compute[74898]:     </disk>
Nov 17 03:18:39 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:18:39 user nova-compute[74898]:       <mac address="fa:16:3e:e3:34:2a"/>
Nov 17 03:18:39 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:18:39 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:18:39 user nova-compute[74898]:       <target dev="tapbc143a47-d4"/>
Nov 17 03:18:39 user nova-compute[74898]:     </interface>
Nov 17 03:18:39 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:18:39 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/3fbd19c4-82c5-4c69-a236-1b3fda1e0a75/console.log" append="off"/>
Nov 17 03:18:39 user nova-compute[74898]:     </serial>
Nov 17 03:18:39 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:18:39 user nova-compute[74898]:     <video>
Nov 17 03:18:39 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:18:39 user nova-compute[74898]:     </video>
Nov 17 03:18:39 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:18:39 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:18:39 user nova-compute[74898]:     </rng>
Nov 17 03:18:39 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:18:39 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:18:39 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:18:39 user nova-compute[74898]:     </memballoon>
Nov 17 03:18:39 user nova-compute[74898]:   </devices>
Nov 17 03:18:39 user nova-compute[74898]: </domain>
Nov 17 03:18:39 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:18:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-440730337',display_name='tempest-AttachVolumeTestJSON-server-440730337',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-440730337',id=33,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJy0/eL2ms1WVq2yYJ6Ajg5L5vGylcmeEEEGpSFVF9VCRO9fpOBZR/n/zWa2GV3Snqi94ZVaAwK1bKkXfemaEi1iwwXNwl1AD142SFiPmtlMYf9QLErpZF6sCPjAvWZTjg==',key_name='tempest-keypair-1333753592',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08b13b86a294437da9a38ca4fd9b98e1',ramdisk_id='',reservation_id='r-9945lqvw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1097544794',owner_user_name='tempest-AttachVolumeTestJSON-1097544794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:18:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f67341bd3d3a47698364dcfc7a7c8a9a',uuid=3fbd19c4-82c5-4c69-a236-1b3fda1e0a75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc143a47-d472-467b-a6a7-59523c7c3f0b", "address": "fa:16:3e:e3:34:2a", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc143a47-d4", "ovs_interfaceid": "bc143a47-d472-467b-a6a7-59523c7c3f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Converting VIF {"id": "bc143a47-d472-467b-a6a7-59523c7c3f0b", "address": "fa:16:3e:e3:34:2a", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc143a47-d4", "ovs_interfaceid": "bc143a47-d472-467b-a6a7-59523c7c3f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:34:2a,bridge_name='br-int',has_traffic_filtering=True,id=bc143a47-d472-467b-a6a7-59523c7c3f0b,network=Network(b4bcd1f2-7a46-421a-8979-8ba9aca50ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc143a47-d4') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG os_vif [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:34:2a,bridge_name='br-int',has_traffic_filtering=True,id=bc143a47-d472-467b-a6a7-59523c7c3f0b,network=Network(b4bcd1f2-7a46-421a-8979-8ba9aca50ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc143a47-d4') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '680ff288-435a-5ff8-ad3a-152d90b1d1a3', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc143a47-d4, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbc143a47-d4, col_values=(('qos', UUID('8e860469-1afc-4cfc-aa6f-012c67f86527')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbc143a47-d4, col_values=(('external_ids', {'iface-id': 'bc143a47-d472-467b-a6a7-59523c7c3f0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:34:2a', 'vm-uuid': '3fbd19c4-82c5-4c69-a236-1b3fda1e0a75'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:39 user nova-compute[74898]: INFO os_vif [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:34:2a,bridge_name='br-int',has_traffic_filtering=True,id=bc143a47-d472-467b-a6a7-59523c7c3f0b,network=Network(b4bcd1f2-7a46-421a-8979-8ba9aca50ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc143a47-d4')
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] No VIF found with MAC fa:16:3e:e3:34:2a, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.network.neutron [req-61013d25-80e8-4673-a9a2-0ed79fa1fb47 req-f5adbe31-3582-463d-9b94-aa38ee9179b7 service nova] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Updated VIF entry in instance network info cache for port bc143a47-d472-467b-a6a7-59523c7c3f0b. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG nova.network.neutron [req-61013d25-80e8-4673-a9a2-0ed79fa1fb47 req-f5adbe31-3582-463d-9b94-aa38ee9179b7 service nova] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Updating instance_info_cache with network_info: [{"id": "bc143a47-d472-467b-a6a7-59523c7c3f0b", "address": "fa:16:3e:e3:34:2a", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc143a47-d4", "ovs_interfaceid": "bc143a47-d472-467b-a6a7-59523c7c3f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:18:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-61013d25-80e8-4673-a9a2-0ed79fa1fb47 req-f5adbe31-3582-463d-9b94-aa38ee9179b7 service nova] Releasing lock "refresh_cache-3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:18:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:40 user nova-compute[74898]: DEBUG nova.compute.manager [req-a4bd4aee-dfe2-43fb-8c08-9ddef954dbaf req-42547f09-14a1-4ddc-99c7-3b95628caac5 service nova] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Received event network-vif-plugged-bc143a47-d472-467b-a6a7-59523c7c3f0b {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:18:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a4bd4aee-dfe2-43fb-8c08-9ddef954dbaf req-42547f09-14a1-4ddc-99c7-3b95628caac5 service nova] Acquiring lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:18:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a4bd4aee-dfe2-43fb-8c08-9ddef954dbaf req-42547f09-14a1-4ddc-99c7-3b95628caac5 service nova] Lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:18:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a4bd4aee-dfe2-43fb-8c08-9ddef954dbaf req-42547f09-14a1-4ddc-99c7-3b95628caac5 service nova] Lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:18:40 user nova-compute[74898]: DEBUG nova.compute.manager [req-a4bd4aee-dfe2-43fb-8c08-9ddef954dbaf req-42547f09-14a1-4ddc-99c7-3b95628caac5 service nova] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] No waiting events found dispatching network-vif-plugged-bc143a47-d472-467b-a6a7-59523c7c3f0b {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:18:40 user nova-compute[74898]: WARNING nova.compute.manager [req-a4bd4aee-dfe2-43fb-8c08-9ddef954dbaf req-42547f09-14a1-4ddc-99c7-3b95628caac5 service nova] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Received unexpected event network-vif-plugged-bc143a47-d472-467b-a6a7-59523c7c3f0b for instance with vm_state building and task_state spawning.
Nov 17 03:18:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG os_brick.utils [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aefb766-47da-4900-ab6a-740aef911bc6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f025352-ca1c-4a5a-8390-f404f08a0889]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36d991d-cc26-4561-935a-907d12b1d723]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb1ca0e-d333-4b0f-8636-ad2d32529214]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:18:42 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:18:42 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ec005f-69b3-4a17-8206-b6a889515c38]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG os_brick.utils [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Updating existing volume attachment record: 76402dbf-79a2-4eef-bad5-87c191aaf786 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG nova.compute.manager [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:18:42 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Instance spawned successfully.
Nov 17 03:18:42 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:18:42 user nova-compute[74898]: INFO nova.compute.manager [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Took 6.11 seconds to spawn the instance on the hypervisor.
Nov 17 03:18:42 user nova-compute[74898]: DEBUG nova.compute.manager [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG nova.compute.manager [req-19f5721a-8269-4e4d-b9ab-ff04b905f5ef req-b7125421-9e73-4e1a-bd49-6ae2fd0734c7 service nova] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Received event network-vif-plugged-bc143a47-d472-467b-a6a7-59523c7c3f0b {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-19f5721a-8269-4e4d-b9ab-ff04b905f5ef req-b7125421-9e73-4e1a-bd49-6ae2fd0734c7 service nova] Acquiring lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-19f5721a-8269-4e4d-b9ab-ff04b905f5ef req-b7125421-9e73-4e1a-bd49-6ae2fd0734c7 service nova] Lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-19f5721a-8269-4e4d-b9ab-ff04b905f5ef req-b7125421-9e73-4e1a-bd49-6ae2fd0734c7 service nova] Lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:18:42 user nova-compute[74898]: DEBUG nova.compute.manager [req-19f5721a-8269-4e4d-b9ab-ff04b905f5ef req-b7125421-9e73-4e1a-bd49-6ae2fd0734c7 service nova] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] No waiting events found dispatching network-vif-plugged-bc143a47-d472-467b-a6a7-59523c7c3f0b {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:18:42 user nova-compute[74898]: WARNING nova.compute.manager [req-19f5721a-8269-4e4d-b9ab-ff04b905f5ef req-b7125421-9e73-4e1a-bd49-6ae2fd0734c7 service nova] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Received unexpected event network-vif-plugged-bc143a47-d472-467b-a6a7-59523c7c3f0b for instance with vm_state building and task_state spawning.
Nov 17 03:18:42 user nova-compute[74898]: INFO nova.compute.manager [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Took 7.43 seconds to build instance.
Nov 17 03:18:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-aab3e0ee-a2d4-4951-a713-94a65fe57935 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.532s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:18:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "90dd082b-900d-49b4-83be-db10c7ab9533" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:18:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "90dd082b-900d-49b4-83be-db10c7ab9533" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:18:45 user nova-compute[74898]: DEBUG nova.compute.manager [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:18:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:18:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:18:45 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:18:45 user nova-compute[74898]: INFO nova.compute.claims [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Claim successful on node user
Nov 17 03:18:45 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:18:46 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:18:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:18:46 user nova-compute[74898]: DEBUG nova.compute.manager [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:18:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:46 user nova-compute[74898]: DEBUG nova.compute.manager [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:18:46 user nova-compute[74898]: DEBUG nova.network.neutron [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:18:46 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:18:46 user nova-compute[74898]: DEBUG nova.policy [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05397a6b586843338aafbc8a17c6e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cd941de23248d8ac93b03f930f565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:18:46 user nova-compute[74898]: DEBUG nova.compute.manager [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:18:46 user nova-compute[74898]: INFO nova.virt.block_device [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Booting with volume-backed-image 50e5d43b-62d6-4f28-a52e-a1c6b84eb51f at /dev/vda
Nov 17 03:18:47 user nova-compute[74898]: DEBUG nova.network.neutron [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Successfully created port: 014195e4-69ec-44a5-bdbf-17a716389fa8 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:18:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG nova.network.neutron [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Successfully updated port: 014195e4-69ec-44a5-bdbf-17a716389fa8 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "refresh_cache-90dd082b-900d-49b4-83be-db10c7ab9533" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquired lock "refresh_cache-90dd082b-900d-49b4-83be-db10c7ab9533" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG nova.network.neutron [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG nova.compute.manager [req-da4358e3-ad0d-4f2d-ae0b-53e50d03106e req-7b159318-3923-4f5f-b1b7-a0a410f52048 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Received event network-changed-014195e4-69ec-44a5-bdbf-17a716389fa8 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG nova.compute.manager [req-da4358e3-ad0d-4f2d-ae0b-53e50d03106e req-7b159318-3923-4f5f-b1b7-a0a410f52048 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Refreshing instance network info cache due to event network-changed-014195e4-69ec-44a5-bdbf-17a716389fa8. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-da4358e3-ad0d-4f2d-ae0b-53e50d03106e req-7b159318-3923-4f5f-b1b7-a0a410f52048 service nova] Acquiring lock "refresh_cache-90dd082b-900d-49b4-83be-db10c7ab9533" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG nova.network.neutron [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG nova.compute.manager [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:18:48 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Creating image(s)
Nov 17 03:18:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Did not create local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Ensure instance console log exists: /opt/stack/data/nova/instances/a162dc24-084d-4612-95d8-67d23f8f6d29/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Start _get_guest_xml network_info=[{"id": "3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7", "address": "fa:16:3e:67:ba:f1", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b11bc7b-8f", "ovs_interfaceid": "3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FTgxluAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a162dc24-084d-4612-95d8-67d23f8f6d29', 'attached_at': '', 'detached_at': '', 'volume_id': '0486a9ba-a72f-466d-a608-feb3149688f4', 'serial': '0486a9ba-a72f-466d-a608-feb3149688f4'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '76402dbf-79a2-4eef-bad5-87c191aaf786', 'volume_type': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:18:48 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:18:48 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:18:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FTgxluAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:18:48 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:18:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:18:48 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:18:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:18:48 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f75f8b6-06ee-440d-803d-5bcbef42415a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:18:48 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9014cc-c961-4a00-819e-6b5a828df5ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4] added
Nov 17 03:18:48 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d761592-f8a7-49e3-87a8-80462af29428]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b81bbb-b0b9-496b-97fd-8e08dfa36f76]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FTgxluAh {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FTgxluAh" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49822b5-cfac-473b-a169-a337ea5303df]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FTgxluAh'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG nova.network.neutron [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Updating instance_info_cache with network_info: [{"id": "014195e4-69ec-44a5-bdbf-17a716389fa8", "address": "fa:16:3e:23:b7:2d", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014195e4-69", "ovs_interfaceid": "014195e4-69ec-44a5-bdbf-17a716389fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.042s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c29455c-4091-4494-a5c2-d60ab7e4a63a]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Releasing lock "refresh_cache-90dd082b-900d-49b4-83be-db10c7ab9533" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG nova.compute.manager [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Instance network_info: |[{"id": "014195e4-69ec-44a5-bdbf-17a716389fa8", "address": "fa:16:3e:23:b7:2d", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014195e4-69", "ovs_interfaceid": "014195e4-69ec-44a5-bdbf-17a716389fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-da4358e3-ad0d-4f2d-ae0b-53e50d03106e req-7b159318-3923-4f5f-b1b7-a0a410f52048 service nova] Acquired lock "refresh_cache-90dd082b-900d-49b4-83be-db10c7ab9533" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG nova.network.neutron [req-da4358e3-ad0d-4f2d-ae0b-53e50d03106e req-7b159318-3923-4f5f-b1b7-a0a410f52048 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Refreshing network info cache for port 014195e4-69ec-44a5-bdbf-17a716389fa8 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[76af9963-6c2e-4910-bebb-c593de0d04b2]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:18:48 user nova-compute[74898]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:18:48 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:18:48 user nova-compute[74898]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:18:48 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[985996b8-4ec7-4dc5-a76f-2cedb6c352c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4, portal: 172.16.0.220,3260]
Nov 17 03:18:48 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4, portal: 172.16.0.220,3260] successful.
Nov 17 03:18:48 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a0b65c-5fab-449b-a329-7332411c143b]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1181bed-dde1-4a8e-9d5f-95c1f74ff938]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:18:48 user nova-compute[74898]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:18:48 user nova-compute[74898]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 (non-flash)
Nov 17 03:18:48 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:18:48 user nova-compute[74898]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:18:48 user nova-compute[74898]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 (non-flash)
Nov 17 03:18:48 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:18:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:49 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0941f5dd-8911-4f50-9135-93d8c0d43bf0]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:49 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:18:49 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FTgxluAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:18:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:49 user nova-compute[74898]: DEBUG nova.network.neutron [req-da4358e3-ad0d-4f2d-ae0b-53e50d03106e req-7b159318-3923-4f5f-b1b7-a0a410f52048 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Updated VIF entry in instance network info cache for port 014195e4-69ec-44a5-bdbf-17a716389fa8. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:18:49 user nova-compute[74898]: DEBUG nova.network.neutron [req-da4358e3-ad0d-4f2d-ae0b-53e50d03106e req-7b159318-3923-4f5f-b1b7-a0a410f52048 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Updating instance_info_cache with network_info: [{"id": "014195e4-69ec-44a5-bdbf-17a716389fa8", "address": "fa:16:3e:23:b7:2d", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014195e4-69", "ovs_interfaceid": "014195e4-69ec-44a5-bdbf-17a716389fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:18:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-da4358e3-ad0d-4f2d-ae0b-53e50d03106e req-7b159318-3923-4f5f-b1b7-a0a410f52048 service nova] Releasing lock "refresh_cache-90dd082b-900d-49b4-83be-db10c7ab9533" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:18:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:18:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '26633613535623030', 'path': '/dev/sdd'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:18:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633613535623030', 'path': '/dev/sdd'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:18:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:18:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-22699785',display_name='tempest-TestVolumeBootPattern-server-22699785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-22699785',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d36087cc8e842c0bfcae89553fb9841',ramdisk_id='',reservation_id='r-ctqx6ty4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1382126375',owner_user_name='tempest-TestVolumeBootPattern-1382126375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:18:36Z,user_data=None,user_id='aa779a5f98394629b6b9fa9d04233e7a',uuid=a162dc24-084d-4612-95d8-67d23f8f6d29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7", "address": "fa:16:3e:67:ba:f1", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b11bc7b-8f", "ovs_interfaceid": "3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:18:50 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converting VIF {"id": "3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7", "address": "fa:16:3e:67:ba:f1", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b11bc7b-8f", "ovs_interfaceid": "3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:18:50 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:ba:f1,bridge_name='br-int',has_traffic_filtering=True,id=3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b11bc7b-8f') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:18:50 user nova-compute[74898]: DEBUG nova.objects.instance [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lazy-loading 'pci_devices' on Instance uuid a162dc24-084d-4612-95d8-67d23f8f6d29 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:18:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:18:50 user nova-compute[74898]:   <uuid>a162dc24-084d-4612-95d8-67d23f8f6d29</uuid>
Nov 17 03:18:50 user nova-compute[74898]:   <name>instance-00000020</name>
Nov 17 03:18:50 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:18:50 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:18:50 user nova-compute[74898]:   <metadata>
Nov 17 03:18:50 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:18:50 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:18:50 user nova-compute[74898]:       <nova:name>tempest-TestVolumeBootPattern-server-22699785</nova:name>
Nov 17 03:18:50 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:18:48</nova:creationTime>
Nov 17 03:18:50 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:18:50 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:18:50 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:18:50 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:18:50 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:18:50 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:18:50 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:18:50 user nova-compute[74898]:       <nova:owner>
Nov 17 03:18:50 user nova-compute[74898]:         <nova:user uuid="aa779a5f98394629b6b9fa9d04233e7a">tempest-TestVolumeBootPattern-1382126375-project-member</nova:user>
Nov 17 03:18:50 user nova-compute[74898]:         <nova:project uuid="5d36087cc8e842c0bfcae89553fb9841">tempest-TestVolumeBootPattern-1382126375</nova:project>
Nov 17 03:18:50 user nova-compute[74898]:       </nova:owner>
Nov 17 03:18:50 user nova-compute[74898]:       <nova:ports>
Nov 17 03:18:50 user nova-compute[74898]:         <nova:port uuid="3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7">
Nov 17 03:18:50 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 17 03:18:50 user nova-compute[74898]:         </nova:port>
Nov 17 03:18:50 user nova-compute[74898]:       </nova:ports>
Nov 17 03:18:50 user nova-compute[74898]:     </nova:instance>
Nov 17 03:18:50 user nova-compute[74898]:   </metadata>
Nov 17 03:18:50 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:18:50 user nova-compute[74898]:     <system>
Nov 17 03:18:50 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:18:50 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:18:50 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:18:50 user nova-compute[74898]:       <entry name="serial">a162dc24-084d-4612-95d8-67d23f8f6d29</entry>
Nov 17 03:18:50 user nova-compute[74898]:       <entry name="uuid">a162dc24-084d-4612-95d8-67d23f8f6d29</entry>
Nov 17 03:18:50 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:18:50 user nova-compute[74898]:     </system>
Nov 17 03:18:50 user nova-compute[74898]:   </sysinfo>
Nov 17 03:18:50 user nova-compute[74898]:   <os>
Nov 17 03:18:50 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:18:50 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:18:50 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:18:50 user nova-compute[74898]:   </os>
Nov 17 03:18:50 user nova-compute[74898]:   <features>
Nov 17 03:18:50 user nova-compute[74898]:     <acpi/>
Nov 17 03:18:50 user nova-compute[74898]:     <apic/>
Nov 17 03:18:50 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:18:50 user nova-compute[74898]:   </features>
Nov 17 03:18:50 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:18:50 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:18:50 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:18:50 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:18:50 user nova-compute[74898]:   </clock>
Nov 17 03:18:50 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:18:50 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:18:50 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:18:50 user nova-compute[74898]:   </cpu>
Nov 17 03:18:50 user nova-compute[74898]:   <devices>
Nov 17 03:18:50 user nova-compute[74898]:     <disk type="block" device="disk">
Nov 17 03:18:50 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:18:50 user nova-compute[74898]:       <source dev="/dev/sdd"/>
Nov 17 03:18:50 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:18:50 user nova-compute[74898]:       <serial>0486a9ba-a72f-466d-a608-feb3149688f4</serial>
Nov 17 03:18:50 user nova-compute[74898]:     </disk>
Nov 17 03:18:50 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:18:50 user nova-compute[74898]:       <mac address="fa:16:3e:67:ba:f1"/>
Nov 17 03:18:50 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:18:50 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:18:50 user nova-compute[74898]:       <target dev="tap3b11bc7b-8f"/>
Nov 17 03:18:50 user nova-compute[74898]:     </interface>
Nov 17 03:18:50 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:18:50 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/a162dc24-084d-4612-95d8-67d23f8f6d29/console.log" append="off"/>
Nov 17 03:18:50 user nova-compute[74898]:     </serial>
Nov 17 03:18:50 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:18:50 user nova-compute[74898]:     <video>
Nov 17 03:18:50 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:18:50 user nova-compute[74898]:     </video>
Nov 17 03:18:50 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:18:50 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:18:50 user nova-compute[74898]:     </rng>
Nov 17 03:18:50 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:18:50 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:18:50 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:18:50 user nova-compute[74898]:     </memballoon>
Nov 17 03:18:50 user nova-compute[74898]:   </devices>
Nov 17 03:18:50 user nova-compute[74898]: </domain>
Nov 17 03:18:50 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:18:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:18:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-22699785',display_name='tempest-TestVolumeBootPattern-server-22699785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-22699785',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d36087cc8e842c0bfcae89553fb9841',ramdisk_id='',reservation_id='r-ctqx6ty4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1382126375',owner_user_name='tempest-TestVolumeBootPattern-1382126375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:18:36Z,user_data=None,user_id='aa779a5f98394629b6b9fa9d04233e7a',uuid=a162dc24-084d-4612-95d8-67d23f8f6d29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7", "address": "fa:16:3e:67:ba:f1", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b11bc7b-8f", "ovs_interfaceid": "3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:18:50 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converting VIF {"id": "3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7", "address": "fa:16:3e:67:ba:f1", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b11bc7b-8f", "ovs_interfaceid": "3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:18:50 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:ba:f1,bridge_name='br-int',has_traffic_filtering=True,id=3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b11bc7b-8f') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:18:50 user nova-compute[74898]: DEBUG os_vif [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:ba:f1,bridge_name='br-int',has_traffic_filtering=True,id=3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b11bc7b-8f') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:18:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:18:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:18:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c00d7956-868c-5e70-98a6-de286d25aac0', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:18:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b11bc7b-8f, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:18:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b11bc7b-8f, col_values=(('qos', UUID('132d64c1-4da7-41bd-98d6-eed1d62e23b1')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:18:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b11bc7b-8f, col_values=(('external_ids', {'iface-id': '3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:ba:f1', 'vm-uuid': 'a162dc24-084d-4612-95d8-67d23f8f6d29'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:18:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:18:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:50 user nova-compute[74898]: INFO os_vif [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:ba:f1,bridge_name='br-int',has_traffic_filtering=True,id=3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b11bc7b-8f')
Nov 17 03:18:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:18:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] No VIF found with MAC fa:16:3e:67:ba:f1, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:18:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:51 user nova-compute[74898]: DEBUG nova.compute.manager [req-253186cd-6f71-4de3-8edc-2e92cf861dc9 req-59b24846-70d4-4cb2-bb47-b41e2f20596b service nova] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Received event network-vif-plugged-3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:18:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-253186cd-6f71-4de3-8edc-2e92cf861dc9 req-59b24846-70d4-4cb2-bb47-b41e2f20596b service nova] Acquiring lock "a162dc24-084d-4612-95d8-67d23f8f6d29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:18:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-253186cd-6f71-4de3-8edc-2e92cf861dc9 req-59b24846-70d4-4cb2-bb47-b41e2f20596b service nova] Lock "a162dc24-084d-4612-95d8-67d23f8f6d29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:18:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-253186cd-6f71-4de3-8edc-2e92cf861dc9 req-59b24846-70d4-4cb2-bb47-b41e2f20596b service nova] Lock "a162dc24-084d-4612-95d8-67d23f8f6d29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:18:51 user nova-compute[74898]: DEBUG nova.compute.manager [req-253186cd-6f71-4de3-8edc-2e92cf861dc9 req-59b24846-70d4-4cb2-bb47-b41e2f20596b service nova] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] No waiting events found dispatching network-vif-plugged-3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:18:51 user nova-compute[74898]: WARNING nova.compute.manager [req-253186cd-6f71-4de3-8edc-2e92cf861dc9 req-59b24846-70d4-4cb2-bb47-b41e2f20596b service nova] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Received unexpected event network-vif-plugged-3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7 for instance with vm_state building and task_state spawning.
Nov 17 03:18:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:52 user nova-compute[74898]: DEBUG os_brick.utils [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:18:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f87a105-2b75-4cce-909b-31ddf5b3fb9e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[10981382-cc5d-4709-b9b6-1208ca715e22]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[799a9d70-ace9-4d3b-a4ea-bc16f8ea6bf5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa5f449-b288-405b-8368-ebebeef993e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:18:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:18:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:18:52 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:18:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e0e577-1c00-4935-a7ee-6090f279eeef]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:18:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:18:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:18:52 user nova-compute[74898]: DEBUG os_brick.utils [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:18:52 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Updating existing volume attachment record: 79ecd3bc-9fd3-4b9a-912b-febe679eab24 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:18:53 user nova-compute[74898]: DEBUG nova.compute.manager [req-4f1f8a9f-ab36-40e2-85eb-7219a6722fcd req-c631937e-23d6-4b92-ad52-5cb9ebe75029 service nova] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Received event network-vif-plugged-3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:18:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4f1f8a9f-ab36-40e2-85eb-7219a6722fcd req-c631937e-23d6-4b92-ad52-5cb9ebe75029 service nova] Acquiring lock "a162dc24-084d-4612-95d8-67d23f8f6d29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:18:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4f1f8a9f-ab36-40e2-85eb-7219a6722fcd req-c631937e-23d6-4b92-ad52-5cb9ebe75029 service nova] Lock "a162dc24-084d-4612-95d8-67d23f8f6d29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:18:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4f1f8a9f-ab36-40e2-85eb-7219a6722fcd req-c631937e-23d6-4b92-ad52-5cb9ebe75029 service nova] Lock "a162dc24-084d-4612-95d8-67d23f8f6d29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:18:53 user nova-compute[74898]: DEBUG nova.compute.manager [req-4f1f8a9f-ab36-40e2-85eb-7219a6722fcd req-c631937e-23d6-4b92-ad52-5cb9ebe75029 service nova] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] No waiting events found dispatching network-vif-plugged-3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:18:53 user nova-compute[74898]: WARNING nova.compute.manager [req-4f1f8a9f-ab36-40e2-85eb-7219a6722fcd req-c631937e-23d6-4b92-ad52-5cb9ebe75029 service nova] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Received unexpected event network-vif-plugged-3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7 for instance with vm_state building and task_state spawning.
Nov 17 03:18:54 user nova-compute[74898]: DEBUG nova.compute.manager [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:18:54 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:18:54 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Instance spawned successfully.
Nov 17 03:18:54 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:18:54 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:18:54 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:18:54 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:18:54 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:18:54 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:18:54 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:18:54 user nova-compute[74898]: INFO nova.compute.manager [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Took 5.63 seconds to spawn the instance on the hypervisor.
Nov 17 03:18:54 user nova-compute[74898]: DEBUG nova.compute.manager [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:18:54 user nova-compute[74898]: INFO nova.compute.manager [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Took 19.02 seconds to build instance.
Nov 17 03:18:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e6a3dd8-9e14-4ad3-83e2-4128e1703da0 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "a162dc24-084d-4612-95d8-67d23f8f6d29" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.143s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:18:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG nova.compute.manager [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:18:58 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Creating image(s)
Nov 17 03:18:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Did not create local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Ensure instance console log exists: /opt/stack/data/nova/instances/90dd082b-900d-49b4-83be-db10c7ab9533/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Start _get_guest_xml network_info=[{"id": "014195e4-69ec-44a5-bdbf-17a716389fa8", "address": "fa:16:3e:23:b7:2d", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014195e4-69", "ovs_interfaceid": "014195e4-69ec-44a5-bdbf-17a716389fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uUFvOzEJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '90dd082b-900d-49b4-83be-db10c7ab9533', 'attached_at': '', 'detached_at': '', 'volume_id': '8f7f265c-c094-42ca-910a-2d55a601ce42', 'serial': '8f7f265c-c094-42ca-910a-2d55a601ce42'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '79ecd3bc-9fd3-4b9a-912b-febe679eab24', 'volume_type': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:18:58 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:18:58 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:18:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uUFvOzEJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:18:58 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:18:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:18:58 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:18:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:18:58 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:18:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7449de0-7a35-4cc3-b695-0128a1b663b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:18:58 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a49e0e5-1fd4-492c-8ace-83cf556d9483]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42] added
Nov 17 03:18:58 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e06b93b-d115-4111-ace7-dd1f55b22e4b]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba046cf0-f66a-44e3-80bf-8d1d60d2fbdf]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uUFvOzEJ {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uUFvOzEJ" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf7d745-3725-46a5-a394-49c4dbd9466e]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uUFvOzEJ'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1534cbff-3d79-4831-be12-fcef1eca75f7]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf20c56e-d340-4866-93ff-7e28c4f5f0d1]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:18:58 user nova-compute[74898]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:18:58 user nova-compute[74898]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 (non-flash)
Nov 17 03:18:58 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:18:58 user nova-compute[74898]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:18:58 user nova-compute[74898]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 (non-flash)
Nov 17 03:18:58 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd3a2c8-0143-410a-8361-cbd5eeba7c09]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42, portal: 172.16.0.220,3260]
Nov 17 03:18:58 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42, portal: 172.16.0.220,3260] successful.
Nov 17 03:18:58 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:18:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:59 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:59 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb0363e-0017-4f01-8c07-85fba7a3f04e]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:59 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:18:59 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:59 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:59 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca5c1ee-628e-45ae-9ac9-0ef83dedf949]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:59 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:18:59 user nova-compute[74898]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:18:59 user nova-compute[74898]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 (non-flash)
Nov 17 03:18:59 user nova-compute[74898]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)
Nov 17 03:18:59 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:18:59 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:18:59 user nova-compute[74898]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:18:59 user nova-compute[74898]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 (non-flash)
Nov 17 03:18:59 user nova-compute[74898]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)
Nov 17 03:18:59 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:18:59 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:18:59 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:18:59 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:18:59 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:18:59 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:18:59 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:18:59 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c76269-e7fb-48f4-bb2e-461a391806fd]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:18:59 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: None {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:19:00 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:19:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uUFvOzEJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:19:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:19:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26636663035306361', 'path': '/dev/sde'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:19:00 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636663035306361', 'path': '/dev/sde'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:19:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:00 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:18:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-521230326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-521230326',id=34,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0cd941de23248d8ac93b03f930f565f',ramdisk_id='',reservation_id='r-gx25h9x6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-507656828',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:18:47Z,user_data=None,user_id='05397a6b586843338aafbc8a17c6e42c',uuid=90dd082b-900d-49b4-83be-db10c7ab9533,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "014195e4-69ec-44a5-bdbf-17a716389fa8", "address": "fa:16:3e:23:b7:2d", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014195e4-69", "ovs_interfaceid": "014195e4-69ec-44a5-bdbf-17a716389fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:19:00 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Converting VIF {"id": "014195e4-69ec-44a5-bdbf-17a716389fa8", "address": "fa:16:3e:23:b7:2d", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014195e4-69", "ovs_interfaceid": "014195e4-69ec-44a5-bdbf-17a716389fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:19:00 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:b7:2d,bridge_name='br-int',has_traffic_filtering=True,id=014195e4-69ec-44a5-bdbf-17a716389fa8,network=Network(9302cb9a-12f9-4845-b6cc-905f4bf24b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014195e4-69') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:19:00 user nova-compute[74898]: DEBUG nova.objects.instance [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lazy-loading 'pci_devices' on Instance uuid 90dd082b-900d-49b4-83be-db10c7ab9533 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:19:00 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:19:00 user nova-compute[74898]:   <uuid>90dd082b-900d-49b4-83be-db10c7ab9533</uuid>
Nov 17 03:19:00 user nova-compute[74898]:   <name>instance-00000022</name>
Nov 17 03:19:00 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:19:00 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:19:00 user nova-compute[74898]:   <metadata>
Nov 17 03:19:00 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:19:00 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:19:00 user nova-compute[74898]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-521230326</nova:name>
Nov 17 03:19:00 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:18:58</nova:creationTime>
Nov 17 03:19:00 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:19:00 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:19:00 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:19:00 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:19:00 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:19:00 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:19:00 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:19:00 user nova-compute[74898]:       <nova:owner>
Nov 17 03:19:00 user nova-compute[74898]:         <nova:user uuid="05397a6b586843338aafbc8a17c6e42c">tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member</nova:user>
Nov 17 03:19:00 user nova-compute[74898]:         <nova:project uuid="b0cd941de23248d8ac93b03f930f565f">tempest-ServerBootFromVolumeStableRescueTest-507656828</nova:project>
Nov 17 03:19:00 user nova-compute[74898]:       </nova:owner>
Nov 17 03:19:00 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:19:00 user nova-compute[74898]:       <nova:ports>
Nov 17 03:19:00 user nova-compute[74898]:         <nova:port uuid="014195e4-69ec-44a5-bdbf-17a716389fa8">
Nov 17 03:19:00 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 17 03:19:00 user nova-compute[74898]:         </nova:port>
Nov 17 03:19:00 user nova-compute[74898]:       </nova:ports>
Nov 17 03:19:00 user nova-compute[74898]:     </nova:instance>
Nov 17 03:19:00 user nova-compute[74898]:   </metadata>
Nov 17 03:19:00 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:19:00 user nova-compute[74898]:     <system>
Nov 17 03:19:00 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:19:00 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:19:00 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:19:00 user nova-compute[74898]:       <entry name="serial">90dd082b-900d-49b4-83be-db10c7ab9533</entry>
Nov 17 03:19:00 user nova-compute[74898]:       <entry name="uuid">90dd082b-900d-49b4-83be-db10c7ab9533</entry>
Nov 17 03:19:00 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:19:00 user nova-compute[74898]:     </system>
Nov 17 03:19:00 user nova-compute[74898]:   </sysinfo>
Nov 17 03:19:00 user nova-compute[74898]:   <os>
Nov 17 03:19:00 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:19:00 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:19:00 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:19:00 user nova-compute[74898]:   </os>
Nov 17 03:19:00 user nova-compute[74898]:   <features>
Nov 17 03:19:00 user nova-compute[74898]:     <acpi/>
Nov 17 03:19:00 user nova-compute[74898]:     <apic/>
Nov 17 03:19:00 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:19:00 user nova-compute[74898]:   </features>
Nov 17 03:19:00 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:19:00 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:19:00 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:19:00 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:19:00 user nova-compute[74898]:   </clock>
Nov 17 03:19:00 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:19:00 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:19:00 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:19:00 user nova-compute[74898]:   </cpu>
Nov 17 03:19:00 user nova-compute[74898]:   <devices>
Nov 17 03:19:00 user nova-compute[74898]:     <disk type="block" device="disk">
Nov 17 03:19:00 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:19:00 user nova-compute[74898]:       <source dev="/dev/sde"/>
Nov 17 03:19:00 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:19:00 user nova-compute[74898]:       <serial>8f7f265c-c094-42ca-910a-2d55a601ce42</serial>
Nov 17 03:19:00 user nova-compute[74898]:     </disk>
Nov 17 03:19:00 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:19:00 user nova-compute[74898]:       <mac address="fa:16:3e:23:b7:2d"/>
Nov 17 03:19:00 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:19:00 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:19:00 user nova-compute[74898]:       <target dev="tap014195e4-69"/>
Nov 17 03:19:00 user nova-compute[74898]:     </interface>
Nov 17 03:19:00 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:19:00 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/90dd082b-900d-49b4-83be-db10c7ab9533/console.log" append="off"/>
Nov 17 03:19:00 user nova-compute[74898]:     </serial>
Nov 17 03:19:00 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:19:00 user nova-compute[74898]:     <video>
Nov 17 03:19:00 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:19:00 user nova-compute[74898]:     </video>
Nov 17 03:19:00 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:19:00 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:19:00 user nova-compute[74898]:     </rng>
Nov 17 03:19:00 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:19:00 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:19:00 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:19:00 user nova-compute[74898]:     </memballoon>
Nov 17 03:19:00 user nova-compute[74898]:   </devices>
Nov 17 03:19:00 user nova-compute[74898]: </domain>
Nov 17 03:19:00 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:19:00 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:18:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-521230326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-521230326',id=34,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0cd941de23248d8ac93b03f930f565f',ramdisk_id='',reservation_id='r-gx25h9x6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-507656828',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:18:47Z,user_data=None,user_id='05397a6b586843338aafbc8a17c6e42c',uuid=90dd082b-900d-49b4-83be-db10c7ab9533,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "014195e4-69ec-44a5-bdbf-17a716389fa8", "address": "fa:16:3e:23:b7:2d", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014195e4-69", "ovs_interfaceid": "014195e4-69ec-44a5-bdbf-17a716389fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:19:00 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Converting VIF {"id": "014195e4-69ec-44a5-bdbf-17a716389fa8", "address": "fa:16:3e:23:b7:2d", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014195e4-69", "ovs_interfaceid": "014195e4-69ec-44a5-bdbf-17a716389fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:19:00 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:b7:2d,bridge_name='br-int',has_traffic_filtering=True,id=014195e4-69ec-44a5-bdbf-17a716389fa8,network=Network(9302cb9a-12f9-4845-b6cc-905f4bf24b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014195e4-69') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:19:00 user nova-compute[74898]: DEBUG os_vif [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:b7:2d,bridge_name='br-int',has_traffic_filtering=True,id=014195e4-69ec-44a5-bdbf-17a716389fa8,network=Network(9302cb9a-12f9-4845-b6cc-905f4bf24b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014195e4-69') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:19:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:19:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:19:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '12ded4e1-f0e6-5cc8-8bd1-677fbb49ca72', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:19:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:19:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap014195e4-69, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:19:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap014195e4-69, col_values=(('qos', UUID('cc1f95c7-0020-427f-99a1-a6b0016c8f62')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:19:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap014195e4-69, col_values=(('external_ids', {'iface-id': '014195e4-69ec-44a5-bdbf-17a716389fa8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:b7:2d', 'vm-uuid': '90dd082b-900d-49b4-83be-db10c7ab9533'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:19:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:19:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:00 user nova-compute[74898]: INFO os_vif [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:b7:2d,bridge_name='br-int',has_traffic_filtering=True,id=014195e4-69ec-44a5-bdbf-17a716389fa8,network=Network(9302cb9a-12f9-4845-b6cc-905f4bf24b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014195e4-69')
Nov 17 03:19:00 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:19:00 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] No VIF found with MAC fa:16:3e:23:b7:2d, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:19:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:01 user nova-compute[74898]: DEBUG nova.compute.manager [req-77f31a84-082d-4f50-81fb-dbb5f3eec8ae req-9c00452a-4d19-4572-b6e1-683e628e1256 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Received event network-vif-plugged-014195e4-69ec-44a5-bdbf-17a716389fa8 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:19:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-77f31a84-082d-4f50-81fb-dbb5f3eec8ae req-9c00452a-4d19-4572-b6e1-683e628e1256 service nova] Acquiring lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:19:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-77f31a84-082d-4f50-81fb-dbb5f3eec8ae req-9c00452a-4d19-4572-b6e1-683e628e1256 service nova] Lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:19:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-77f31a84-082d-4f50-81fb-dbb5f3eec8ae req-9c00452a-4d19-4572-b6e1-683e628e1256 service nova] Lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:19:01 user nova-compute[74898]: DEBUG nova.compute.manager [req-77f31a84-082d-4f50-81fb-dbb5f3eec8ae req-9c00452a-4d19-4572-b6e1-683e628e1256 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] No waiting events found dispatching network-vif-plugged-014195e4-69ec-44a5-bdbf-17a716389fa8 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:19:01 user nova-compute[74898]: WARNING nova.compute.manager [req-77f31a84-082d-4f50-81fb-dbb5f3eec8ae req-9c00452a-4d19-4572-b6e1-683e628e1256 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Received unexpected event network-vif-plugged-014195e4-69ec-44a5-bdbf-17a716389fa8 for instance with vm_state building and task_state spawning.
Nov 17 03:19:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:03 user nova-compute[74898]: DEBUG nova.compute.manager [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:19:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:19:03 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Instance spawned successfully.
Nov 17 03:19:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:19:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:19:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:19:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:19:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:19:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:19:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:19:04 user nova-compute[74898]: DEBUG nova.compute.manager [req-ffb6ad41-ed6c-4310-b520-96b13f9b7761 req-4d1f2d02-10df-4493-b68c-00461eae3a1a service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Received event network-vif-plugged-014195e4-69ec-44a5-bdbf-17a716389fa8 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:19:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ffb6ad41-ed6c-4310-b520-96b13f9b7761 req-4d1f2d02-10df-4493-b68c-00461eae3a1a service nova] Acquiring lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:19:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ffb6ad41-ed6c-4310-b520-96b13f9b7761 req-4d1f2d02-10df-4493-b68c-00461eae3a1a service nova] Lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:19:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ffb6ad41-ed6c-4310-b520-96b13f9b7761 req-4d1f2d02-10df-4493-b68c-00461eae3a1a service nova] Lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:19:04 user nova-compute[74898]: DEBUG nova.compute.manager [req-ffb6ad41-ed6c-4310-b520-96b13f9b7761 req-4d1f2d02-10df-4493-b68c-00461eae3a1a service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] No waiting events found dispatching network-vif-plugged-014195e4-69ec-44a5-bdbf-17a716389fa8 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:19:04 user nova-compute[74898]: WARNING nova.compute.manager [req-ffb6ad41-ed6c-4310-b520-96b13f9b7761 req-4d1f2d02-10df-4493-b68c-00461eae3a1a service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Received unexpected event network-vif-plugged-014195e4-69ec-44a5-bdbf-17a716389fa8 for instance with vm_state building and task_state spawning.
Nov 17 03:19:04 user nova-compute[74898]: INFO nova.compute.manager [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Took 5.54 seconds to spawn the instance on the hypervisor.
Nov 17 03:19:04 user nova-compute[74898]: DEBUG nova.compute.manager [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:19:04 user nova-compute[74898]: INFO nova.compute.manager [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Took 18.77 seconds to build instance.
Nov 17 03:19:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-975995ea-5f49-42a8-ade9-35c35dbb1074 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "90dd082b-900d-49b4-83be-db10c7ab9533" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.870s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:19:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:16 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:25 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:19:25 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:19:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:27 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:19:28 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:19:29 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:19:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:30 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:19:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:31 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:19:32 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:19:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:19:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:19:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:19:32 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:19:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:19:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:19:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbd19c4-82c5-4c69-a236-1b3fda1e0a75/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:19:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbd19c4-82c5-4c69-a236-1b3fda1e0a75/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:19:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbd19c4-82c5-4c69-a236-1b3fda1e0a75/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:19:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbd19c4-82c5-4c69-a236-1b3fda1e0a75/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:19:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:19:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:19:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:19:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:19:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:19:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:19:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:19:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:19:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:19:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:19:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:19:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:19:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:19:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:19:34 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:19:34 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:19:34 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=8080MB free_disk=25.210792541503906GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:19:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:19:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:19:34 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 42994e39-187a-4fb6-a293-24a4eb57177b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:19:34 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 13449e5c-809b-4db2-af0b-53f5865eb3a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:19:34 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 24cd7ac4-3724-4189-82a7-ba61ba46097a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:19:34 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 6eee4731-60ed-41ab-905e-395aa4d5e568 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:19:34 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 3b325f5d-481c-410e-910a-f29df36caec2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:19:34 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance a162dc24-084d-4612-95d8-67d23f8f6d29 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:19:34 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:19:34 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 90dd082b-900d-49b4-83be-db10c7ab9533 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:19:34 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:19:34 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:19:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:35 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:19:35 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:19:35 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:19:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:19:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:36 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:19:36 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:19:36 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Didn't find any instances for network info cache update. {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 17 03:19:36 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:19:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:40 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:19:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:19:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:19:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:19:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:19:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:19:58 user nova-compute[74898]: INFO nova.compute.manager [None req-b163eb27-a16d-431f-bb89-5555c3d41f5e tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Get console output
Nov 17 03:19:58 user nova-compute[74898]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 17 03:20:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:20:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:20:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:20:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:20:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:20:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:20:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:20:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:20:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:20:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:20:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:20:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:20:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "a162dc24-084d-4612-95d8-67d23f8f6d29" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "a162dc24-084d-4612-95d8-67d23f8f6d29" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "a162dc24-084d-4612-95d8-67d23f8f6d29-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "a162dc24-084d-4612-95d8-67d23f8f6d29-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "a162dc24-084d-4612-95d8-67d23f8f6d29-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:20:26 user nova-compute[74898]: INFO nova.compute.manager [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Terminating instance
Nov 17 03:20:26 user nova-compute[74898]: DEBUG nova.compute.manager [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG nova.compute.manager [req-d8c21d62-93fb-4db6-b4fa-e2f74c7a7f24 req-45321861-377c-42e9-aeee-ea150f995d86 service nova] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Received event network-changed-bc143a47-d472-467b-a6a7-59523c7c3f0b {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG nova.compute.manager [req-d8c21d62-93fb-4db6-b4fa-e2f74c7a7f24 req-45321861-377c-42e9-aeee-ea150f995d86 service nova] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Refreshing instance network info cache due to event network-changed-bc143a47-d472-467b-a6a7-59523c7c3f0b. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d8c21d62-93fb-4db6-b4fa-e2f74c7a7f24 req-45321861-377c-42e9-aeee-ea150f995d86 service nova] Acquiring lock "refresh_cache-3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d8c21d62-93fb-4db6-b4fa-e2f74c7a7f24 req-45321861-377c-42e9-aeee-ea150f995d86 service nova] Acquired lock "refresh_cache-3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG nova.network.neutron [req-d8c21d62-93fb-4db6-b4fa-e2f74c7a7f24 req-45321861-377c-42e9-aeee-ea150f995d86 service nova] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Refreshing network info cache for port bc143a47-d472-467b-a6a7-59523c7c3f0b {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG nova.compute.manager [req-c9d23751-5716-4a27-bc5f-31ae2d8b2eba req-096173a0-ca39-43e2-bf08-54e1d7dbd782 service nova] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Received event network-vif-unplugged-3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c9d23751-5716-4a27-bc5f-31ae2d8b2eba req-096173a0-ca39-43e2-bf08-54e1d7dbd782 service nova] Acquiring lock "a162dc24-084d-4612-95d8-67d23f8f6d29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c9d23751-5716-4a27-bc5f-31ae2d8b2eba req-096173a0-ca39-43e2-bf08-54e1d7dbd782 service nova] Lock "a162dc24-084d-4612-95d8-67d23f8f6d29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c9d23751-5716-4a27-bc5f-31ae2d8b2eba req-096173a0-ca39-43e2-bf08-54e1d7dbd782 service nova] Lock "a162dc24-084d-4612-95d8-67d23f8f6d29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG nova.compute.manager [req-c9d23751-5716-4a27-bc5f-31ae2d8b2eba req-096173a0-ca39-43e2-bf08-54e1d7dbd782 service nova] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] No waiting events found dispatching network-vif-unplugged-3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG nova.compute.manager [req-c9d23751-5716-4a27-bc5f-31ae2d8b2eba req-096173a0-ca39-43e2-bf08-54e1d7dbd782 service nova] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Received event network-vif-unplugged-3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:26 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Instance destroyed successfully.
Nov 17 03:20:26 user nova-compute[74898]: DEBUG nova.objects.instance [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lazy-loading 'resources' on Instance uuid a162dc24-084d-4612-95d8-67d23f8f6d29 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:18:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-22699785',display_name='tempest-TestVolumeBootPattern-server-22699785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-22699785',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:18:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d36087cc8e842c0bfcae89553fb9841',ramdisk_id='',reservation_id='r-ctqx6ty4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1382126375',owner_user_name='tempest-TestVolumeBootPattern-1382126375-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:18:54Z,user_data=None,user_id='aa779a5f98394629b6b9fa9d04233e7a',uuid=a162dc24-084d-4612-95d8-67d23f8f6d29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7", "address": "fa:16:3e:67:ba:f1", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b11bc7b-8f", "ovs_interfaceid": "3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converting VIF {"id": "3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7", "address": "fa:16:3e:67:ba:f1", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b11bc7b-8f", "ovs_interfaceid": "3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:ba:f1,bridge_name='br-int',has_traffic_filtering=True,id=3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b11bc7b-8f') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG os_vif [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:ba:f1,bridge_name='br-int',has_traffic_filtering=True,id=3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b11bc7b-8f') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b11bc7b-8f, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=132d64c1-4da7-41bd-98d6-eed1d62e23b1) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:26 user nova-compute[74898]: INFO os_vif [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:ba:f1,bridge_name='br-int',has_traffic_filtering=True,id=3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b11bc7b-8f')
Nov 17 03:20:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FTgxluAh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:20:26 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:20:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbcf6b5-9d85-476d-8e5c-992289bda2b0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:20:26 user nova-compute[74898]: No targets found.
Nov 17 03:20:26 user nova-compute[74898]: iSNS:
Nov 17 03:20:26 user nova-compute[74898]: No targets found.
Nov 17 03:20:26 user nova-compute[74898]: STATIC:
Nov 17 03:20:26 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4
Nov 17 03:20:26 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:20:26 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:20:26 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5
Nov 17 03:20:26 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:20:26 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:20:26 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4
Nov 17 03:20:26 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:20:26 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:20:26 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42
Nov 17 03:20:26 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:20:26 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:20:26 user nova-compute[74898]: FIRMWARE:
Nov 17 03:20:26 user nova-compute[74898]: No targets found.
Nov 17 03:20:26 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:20:26 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:20:26 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a87dca-4f63-4ec2-ae10-66deb83a96ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[701c4fc0-0fc5-4d61-afd3-c89e2a84c1a2]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:20:26 user nova-compute[74898]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:20:26 user nova-compute[74898]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 (non-flash)
Nov 17 03:20:26 user nova-compute[74898]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)
Nov 17 03:20:26 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:20:26 user nova-compute[74898]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:20:26 user nova-compute[74898]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 (non-flash)
Nov 17 03:20:26 user nova-compute[74898]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)
Nov 17 03:20:26 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf86960e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4'): ({'sdd'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Removing single pathed devices sdd {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e374f0b-948d-4382-9b4a-a0d246f34765]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaaba7ba-1e2f-45cc-9125-0d095e4865d8]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Flushing IO for device /dev/sdd {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22ce399-9e37-4e8d-bf07-fba3d1b6b8a4]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:26 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:20:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[326b6035-0792-4d5d-86cf-b470753dba70]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:27 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:20:27 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] SCSI volumes sdd have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:20:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:20:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:27 user nova-compute[74898]: DEBUG nova.network.neutron [req-d8c21d62-93fb-4db6-b4fa-e2f74c7a7f24 req-45321861-377c-42e9-aeee-ea150f995d86 service nova] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Updated VIF entry in instance network info cache for port bc143a47-d472-467b-a6a7-59523c7c3f0b. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:20:27 user nova-compute[74898]: DEBUG nova.network.neutron [req-d8c21d62-93fb-4db6-b4fa-e2f74c7a7f24 req-45321861-377c-42e9-aeee-ea150f995d86 service nova] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Updating instance_info_cache with network_info: [{"id": "bc143a47-d472-467b-a6a7-59523c7c3f0b", "address": "fa:16:3e:e3:34:2a", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc143a47-d4", "ovs_interfaceid": "bc143a47-d472-467b-a6a7-59523c7c3f0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:20:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10f01bc-b921-4b91-aac3-246aebbe3aa8]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:20:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d8c21d62-93fb-4db6-b4fa-e2f74c7a7f24 req-45321861-377c-42e9-aeee-ea150f995d86 service nova] Releasing lock "refresh_cache-3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:20:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35a12f0-d59b-402d-b3d6-c55243ee34ee]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4, portal: 172.16.0.220,3260]
Nov 17 03:20:27 user nova-compute[74898]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4, portal: 172.16.0.220,3260] successful.
Nov 17 03:20:27 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:20:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0486a9ba-a72f-466d-a608-feb3149688f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d16cd1-142c-4a19-a91f-e0227f4d3278]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:20:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:20:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] <== disconnect_volume: return (332ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:20:27 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:20:27 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Deleting instance files /opt/stack/data/nova/instances/a162dc24-084d-4612-95d8-67d23f8f6d29_del
Nov 17 03:20:27 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Deletion of /opt/stack/data/nova/instances/a162dc24-084d-4612-95d8-67d23f8f6d29_del complete
Nov 17 03:20:27 user nova-compute[74898]: INFO nova.compute.manager [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 17 03:20:27 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:20:27 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:20:27 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:20:27 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:20:27 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Took 0.42 seconds to deallocate network for instance.
Nov 17 03:20:28 user nova-compute[74898]: INFO nova.compute.manager [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Took 0.72 seconds to detach 1 volumes for instance.
Nov 17 03:20:28 user nova-compute[74898]: DEBUG nova.compute.manager [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Deleting volume: 0486a9ba-a72f-466d-a608-feb3149688f4 {{(pid=74898) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 17 03:20:28 user nova-compute[74898]: DEBUG nova.compute.manager [req-c5786fc7-b44f-45b6-94c2-55bc1eae0d7e req-5b851b89-0e7c-46d7-b0c7-4c0c11fca2bc service nova] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Received event network-vif-plugged-3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:20:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c5786fc7-b44f-45b6-94c2-55bc1eae0d7e req-5b851b89-0e7c-46d7-b0c7-4c0c11fca2bc service nova] Acquiring lock "a162dc24-084d-4612-95d8-67d23f8f6d29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:20:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c5786fc7-b44f-45b6-94c2-55bc1eae0d7e req-5b851b89-0e7c-46d7-b0c7-4c0c11fca2bc service nova] Lock "a162dc24-084d-4612-95d8-67d23f8f6d29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:20:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c5786fc7-b44f-45b6-94c2-55bc1eae0d7e req-5b851b89-0e7c-46d7-b0c7-4c0c11fca2bc service nova] Lock "a162dc24-084d-4612-95d8-67d23f8f6d29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:20:28 user nova-compute[74898]: DEBUG nova.compute.manager [req-c5786fc7-b44f-45b6-94c2-55bc1eae0d7e req-5b851b89-0e7c-46d7-b0c7-4c0c11fca2bc service nova] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] No waiting events found dispatching network-vif-plugged-3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:20:28 user nova-compute[74898]: WARNING nova.compute.manager [req-c5786fc7-b44f-45b6-94c2-55bc1eae0d7e req-5b851b89-0e7c-46d7-b0c7-4c0c11fca2bc service nova] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Received unexpected event network-vif-plugged-3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7 for instance with vm_state active and task_state deleting.
Nov 17 03:20:28 user nova-compute[74898]: DEBUG nova.compute.manager [req-c5786fc7-b44f-45b6-94c2-55bc1eae0d7e req-5b851b89-0e7c-46d7-b0c7-4c0c11fca2bc service nova] [instance: a162dc24-084d-4612-95d8-67d23f8f6d29] Received event network-vif-deleted-3b11bc7b-8fea-40d8-90bc-2b1b0a8b07d7 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:20:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:20:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:20:28 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:20:28 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:20:28 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:20:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:20:28 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Deleted allocations for instance a162dc24-084d-4612-95d8-67d23f8f6d29
Nov 17 03:20:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:20:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:20:28 user nova-compute[74898]: DEBUG nova.objects.instance [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'flavor' on Instance uuid 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:20:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:20:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2756206a-ccaf-4cb1-b961-5e34f0d2892b tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "a162dc24-084d-4612-95d8-67d23f8f6d29" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.932s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:20:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:20:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:20:29 user nova-compute[74898]: INFO nova.compute.manager [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Attaching volume dea879e4-9b48-4c3c-877a-d907e1c9aaff to /dev/vdb
Nov 17 03:20:29 user nova-compute[74898]: DEBUG os_brick.utils [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:20:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26efa15-d5cc-49c0-b0ce-ffb790e4a17d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8798fa79-fa9b-41d0-8c71-b91a82dfd766]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e67eb1b-c06f-4c8e-a5b6-eb4c05c885db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1065a7af-18b8-4f54-bf31-0f6a414623e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:20:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:20:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:20:29 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:20:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b334631b-e7e1-4e97-8a32-ee5112b4b23f]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:20:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:20:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:20:29 user nova-compute[74898]: DEBUG os_brick.utils [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:20:29 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Updating existing volume attachment record: caa62e7c-7a4b-481f-96fe-648e22f9fbb7 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:20:29 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:20:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:31 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:20:31 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:20:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:32 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:20:33 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:20:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:20:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:20:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:20:33 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:20:33 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:20:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbd19c4-82c5-4c69-a236-1b3fda1e0a75/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbd19c4-82c5-4c69-a236-1b3fda1e0a75/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbd19c4-82c5-4c69-a236-1b3fda1e0a75/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbd19c4-82c5-4c69-a236-1b3fda1e0a75/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eVlBLohP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:20:34 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:20:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:20:34 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:20:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:20:34 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d43b4a-b648-48c8-861f-a9627dbd0ba1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:20:34 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60529e6-b68f-4fc7-8eda-826e87a18d9b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff] added
Nov 17 03:20:34 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.042s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a0fac7-e2d8-4636-8370-1d6656d595dd]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a78b3e-d85f-410f-90bf-67c6e1012c86]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eVlBLohP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eVlBLohP" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad5d888-8b58-420e-b533-b1f7de7e3dda]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eVlBLohP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[238151bb-09c5-4f0b-96cc-11a5e25a17e9]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b3383a-ca2d-47ce-be81-3c0da0f7352e]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:20:34 user nova-compute[74898]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:20:34 user nova-compute[74898]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)
Nov 17 03:20:34 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:20:34 user nova-compute[74898]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:20:34 user nova-compute[74898]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)
Nov 17 03:20:34 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b758e6d1-1fbc-4f8b-9dbd-df5d6f35e653]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff, portal: 172.16.0.220,3260]
Nov 17 03:20:34 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff, portal: 172.16.0.220,3260] successful.
Nov 17 03:20:34 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:20:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[427ab7b1-6c6a-44c5-a0d1-f358a9b5b16e]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:20:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d766c93-e163-416f-88b7-0ceda7c5fd7f]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:20:35 user nova-compute[74898]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:20:35 user nova-compute[74898]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)
Nov 17 03:20:35 user nova-compute[74898]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff (non-flash)
Nov 17 03:20:35 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:20:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:20:35 user nova-compute[74898]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:20:35 user nova-compute[74898]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)
Nov 17 03:20:35 user nova-compute[74898]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff (non-flash)
Nov 17 03:20:35 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:20:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:20:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:20:35 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:20:35 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:20:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[62538a9f-5f1a-4cd6-a7a9-a50c38e44ea3]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:35 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: None {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:20:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:35 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:20:35 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:20:35 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:20:35 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:20:36 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=8311MB free_disk=25.209617614746094GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eVlBLohP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23730333764336362', 'path': '/dev/sdd'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730333764336362', 'path': '/dev/sdd'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG nova.objects.instance [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'flavor' on Instance uuid 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 03:20:36 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:20:36 user nova-compute[74898]:   <source dev="/dev/sdd"/>
Nov 17 03:20:36 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:20:36 user nova-compute[74898]:   <serial>dea879e4-9b48-4c3c-877a-d907e1c9aaff</serial>
Nov 17 03:20:36 user nova-compute[74898]: </disk>
Nov 17 03:20:36 user nova-compute[74898]:  {{(pid=74898) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 42994e39-187a-4fb6-a293-24a4eb57177b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 13449e5c-809b-4db2-af0b-53f5865eb3a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 24cd7ac4-3724-4189-82a7-ba61ba46097a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 6eee4731-60ed-41ab-905e-395aa4d5e568 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 3b325f5d-481c-410e-910a-f29df36caec2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 90dd082b-900d-49b4-83be-db10c7ab9533 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Refreshing inventories for resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Updating ProviderTree inventory for provider b743bdc9-a8bb-467c-98c8-06f1954f87df from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Updating inventory in ProviderTree for provider b743bdc9-a8bb-467c-98c8-06f1954f87df with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Refreshing aggregate associations for resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df, aggregates: None {{(pid=74898) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Refreshing trait associations for resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=74898) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] No VIF found with MAC fa:16:3e:e3:34:2a, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:20:36 user nova-compute[74898]: INFO nova.compute.manager [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Rescuing
Nov 17 03:20:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "refresh_cache-90dd082b-900d-49b4-83be-db10c7ab9533" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquired lock "refresh_cache-90dd082b-900d-49b4-83be-db10c7ab9533" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG nova.network.neutron [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-270cfaf2-87cb-4883-8fa7-a00ca12cd98a tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.640s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.847s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Cleaning up deleted instances {{(pid=74898) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 17 03:20:36 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] There are 0 instances to clean {{(pid=74898) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 17 03:20:37 user nova-compute[74898]: DEBUG nova.network.neutron [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Updating instance_info_cache with network_info: [{"id": "014195e4-69ec-44a5-bdbf-17a716389fa8", "address": "fa:16:3e:23:b7:2d", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014195e4-69", "ovs_interfaceid": "014195e4-69ec-44a5-bdbf-17a716389fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:20:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Releasing lock "refresh_cache-90dd082b-900d-49b4-83be-db10c7ab9533" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:20:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:37 user nova-compute[74898]: DEBUG nova.compute.manager [req-eebdf92a-131a-4870-998a-4ce6b36f9b2a req-997017c4-3b5b-4a5d-ae63-f3abecf77bb4 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Received event network-vif-unplugged-014195e4-69ec-44a5-bdbf-17a716389fa8 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:20:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-eebdf92a-131a-4870-998a-4ce6b36f9b2a req-997017c4-3b5b-4a5d-ae63-f3abecf77bb4 service nova] Acquiring lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:20:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-eebdf92a-131a-4870-998a-4ce6b36f9b2a req-997017c4-3b5b-4a5d-ae63-f3abecf77bb4 service nova] Lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:20:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-eebdf92a-131a-4870-998a-4ce6b36f9b2a req-997017c4-3b5b-4a5d-ae63-f3abecf77bb4 service nova] Lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:20:37 user nova-compute[74898]: DEBUG nova.compute.manager [req-eebdf92a-131a-4870-998a-4ce6b36f9b2a req-997017c4-3b5b-4a5d-ae63-f3abecf77bb4 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] No waiting events found dispatching network-vif-unplugged-014195e4-69ec-44a5-bdbf-17a716389fa8 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:20:37 user nova-compute[74898]: WARNING nova.compute.manager [req-eebdf92a-131a-4870-998a-4ce6b36f9b2a req-997017c4-3b5b-4a5d-ae63-f3abecf77bb4 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Received unexpected event network-vif-unplugged-014195e4-69ec-44a5-bdbf-17a716389fa8 for instance with vm_state active and task_state rescuing.
Nov 17 03:20:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:37 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:20:37 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:20:37 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Rebuilding the list of instances to heal {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 03:20:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-42994e39-187a-4fb6-a293-24a4eb57177b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:20:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-42994e39-187a-4fb6-a293-24a4eb57177b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:20:37 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:20:37 user nova-compute[74898]: DEBUG nova.objects.instance [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lazy-loading 'info_cache' on Instance uuid 42994e39-187a-4fb6-a293-24a4eb57177b {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:20:38 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Instance destroyed successfully.
Nov 17 03:20:38 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Attempting a stable device rescue
Nov 17 03:20:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74898) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 17 03:20:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Instance directory exists: not creating {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 17 03:20:38 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Creating image(s)
Nov 17 03:20:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "/opt/stack/data/nova/instances/90dd082b-900d-49b4-83be-db10c7ab9533/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:20:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "/opt/stack/data/nova/instances/90dd082b-900d-49b4-83be-db10c7ab9533/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:20:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "/opt/stack/data/nova/instances/90dd082b-900d-49b4-83be-db10c7ab9533/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:20:38 user nova-compute[74898]: DEBUG nova.objects.instance [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lazy-loading 'trusted_certs' on Instance uuid 90dd082b-900d-49b4-83be-db10c7ab9533 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:20:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "d4f8cd6277b8159174836ea2f871652b993a6b93" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:20:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "d4f8cd6277b8159174836ea2f871652b993a6b93" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:20:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4f8cd6277b8159174836ea2f871652b993a6b93.part --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:39 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Updating instance_info_cache with network_info: [{"id": "92a5885a-8cb1-43f8-906a-97d7fa08eb62", "address": "fa:16:3e:ab:28:fe", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a5885a-8c", "ovs_interfaceid": "92a5885a-8cb1-43f8-906a-97d7fa08eb62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:20:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-42994e39-187a-4fb6-a293-24a4eb57177b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:20:39 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:20:39 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:20:39 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:20:39 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Cleaning up deleted instances with incomplete migration  {{(pid=74898) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 17 03:20:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4f8cd6277b8159174836ea2f871652b993a6b93.part --force-share --output=json" returned: 0 in 0.176s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:39 user nova-compute[74898]: DEBUG nova.virt.images [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] ecbebd25-e49c-4e38-abe1-a488e694ea98 was qcow2, converting to raw {{(pid=74898) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 17 03:20:39 user nova-compute[74898]: DEBUG nova.privsep.utils [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74898) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 03:20:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d4f8cd6277b8159174836ea2f871652b993a6b93.part /opt/stack/data/nova/instances/_base/d4f8cd6277b8159174836ea2f871652b993a6b93.converted {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-a19b76c2-6aff-48ba-9acf-691a13aa59ae req-62c92b11-20fc-4dba-a323-aa09e40747f5 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Received event network-vif-plugged-014195e4-69ec-44a5-bdbf-17a716389fa8 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:20:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a19b76c2-6aff-48ba-9acf-691a13aa59ae req-62c92b11-20fc-4dba-a323-aa09e40747f5 service nova] Acquiring lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:20:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a19b76c2-6aff-48ba-9acf-691a13aa59ae req-62c92b11-20fc-4dba-a323-aa09e40747f5 service nova] Lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:20:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a19b76c2-6aff-48ba-9acf-691a13aa59ae req-62c92b11-20fc-4dba-a323-aa09e40747f5 service nova] Lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:20:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-a19b76c2-6aff-48ba-9acf-691a13aa59ae req-62c92b11-20fc-4dba-a323-aa09e40747f5 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] No waiting events found dispatching network-vif-plugged-014195e4-69ec-44a5-bdbf-17a716389fa8 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:20:39 user nova-compute[74898]: WARNING nova.compute.manager [req-a19b76c2-6aff-48ba-9acf-691a13aa59ae req-62c92b11-20fc-4dba-a323-aa09e40747f5 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Received unexpected event network-vif-plugged-014195e4-69ec-44a5-bdbf-17a716389fa8 for instance with vm_state active and task_state rescuing.
Nov 17 03:20:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d4f8cd6277b8159174836ea2f871652b993a6b93.part /opt/stack/data/nova/instances/_base/d4f8cd6277b8159174836ea2f871652b993a6b93.converted" returned: 0 in 0.520s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4f8cd6277b8159174836ea2f871652b993a6b93.converted --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4f8cd6277b8159174836ea2f871652b993a6b93.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "d4f8cd6277b8159174836ea2f871652b993a6b93" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.031s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "d4f8cd6277b8159174836ea2f871652b993a6b93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "d4f8cd6277b8159174836ea2f871652b993a6b93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4f8cd6277b8159174836ea2f871652b993a6b93 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4f8cd6277b8159174836ea2f871652b993a6b93 --force-share --output=json" returned: 0 in 0.174s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4f8cd6277b8159174836ea2f871652b993a6b93,backing_fmt=raw /opt/stack/data/nova/instances/90dd082b-900d-49b4-83be-db10c7ab9533/disk.rescue {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4f8cd6277b8159174836ea2f871652b993a6b93,backing_fmt=raw /opt/stack/data/nova/instances/90dd082b-900d-49b4-83be-db10c7ab9533/disk.rescue" returned: 0 in 0.049s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "d4f8cd6277b8159174836ea2f871652b993a6b93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.objects.instance [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lazy-loading 'migration_context' on Instance uuid 90dd082b-900d-49b4-83be-db10c7ab9533 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.objects.base [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Object Instance<90dd082b-900d-49b4-83be-db10c7ab9533> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Start _get_guest_xml network_info=[{"id": "014195e4-69ec-44a5-bdbf-17a716389fa8", "address": "fa:16:3e:23:b7:2d", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "vif_mac": "fa:16:3e:23:b7:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014195e4-69", "ovs_interfaceid": "014195e4-69ec-44a5-bdbf-17a716389fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ecbebd25-e49c-4e38-abe1-a488e694ea98', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uUFvOzEJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '90dd082b-900d-49b4-83be-db10c7ab9533', 'attached_at': '', 'detached_at': '', 'volume_id': '8f7f265c-c094-42ca-910a-2d55a601ce42', 'serial': '8f7f265c-c094-42ca-910a-2d55a601ce42'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '79ecd3bc-9fd3-4b9a-912b-febe679eab24', 'volume_type': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.objects.instance [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lazy-loading 'resources' on Instance uuid 90dd082b-900d-49b4-83be-db10c7ab9533 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.objects.base [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Object Instance<90dd082b-900d-49b4-83be-db10c7ab9533> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.objects.instance [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lazy-loading 'numa_topology' on Instance uuid 90dd082b-900d-49b4-83be-db10c7ab9533 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.objects.base [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Object Instance<90dd082b-900d-49b4-83be-db10c7ab9533> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:20:40 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:20:40 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.objects.instance [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lazy-loading 'vcpu_model' on Instance uuid 90dd082b-900d-49b4-83be-db10c7ab9533 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.objects.base [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Object Instance<90dd082b-900d-49b4-83be-db10c7ab9533> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uUFvOzEJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:20:40 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:20:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:20:40 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:20:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:20:40 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.objects.instance [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'flavor' on Instance uuid 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d3c103-bbfd-4f68-bb91-de6f7e3b3e6c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = uUFvOzEJ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 17 03:20:40 user nova-compute[74898]: node.name = iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42
Nov 17 03:20:40 user nova-compute[74898]: node.tpgt = -1
Nov 17 03:20:40 user nova-compute[74898]: node.startup = automatic
Nov 17 03:20:40 user nova-compute[74898]: node.leading_login = No
Nov 17 03:20:40 user nova-compute[74898]: iface.iscsi_ifacename = default
Nov 17 03:20:40 user nova-compute[74898]: iface.net_ifacename = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.ipaddress = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.prefix_len = 0
Nov 17 03:20:40 user nova-compute[74898]: iface.hwaddress = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.transport_name = tcp
Nov 17 03:20:40 user nova-compute[74898]: iface.initiatorname = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.state = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.vlan_id = 0
Nov 17 03:20:40 user nova-compute[74898]: iface.vlan_priority = 0
Nov 17 03:20:40 user nova-compute[74898]: iface.vlan_state = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.iface_num = 0
Nov 17 03:20:40 user nova-compute[74898]: iface.mtu = 0
Nov 17 03:20:40 user nova-compute[74898]: iface.port = 0
Nov 17 03:20:40 user nova-compute[74898]: iface.bootproto = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.subnet_mask = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.gateway = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.dhcp_alt_client_id_state = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.dhcp_alt_client_id = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.dhcp_dns = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.dhcp_learn_iqn = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.dhcp_req_vendor_id_state = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.dhcp_vendor_id_state = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.dhcp_vendor_id = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.dhcp_slp_da = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.fragmentation = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.gratuitous_arp = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.incoming_forwarding = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.tos_state = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.tos = 0
Nov 17 03:20:40 user nova-compute[74898]: iface.ttl = 0
Nov 17 03:20:40 user nova-compute[74898]: iface.delayed_ack = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.tcp_nagle = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.tcp_wsf_state = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.tcp_wsf = 0
Nov 17 03:20:40 user nova-compute[74898]: iface.tcp_timer_scale = 0
Nov 17 03:20:40 user nova-compute[74898]: iface.tcp_timestamp = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.redirect = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.def_task_mgmt_timeout = 0
Nov 17 03:20:40 user nova-compute[74898]: iface.header_digest = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.data_digest = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.immediate_data = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.initial_r2t = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.data_seq_inorder = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.data_pdu_inorder = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.erl = 0
Nov 17 03:20:40 user nova-compute[74898]: iface.max_receive_data_len = 0
Nov 17 03:20:40 user nova-compute[74898]: iface.first_burst_len = 0
Nov 17 03:20:40 user nova-compute[74898]: iface.max_outstanding_r2t = 0
Nov 17 03:20:40 user nova-compute[74898]: iface.max_burst_len = 0
Nov 17 03:20:40 user nova-compute[74898]: iface.chap_auth = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.bidi_chap = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.strict_login_compliance = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.discovery_auth = <empty>
Nov 17 03:20:40 user nova-compute[74898]: iface.discovery_logout = <empty>
Nov 17 03:20:40 user nova-compute[74898]: node.discovery_address = <empty>
Nov 17 03:20:40 user nova-compute[74898]: node.discovery_port = 0
Nov 17 03:20:40 user nova-compute[74898]: node.discovery_type = static
Nov 17 03:20:40 user nova-compute[74898]: node.session.initial_cmdsn = 0
Nov 17 03:20:40 user nova-compute[74898]: node.session.initial_login_retry_max = 8
Nov 17 03:20:40 user nova-compute[74898]: node.session.xmit_thread_priority = -20
Nov 17 03:20:40 user nova-compute[74898]: node.session.cmds_max = 128
Nov 17 03:20:40 user nova-compute[74898]: node.session.queue_depth = 32
Nov 17 03:20:40 user nova-compute[74898]: node.session.nr_sessions = 1
Nov 17 03:20:40 user nova-compute[74898]: node.session.auth.authmethod = CHAP
Nov 17 03:20:40 user nova-compute[74898]: node.session.auth.username = uUFvOzEJ
Nov 17 03:20:40 user nova-compute[74898]: node.session.auth.password = ***
Nov 17 03:20:40 user nova-compute[74898]: node.session.auth.username_in = <empty>
Nov 17 03:20:40 user nova-compute[74898]: node.session.auth.password_in = <empty>
Nov 17 03:20:40 user nova-compute[74898]: node.session.auth.chap_algs = MD5
Nov 17 03:20:40 user nova-compute[74898]: node.session.timeo.replacement_timeout = 120
Nov 17 03:20:40 user nova-compute[74898]: node.session.err_timeo.abort_timeout = 15
Nov 17 03:20:40 user nova-compute[74898]: node.session.err_timeo.lu_reset_timeout = 30
Nov 17 03:20:40 user nova-compute[74898]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 17 03:20:40 user nova-compute[74898]: node.session.err_timeo.host_reset_timeout = 60
Nov 17 03:20:40 user nova-compute[74898]: node.session.iscsi.FastAbort = Yes
Nov 17 03:20:40 user nova-compute[74898]: node.session.iscsi.InitialR2T = No
Nov 17 03:20:40 user nova-compute[74898]: node.session.iscsi.ImmediateData = Yes
Nov 17 03:20:40 user nova-compute[74898]: node.session.iscsi.FirstBurstLength = 262144
Nov 17 03:20:40 user nova-compute[74898]: node.session.iscsi.MaxBurstLength = 16776192
Nov 17 03:20:40 user nova-compute[74898]: node.session.iscsi.DefaultTime2Retain = 0
Nov 17 03:20:40 user nova-compute[74898]: node.session.iscsi.DefaultTime2Wait = 2
Nov 17 03:20:40 user nova-compute[74898]: node.session.iscsi.MaxConnections = 1
Nov 17 03:20:40 user nova-compute[74898]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 17 03:20:40 user nova-compute[74898]: node.session.iscsi.ERL = 0
Nov 17 03:20:40 user nova-compute[74898]: node.session.scan = manual
Nov 17 03:20:40 user nova-compute[74898]: node.session.reopen_max = 0
Nov 17 03:20:40 user nova-compute[74898]: node.conn[0].address = 172.16.0.220
Nov 17 03:20:40 user nova-compute[74898]: node.conn[0].port = 3260
Nov 17 03:20:40 user nova-compute[74898]: node.conn[0].startup = manual
Nov 17 03:20:40 user nova-compute[74898]: node.conn[0].tcp.window_size = 524288
Nov 17 03:20:40 user nova-compute[74898]: node.conn[0].tcp.type_of_service = 0
Nov 17 03:20:40 user nova-compute[74898]: node.conn[0].timeo.logout_timeout = 15
Nov 17 03:20:40 user nova-compute[74898]: node.conn[0].timeo.login_timeout = 15
Nov 17 03:20:40 user nova-compute[74898]: node.conn[0].timeo.auth_timeout = 45
Nov 17 03:20:40 user nova-compute[74898]: node.conn[0].timeo.noop_out_interval = 5
Nov 17 03:20:40 user nova-compute[74898]: node.conn[0].timeo.noop_out_timeout = 5
Nov 17 03:20:40 user nova-compute[74898]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 17 03:20:40 user nova-compute[74898]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 17 03:20:40 user nova-compute[74898]: node.conn[0].iscsi.HeaderDigest = None
Nov 17 03:20:40 user nova-compute[74898]: node.conn[0].iscsi.DataDigest = None
Nov 17 03:20:40 user nova-compute[74898]: node.conn[0].iscsi.IFMarker = No
Nov 17 03:20:40 user nova-compute[74898]: node.conn[0].iscsi.OFMarker = No
Nov 17 03:20:40 user nova-compute[74898]: # END RECORD
Nov 17 03:20:40 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae310bf-d91d-48d9-84ca-93f2317b380e]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c4e4a1-7a88-4270-8698-ea49cbbab074]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uUFvOzEJ {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uUFvOzEJ" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7699f2b4-3fce-4626-95f2-4fca923bfd28]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uUFvOzEJ'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[98898568-6550-46b0-b9bf-5ebc1201802d]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[be77bed7-8b84-4ee2-a661-c193d2bc5abd]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:20:40 user nova-compute[74898]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:20:40 user nova-compute[74898]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)
Nov 17 03:20:40 user nova-compute[74898]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff (non-flash)
Nov 17 03:20:40 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:20:40 user nova-compute[74898]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:20:40 user nova-compute[74898]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)
Nov 17 03:20:40 user nova-compute[74898]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff (non-flash)
Nov 17 03:20:40 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.173s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] HCTL ('36', '0', '0', 0) found on session 41 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf01f62-5c8d-4812-8d32-72db24bc1328]: (4, ('0 0 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Searching for a device in session 41 and hctl ('36', '0', '0', 0) yield: sde {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uUFvOzEJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.204s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] <== connect_volume: return (206ms) {'type': 'block', 'scsi_wwn': '26636663035306361', 'path': '/dev/sde'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636663035306361', 'path': '/dev/sde'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:20:40 user nova-compute[74898]: INFO nova.compute.manager [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Attaching volume 68238c63-dadc-4967-be2d-3322aa95a257 to /dev/vdc
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:18:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-521230326',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-521230326',id=34,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:19:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0cd941de23248d8ac93b03f930f565f',ramdisk_id='',reservation_id='r-gx25h9x6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-507656828',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:19:04Z,user_data=None,user_id='05397a6b586843338aafbc8a17c6e42c',uuid=90dd082b-900d-49b4-83be-db10c7ab9533,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "014195e4-69ec-44a5-bdbf-17a716389fa8", "address": "fa:16:3e:23:b7:2d", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "vif_mac": "fa:16:3e:23:b7:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014195e4-69", "ovs_interfaceid": "014195e4-69ec-44a5-bdbf-17a716389fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Converting VIF {"id": "014195e4-69ec-44a5-bdbf-17a716389fa8", "address": "fa:16:3e:23:b7:2d", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "vif_mac": "fa:16:3e:23:b7:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014195e4-69", "ovs_interfaceid": "014195e4-69ec-44a5-bdbf-17a716389fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:b7:2d,bridge_name='br-int',has_traffic_filtering=True,id=014195e4-69ec-44a5-bdbf-17a716389fa8,network=Network(9302cb9a-12f9-4845-b6cc-905f4bf24b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014195e4-69') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.objects.instance [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lazy-loading 'pci_devices' on Instance uuid 90dd082b-900d-49b4-83be-db10c7ab9533 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.objects.base [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Object Instance<90dd082b-900d-49b4-83be-db10c7ab9533> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74898) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:20:40 user nova-compute[74898]:   <uuid>90dd082b-900d-49b4-83be-db10c7ab9533</uuid>
Nov 17 03:20:40 user nova-compute[74898]:   <name>instance-00000022</name>
Nov 17 03:20:40 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:20:40 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:20:40 user nova-compute[74898]:   <metadata>
Nov 17 03:20:40 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:20:40 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:20:40 user nova-compute[74898]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-521230326</nova:name>
Nov 17 03:20:40 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:20:40</nova:creationTime>
Nov 17 03:20:40 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:20:40 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:20:40 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:20:40 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:20:40 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:20:40 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:20:40 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:20:40 user nova-compute[74898]:       <nova:owner>
Nov 17 03:20:40 user nova-compute[74898]:         <nova:user uuid="05397a6b586843338aafbc8a17c6e42c">tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member</nova:user>
Nov 17 03:20:40 user nova-compute[74898]:         <nova:project uuid="b0cd941de23248d8ac93b03f930f565f">tempest-ServerBootFromVolumeStableRescueTest-507656828</nova:project>
Nov 17 03:20:40 user nova-compute[74898]:       </nova:owner>
Nov 17 03:20:40 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:20:40 user nova-compute[74898]:       <nova:ports>
Nov 17 03:20:40 user nova-compute[74898]:         <nova:port uuid="014195e4-69ec-44a5-bdbf-17a716389fa8">
Nov 17 03:20:40 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 17 03:20:40 user nova-compute[74898]:         </nova:port>
Nov 17 03:20:40 user nova-compute[74898]:       </nova:ports>
Nov 17 03:20:40 user nova-compute[74898]:     </nova:instance>
Nov 17 03:20:40 user nova-compute[74898]:   </metadata>
Nov 17 03:20:40 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:20:40 user nova-compute[74898]:     <system>
Nov 17 03:20:40 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:20:40 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:20:40 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:20:40 user nova-compute[74898]:       <entry name="serial">90dd082b-900d-49b4-83be-db10c7ab9533</entry>
Nov 17 03:20:40 user nova-compute[74898]:       <entry name="uuid">90dd082b-900d-49b4-83be-db10c7ab9533</entry>
Nov 17 03:20:40 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:20:40 user nova-compute[74898]:     </system>
Nov 17 03:20:40 user nova-compute[74898]:   </sysinfo>
Nov 17 03:20:40 user nova-compute[74898]:   <os>
Nov 17 03:20:40 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:20:40 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:20:40 user nova-compute[74898]:   </os>
Nov 17 03:20:40 user nova-compute[74898]:   <features>
Nov 17 03:20:40 user nova-compute[74898]:     <acpi/>
Nov 17 03:20:40 user nova-compute[74898]:     <apic/>
Nov 17 03:20:40 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:20:40 user nova-compute[74898]:   </features>
Nov 17 03:20:40 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:20:40 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:20:40 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:20:40 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:20:40 user nova-compute[74898]:   </clock>
Nov 17 03:20:40 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:20:40 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:20:40 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:20:40 user nova-compute[74898]:   </cpu>
Nov 17 03:20:40 user nova-compute[74898]:   <devices>
Nov 17 03:20:40 user nova-compute[74898]:     <disk type="block" device="disk">
Nov 17 03:20:40 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:20:40 user nova-compute[74898]:       <source dev="/dev/sde"/>
Nov 17 03:20:40 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:20:40 user nova-compute[74898]:       <serial>8f7f265c-c094-42ca-910a-2d55a601ce42</serial>
Nov 17 03:20:40 user nova-compute[74898]:     </disk>
Nov 17 03:20:40 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:20:40 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:20:40 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/90dd082b-900d-49b4-83be-db10c7ab9533/disk.rescue"/>
Nov 17 03:20:40 user nova-compute[74898]:       <target dev="vdb" bus="virtio"/>
Nov 17 03:20:40 user nova-compute[74898]:       <boot order="1"/>
Nov 17 03:20:40 user nova-compute[74898]:     </disk>
Nov 17 03:20:40 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:20:40 user nova-compute[74898]:       <mac address="fa:16:3e:23:b7:2d"/>
Nov 17 03:20:40 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:20:40 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:20:40 user nova-compute[74898]:       <target dev="tap014195e4-69"/>
Nov 17 03:20:40 user nova-compute[74898]:     </interface>
Nov 17 03:20:40 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:20:40 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/90dd082b-900d-49b4-83be-db10c7ab9533/console.log" append="off"/>
Nov 17 03:20:40 user nova-compute[74898]:     </serial>
Nov 17 03:20:40 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:20:40 user nova-compute[74898]:     <video>
Nov 17 03:20:40 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:20:40 user nova-compute[74898]:     </video>
Nov 17 03:20:40 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:20:40 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:20:40 user nova-compute[74898]:     </rng>
Nov 17 03:20:40 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:20:40 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:20:40 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:20:40 user nova-compute[74898]:     </memballoon>
Nov 17 03:20:40 user nova-compute[74898]:   </devices>
Nov 17 03:20:40 user nova-compute[74898]: </domain>
Nov 17 03:20:40 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:20:40 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Instance destroyed successfully.
Nov 17 03:20:40 user nova-compute[74898]: DEBUG os_brick.utils [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e24859-8b17-4e70-97fd-f0b0205f326e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e594212e-b868-4183-b604-f6b48aea0dee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] No VIF found with MAC fa:16:3e:23:b7:2d, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16aba5d-1156-4200-b7e7-55553c43887c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b469c409-e9e3-4ce9-8bb6-756b69718d5d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:20:40 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:20:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[16992b9d-6486-4c1d-92f8-606e6d05a0b7]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG os_brick.utils [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:20:40 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Updating existing volume attachment record: 1a52de64-a1be-4d52-a448-7ea1ddc562e7 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:20:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:42 user nova-compute[74898]: DEBUG nova.compute.manager [req-cc92c6c9-52b7-4a1d-be01-f30c903624dc req-336333c1-3c28-40cd-ab7d-8cdb3727d105 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Received event network-vif-plugged-014195e4-69ec-44a5-bdbf-17a716389fa8 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:20:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-cc92c6c9-52b7-4a1d-be01-f30c903624dc req-336333c1-3c28-40cd-ab7d-8cdb3727d105 service nova] Acquiring lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:20:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-cc92c6c9-52b7-4a1d-be01-f30c903624dc req-336333c1-3c28-40cd-ab7d-8cdb3727d105 service nova] Lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:20:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-cc92c6c9-52b7-4a1d-be01-f30c903624dc req-336333c1-3c28-40cd-ab7d-8cdb3727d105 service nova] Lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:20:42 user nova-compute[74898]: DEBUG nova.compute.manager [req-cc92c6c9-52b7-4a1d-be01-f30c903624dc req-336333c1-3c28-40cd-ab7d-8cdb3727d105 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] No waiting events found dispatching network-vif-plugged-014195e4-69ec-44a5-bdbf-17a716389fa8 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:20:42 user nova-compute[74898]: WARNING nova.compute.manager [req-cc92c6c9-52b7-4a1d-be01-f30c903624dc req-336333c1-3c28-40cd-ab7d-8cdb3727d105 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Received unexpected event network-vif-plugged-014195e4-69ec-44a5-bdbf-17a716389fa8 for instance with vm_state active and task_state rescuing.
Nov 17 03:20:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:44 user nova-compute[74898]: DEBUG nova.compute.manager [None req-f14fe0a4-df41-4b67-84ba-2d681dc7b465 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:20:44 user nova-compute[74898]: DEBUG nova.compute.manager [req-49fecf18-6949-438f-abf2-2c1e0be45787 req-e1898b82-2af8-4230-9d87-5ac893cb1390 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Received event network-vif-plugged-014195e4-69ec-44a5-bdbf-17a716389fa8 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:20:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-49fecf18-6949-438f-abf2-2c1e0be45787 req-e1898b82-2af8-4230-9d87-5ac893cb1390 service nova] Acquiring lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:20:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-49fecf18-6949-438f-abf2-2c1e0be45787 req-e1898b82-2af8-4230-9d87-5ac893cb1390 service nova] Lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:20:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-49fecf18-6949-438f-abf2-2c1e0be45787 req-e1898b82-2af8-4230-9d87-5ac893cb1390 service nova] Lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:20:44 user nova-compute[74898]: DEBUG nova.compute.manager [req-49fecf18-6949-438f-abf2-2c1e0be45787 req-e1898b82-2af8-4230-9d87-5ac893cb1390 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] No waiting events found dispatching network-vif-plugged-014195e4-69ec-44a5-bdbf-17a716389fa8 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:20:44 user nova-compute[74898]: WARNING nova.compute.manager [req-49fecf18-6949-438f-abf2-2c1e0be45787 req-e1898b82-2af8-4230-9d87-5ac893cb1390 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Received unexpected event network-vif-plugged-014195e4-69ec-44a5-bdbf-17a716389fa8 for instance with vm_state rescued and task_state None.
Nov 17 03:20:45 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eZosCwdm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:20:46 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:20:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:20:46 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:20:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:20:46 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[206e0c6f-8ad4-4ff1-badf-62fa69924365]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:20:46 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed7b8f4-8af6-4429-8d98-250b7ce4e18e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257] added
Nov 17 03:20:46 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e02b9e6-ac49-4296-9c0f-30e557f095dd]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ab48bf-6203-451b-8efb-d0463402bf48]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eZosCwdm {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eZosCwdm" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4faeb8fe-b284-4b27-9a16-2f6c5e4ef403]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eZosCwdm'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f62c4a-4496-4c73-bdcd-7cfca9f3b90f]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19c8712-f051-4d82-858b-cdd479ad764a]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:20:46 user nova-compute[74898]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:20:46 user nova-compute[74898]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)
Nov 17 03:20:46 user nova-compute[74898]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff (non-flash)
Nov 17 03:20:46 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:20:46 user nova-compute[74898]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:20:46 user nova-compute[74898]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)
Nov 17 03:20:46 user nova-compute[74898]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff (non-flash)
Nov 17 03:20:46 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4d2ad7-3438-4f93-87fd-d3759b6961cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257, portal: 172.16.0.220,3260]
Nov 17 03:20:46 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257, portal: 172.16.0.220,3260] successful.
Nov 17 03:20:46 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a542c3a3-99ef-4a84-a11a-71ce9a0079b0]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c948f6bc-dcfa-4d2a-ae29-749014fd6c22]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:20:46 user nova-compute[74898]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:20:46 user nova-compute[74898]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)
Nov 17 03:20:46 user nova-compute[74898]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff (non-flash)
Nov 17 03:20:46 user nova-compute[74898]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 (non-flash)
Nov 17 03:20:46 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:20:46 user nova-compute[74898]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:20:46 user nova-compute[74898]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)
Nov 17 03:20:46 user nova-compute[74898]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff (non-flash)
Nov 17 03:20:46 user nova-compute[74898]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 (non-flash)
Nov 17 03:20:46 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] HCTL ('37', '-', '-', 0) found on session 43 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[069ce116-b665-48bb-94ac-f7d14eb98c95]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:20:46 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Searching for a device in session 43 and hctl ['37', '*', '*', 0] yield: None {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:20:47 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Searching for a device in session 43 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:20:47 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eZosCwdm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:20:47 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:20:47 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23631613236323366', 'path': '/dev/sdf'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:20:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631613236323366', 'path': '/dev/sdf'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:20:47 user nova-compute[74898]: DEBUG nova.objects.instance [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'flavor' on Instance uuid 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:20:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 03:20:47 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:20:47 user nova-compute[74898]:   <source dev="/dev/sdf"/>
Nov 17 03:20:47 user nova-compute[74898]:   <target dev="vdc" bus="virtio"/>
Nov 17 03:20:47 user nova-compute[74898]:   <serial>68238c63-dadc-4967-be2d-3322aa95a257</serial>
Nov 17 03:20:47 user nova-compute[74898]: </disk>
Nov 17 03:20:47 user nova-compute[74898]:  {{(pid=74898) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 03:20:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:20:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:20:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:20:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] No VIF found with MAC fa:16:3e:e3:34:2a, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:20:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-51a5b936-3a25-4346-8aec-f2951c6f177b tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.690s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:20:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:20:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:20:49 user nova-compute[74898]: INFO nova.compute.manager [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Detaching volume dea879e4-9b48-4c3c-877a-d907e1c9aaff
Nov 17 03:20:49 user nova-compute[74898]: INFO nova.virt.block_device [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Attempting to driver detach volume dea879e4-9b48-4c3c-877a-d907e1c9aaff from mountpoint /dev/vdb
Nov 17 03:20:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Attempting to detach device vdb from instance 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75 from the persistent domain config. {{(pid=74898) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 03:20:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:20:49 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:20:49 user nova-compute[74898]:   <source dev="/dev/sdd"/>
Nov 17 03:20:49 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:20:49 user nova-compute[74898]:   <serial>dea879e4-9b48-4c3c-877a-d907e1c9aaff</serial>
Nov 17 03:20:49 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:20:49 user nova-compute[74898]: </disk>
Nov 17 03:20:49 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:20:49 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Successfully detached device vdb from instance 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75 from the persistent domain config.
Nov 17 03:20:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75 from the live domain config. {{(pid=74898) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 03:20:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:20:49 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:20:49 user nova-compute[74898]:   <source dev="/dev/sdd"/>
Nov 17 03:20:49 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:20:49 user nova-compute[74898]:   <serial>dea879e4-9b48-4c3c-877a-d907e1c9aaff</serial>
Nov 17 03:20:49 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:20:49 user nova-compute[74898]: </disk>
Nov 17 03:20:49 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:20:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75 {{(pid=74898) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 03:20:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "3b325f5d-481c-410e-910a-f29df36caec2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:20:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "3b325f5d-481c-410e-910a-f29df36caec2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:20:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "3b325f5d-481c-410e-910a-f29df36caec2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:20:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "3b325f5d-481c-410e-910a-f29df36caec2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:20:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "3b325f5d-481c-410e-910a-f29df36caec2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:20:59 user nova-compute[74898]: INFO nova.compute.manager [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Terminating instance
Nov 17 03:20:59 user nova-compute[74898]: DEBUG nova.compute.manager [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:20:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-586b8063-4507-46c0-842d-07526d1ad15b req-fba15e0a-863f-4a93-b29e-0accf52be8c6 service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Received event network-vif-unplugged-cc6303d4-2332-4907-a0b1-7a4bf175282d {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:20:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-586b8063-4507-46c0-842d-07526d1ad15b req-fba15e0a-863f-4a93-b29e-0accf52be8c6 service nova] Acquiring lock "3b325f5d-481c-410e-910a-f29df36caec2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:20:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-586b8063-4507-46c0-842d-07526d1ad15b req-fba15e0a-863f-4a93-b29e-0accf52be8c6 service nova] Lock "3b325f5d-481c-410e-910a-f29df36caec2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:20:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-586b8063-4507-46c0-842d-07526d1ad15b req-fba15e0a-863f-4a93-b29e-0accf52be8c6 service nova] Lock "3b325f5d-481c-410e-910a-f29df36caec2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:20:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-586b8063-4507-46c0-842d-07526d1ad15b req-fba15e0a-863f-4a93-b29e-0accf52be8c6 service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] No waiting events found dispatching network-vif-unplugged-cc6303d4-2332-4907-a0b1-7a4bf175282d {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:20:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-586b8063-4507-46c0-842d-07526d1ad15b req-fba15e0a-863f-4a93-b29e-0accf52be8c6 service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Received event network-vif-unplugged-cc6303d4-2332-4907-a0b1-7a4bf175282d for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:20:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:20:59 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Instance destroyed successfully.
Nov 17 03:20:59 user nova-compute[74898]: DEBUG nova.objects.instance [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lazy-loading 'resources' on Instance uuid 3b325f5d-481c-410e-910a-f29df36caec2 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1434129510',display_name='tempest-ServerActionsTestOtherA-server-1434129510',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1434129510',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGXK5tLG9vQRvq8SJwGRy2Vz7FVpdMueKXoroRQhoaTXP+S/vHTHRNXWHjGdbL7ZfWa7nQ7EpuIvdSjNY8pD+Io25QXwMjrtjgT3+jZPylEXHxX7Pj0OQhFvC17oY0/CA==',key_name='tempest-keypair-1226860529',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:16:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ff82629b7d7486a86574994974fabda',ramdisk_id='',reservation_id='r-kppu8s8d',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-214359699',owner_user_name='tempest-ServerActionsTestOtherA-214359699-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:18:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28445b2b2360414bac2607ec94166369',uuid=3b325f5d-481c-410e-910a-f29df36caec2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "address": "fa:16:3e:75:38:b0", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6303d4-23", "ovs_interfaceid": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Converting VIF {"id": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "address": "fa:16:3e:75:38:b0", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6303d4-23", "ovs_interfaceid": "cc6303d4-2332-4907-a0b1-7a4bf175282d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:38:b0,bridge_name='br-int',has_traffic_filtering=True,id=cc6303d4-2332-4907-a0b1-7a4bf175282d,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc6303d4-23') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG os_vif [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:38:b0,bridge_name='br-int',has_traffic_filtering=True,id=cc6303d4-2332-4907-a0b1-7a4bf175282d,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc6303d4-23') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc6303d4-23, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d19965a8-1874-420d-96a2-3d94d70fe532) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:21:00 user nova-compute[74898]: INFO os_vif [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:38:b0,bridge_name='br-int',has_traffic_filtering=True,id=cc6303d4-2332-4907-a0b1-7a4bf175282d,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc6303d4-23')
Nov 17 03:21:00 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVQaZPJS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:21:00 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:21:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[925b1dad-02ed-4d84-8cf0-93c661bdc304]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:21:00 user nova-compute[74898]: No targets found.
Nov 17 03:21:00 user nova-compute[74898]: iSNS:
Nov 17 03:21:00 user nova-compute[74898]: No targets found.
Nov 17 03:21:00 user nova-compute[74898]: STATIC:
Nov 17 03:21:00 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5
Nov 17 03:21:00 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:21:00 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:21:00 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4
Nov 17 03:21:00 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:21:00 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:21:00 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff
Nov 17 03:21:00 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:21:00 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:21:00 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42
Nov 17 03:21:00 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:21:00 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:21:00 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257
Nov 17 03:21:00 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:21:00 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:21:00 user nova-compute[74898]: FIRMWARE:
Nov 17 03:21:00 user nova-compute[74898]: No targets found.
Nov 17 03:21:00 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:21:00 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:21:00 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c17d447-235b-47aa-b909-745a65688f41]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[199f6b63-fc32-4370-bec5-d6272e6e5dbc]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:21:00 user nova-compute[74898]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:21:00 user nova-compute[74898]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)
Nov 17 03:21:00 user nova-compute[74898]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff (non-flash)
Nov 17 03:21:00 user nova-compute[74898]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 (non-flash)
Nov 17 03:21:00 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:21:00 user nova-compute[74898]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 (non-flash)
Nov 17 03:21:00 user nova-compute[74898]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)
Nov 17 03:21:00 user nova-compute[74898]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff (non-flash)
Nov 17 03:21:00 user nova-compute[74898]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 (non-flash)
Nov 17 03:21:00 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf84cb370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5'): ({'sdb'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Removing single pathed devices sdb {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd91e6a-d52b-4239-96d0-9bfd9179376a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2549743d-762d-4b34-86ec-de68f7807fcc]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Flushing IO for device /dev/sdb {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f293634-9242-471d-8887-4c2be1a7aab1]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d604b8-3157-47f3-9b00-a67739dfff43]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_9a3796a8', '/dev/disk/by-id/scsi-1SCST_BIO9a3796a8-eb044dce1104f04e', '/dev/disk/by-id/scsi-26562303434646365') {{(pid=86021) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ad02d8-1118-4e1e-ba4b-4ea29da8579d]: (4, None) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b617ee22-27d4-4748-a478-d7bad62b8cc3]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c9ddba-1288-47e8-b0b9-95a48a4b680f]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5, portal: 172.16.0.220,3260]
Nov 17 03:21:00 user nova-compute[74898]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5, portal: 172.16.0.220,3260] successful.
Nov 17 03:21:00 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:274f0b23-bf75-4a48-8cb0-462cf98606e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[63404a91-ba06-4058-91bf-077da2047d77]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] <== disconnect_volume: return (346ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:21:00 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Deleting instance files /opt/stack/data/nova/instances/3b325f5d-481c-410e-910a-f29df36caec2_del
Nov 17 03:21:00 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Deletion of /opt/stack/data/nova/instances/3b325f5d-481c-410e-910a-f29df36caec2_del complete
Nov 17 03:21:00 user nova-compute[74898]: INFO nova.compute.manager [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 17 03:21:00 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:21:00 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:21:01 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:21:01 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Took 0.73 seconds to deallocate network for instance.
Nov 17 03:21:01 user nova-compute[74898]: DEBUG nova.compute.manager [req-c16b5bfe-7580-4d66-b930-e122325f4d3f req-3c9e1411-a49a-4cda-a7c6-f62c226c4e53 service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Received event network-vif-deleted-cc6303d4-2332-4907-a0b1-7a4bf175282d {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:21:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:01 user nova-compute[74898]: DEBUG nova.compute.manager [req-24eca42f-fefb-483c-bb48-8d639076ef57 req-ebe8e2c2-8aaf-4810-beb5-8c4fda84f9a5 service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Received event network-vif-plugged-cc6303d4-2332-4907-a0b1-7a4bf175282d {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:21:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-24eca42f-fefb-483c-bb48-8d639076ef57 req-ebe8e2c2-8aaf-4810-beb5-8c4fda84f9a5 service nova] Acquiring lock "3b325f5d-481c-410e-910a-f29df36caec2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:21:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-24eca42f-fefb-483c-bb48-8d639076ef57 req-ebe8e2c2-8aaf-4810-beb5-8c4fda84f9a5 service nova] Lock "3b325f5d-481c-410e-910a-f29df36caec2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:21:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-24eca42f-fefb-483c-bb48-8d639076ef57 req-ebe8e2c2-8aaf-4810-beb5-8c4fda84f9a5 service nova] Lock "3b325f5d-481c-410e-910a-f29df36caec2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:21:01 user nova-compute[74898]: DEBUG nova.compute.manager [req-24eca42f-fefb-483c-bb48-8d639076ef57 req-ebe8e2c2-8aaf-4810-beb5-8c4fda84f9a5 service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] No waiting events found dispatching network-vif-plugged-cc6303d4-2332-4907-a0b1-7a4bf175282d {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:21:01 user nova-compute[74898]: WARNING nova.compute.manager [req-24eca42f-fefb-483c-bb48-8d639076ef57 req-ebe8e2c2-8aaf-4810-beb5-8c4fda84f9a5 service nova] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Received unexpected event network-vif-plugged-cc6303d4-2332-4907-a0b1-7a4bf175282d for instance with vm_state active and task_state deleting.
Nov 17 03:21:01 user nova-compute[74898]: INFO nova.compute.manager [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Took 0.77 seconds to detach 1 volumes for instance.
Nov 17 03:21:01 user nova-compute[74898]: DEBUG nova.compute.manager [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 3b325f5d-481c-410e-910a-f29df36caec2] Deleting volume: 274f0b23-bf75-4a48-8cb0-462cf98606e5 {{(pid=74898) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 17 03:21:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:21:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:21:02 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:21:02 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:21:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:21:02 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Deleted allocations for instance 3b325f5d-481c-410e-910a-f29df36caec2
Nov 17 03:21:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f9cb0369-4e89-44f2-8091-7aea0c73c7b3 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "3b325f5d-481c-410e-910a-f29df36caec2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.203s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:21:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:10 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75 is timed out.
Nov 17 03:21:10 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Successfully detached device vdb from instance 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75 from the live domain config.
Nov 17 03:21:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eVlBLohP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:21:10 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:21:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bf308f-d1e3-4684-8b88-75285fe6b854]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:21:10 user nova-compute[74898]: No targets found.
Nov 17 03:21:10 user nova-compute[74898]: iSNS:
Nov 17 03:21:10 user nova-compute[74898]: No targets found.
Nov 17 03:21:10 user nova-compute[74898]: STATIC:
Nov 17 03:21:10 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4
Nov 17 03:21:10 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:21:10 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:21:10 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff
Nov 17 03:21:10 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:21:10 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:21:10 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42
Nov 17 03:21:10 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:21:10 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:21:10 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257
Nov 17 03:21:10 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:21:10 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:21:10 user nova-compute[74898]: FIRMWARE:
Nov 17 03:21:10 user nova-compute[74898]: No targets found.
Nov 17 03:21:10 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:21:10 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:21:10 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f9c2d6-1a2b-4930-9982-bbc48dc86153]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad7429b-21b5-43cf-b46f-40cf8abcd14b]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:21:10 user nova-compute[74898]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)
Nov 17 03:21:10 user nova-compute[74898]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff (non-flash)
Nov 17 03:21:10 user nova-compute[74898]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 (non-flash)
Nov 17 03:21:10 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:21:10 user nova-compute[74898]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)
Nov 17 03:21:10 user nova-compute[74898]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff (non-flash)
Nov 17 03:21:10 user nova-compute[74898]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 (non-flash)
Nov 17 03:21:10 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf86aca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff'): ({'sdd'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Removing single pathed devices sdd {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a617ff-4cca-4d7c-bf3c-66b84b457de0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78d6d4d-594a-4e97-8ce1-2ce4c8fe8efa]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Flushing IO for device /dev/sdd {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f6b28c-de62-4a65-a535-cd20cb646e56]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f37157a-4d2e-4f9a-9c66-e53fcaed0a6e]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] SCSI volumes sdd have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d83a788-5943-4840-bcba-855e416b1086]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea3703a-0a81-4a21-9b5e-2d045c215266]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff, portal: 172.16.0.220,3260]
Nov 17 03:21:10 user nova-compute[74898]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff, portal: 172.16.0.220,3260] successful.
Nov 17 03:21:10 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea879e4-9b48-4c3c-877a-d907e1c9aaff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ab3665-a558-45f9-9c7b-38e648aac48e]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] <== disconnect_volume: return (306ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:21:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:21:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:11 user nova-compute[74898]: DEBUG nova.objects.instance [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'flavor' on Instance uuid 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:21:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-266a008e-42ad-4c4c-b357-e8699ebe3c7d tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.734s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:21:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:21:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:21:12 user nova-compute[74898]: INFO nova.compute.manager [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Detaching volume 68238c63-dadc-4967-be2d-3322aa95a257
Nov 17 03:21:12 user nova-compute[74898]: INFO nova.virt.block_device [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Attempting to driver detach volume 68238c63-dadc-4967-be2d-3322aa95a257 from mountpoint /dev/vdc
Nov 17 03:21:12 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Attempting to detach device vdc from instance 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75 from the persistent domain config. {{(pid=74898) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 03:21:12 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:21:12 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:21:12 user nova-compute[74898]:   <source dev="/dev/sdf"/>
Nov 17 03:21:12 user nova-compute[74898]:   <target dev="vdc" bus="virtio"/>
Nov 17 03:21:12 user nova-compute[74898]:   <serial>68238c63-dadc-4967-be2d-3322aa95a257</serial>
Nov 17 03:21:12 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 17 03:21:12 user nova-compute[74898]: </disk>
Nov 17 03:21:12 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:21:12 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Successfully detached device vdc from instance 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75 from the persistent domain config.
Nov 17 03:21:12 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75 from the live domain config. {{(pid=74898) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 03:21:12 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:21:12 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:21:12 user nova-compute[74898]:   <source dev="/dev/sdf"/>
Nov 17 03:21:12 user nova-compute[74898]:   <target dev="vdc" bus="virtio"/>
Nov 17 03:21:12 user nova-compute[74898]:   <serial>68238c63-dadc-4967-be2d-3322aa95a257</serial>
Nov 17 03:21:12 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 17 03:21:12 user nova-compute[74898]: </disk>
Nov 17 03:21:12 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:21:13 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75 {{(pid=74898) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 03:21:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:16 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "8e4684b2-7234-4a88-8571-89531c5dfa03" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "8e4684b2-7234-4a88-8571-89531c5dfa03" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG nova.compute.manager [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:21:28 user nova-compute[74898]: INFO nova.compute.claims [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Claim successful on node user
Nov 17 03:21:28 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.337s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG nova.compute.manager [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG nova.compute.manager [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG nova.network.neutron [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:21:28 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:21:28 user nova-compute[74898]: DEBUG nova.compute.manager [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG nova.policy [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa779a5f98394629b6b9fa9d04233e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d36087cc8e842c0bfcae89553fb9841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:21:28 user nova-compute[74898]: INFO nova.virt.block_device [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Booting with volume 8615ac1c-89ad-480d-b5c6-1b1eec7765c9 at /dev/vda
Nov 17 03:21:28 user nova-compute[74898]: DEBUG os_brick.utils [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3782aeb-c602-477a-a078-9649df3dc82f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dd8625-47d6-422d-b7f2-02bd6c8cf624]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63cd0d9-c30e-4983-8e78-d5d3f377de6f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2e7003-ae2d-4274-aaef-20c4da7e04c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:21:28 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:21:28 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4bdf9e-fa08-4e1f-bbad-787b293a5a4a]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG os_brick.utils [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:21:28 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Updating existing volume attachment record: b406a4df-9f71-4d10-b93b-73db39396819 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:21:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:29 user nova-compute[74898]: DEBUG nova.network.neutron [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Successfully created port: c22de465-9b25-416b-bd4a-ff729ce99a18 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:21:29 user nova-compute[74898]: DEBUG nova.network.neutron [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Successfully updated port: c22de465-9b25-416b-bd4a-ff729ce99a18 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:21:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "refresh_cache-8e4684b2-7234-4a88-8571-89531c5dfa03" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:21:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquired lock "refresh_cache-8e4684b2-7234-4a88-8571-89531c5dfa03" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:21:29 user nova-compute[74898]: DEBUG nova.network.neutron [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:21:29 user nova-compute[74898]: DEBUG nova.compute.manager [req-a5ec5183-31b2-45c0-9d7d-c990d4aa62c1 req-7ea4217c-9362-4980-ab40-db22bb93e8fe service nova] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Received event network-changed-c22de465-9b25-416b-bd4a-ff729ce99a18 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:21:29 user nova-compute[74898]: DEBUG nova.compute.manager [req-a5ec5183-31b2-45c0-9d7d-c990d4aa62c1 req-7ea4217c-9362-4980-ab40-db22bb93e8fe service nova] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Refreshing instance network info cache due to event network-changed-c22de465-9b25-416b-bd4a-ff729ce99a18. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:21:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a5ec5183-31b2-45c0-9d7d-c990d4aa62c1 req-7ea4217c-9362-4980-ab40-db22bb93e8fe service nova] Acquiring lock "refresh_cache-8e4684b2-7234-4a88-8571-89531c5dfa03" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:21:29 user nova-compute[74898]: DEBUG nova.network.neutron [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:21:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:30 user nova-compute[74898]: DEBUG nova.network.neutron [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Updating instance_info_cache with network_info: [{"id": "c22de465-9b25-416b-bd4a-ff729ce99a18", "address": "fa:16:3e:f0:01:60", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22de465-9b", "ovs_interfaceid": "c22de465-9b25-416b-bd4a-ff729ce99a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:21:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Releasing lock "refresh_cache-8e4684b2-7234-4a88-8571-89531c5dfa03" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:21:30 user nova-compute[74898]: DEBUG nova.compute.manager [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Instance network_info: |[{"id": "c22de465-9b25-416b-bd4a-ff729ce99a18", "address": "fa:16:3e:f0:01:60", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22de465-9b", "ovs_interfaceid": "c22de465-9b25-416b-bd4a-ff729ce99a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:21:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a5ec5183-31b2-45c0-9d7d-c990d4aa62c1 req-7ea4217c-9362-4980-ab40-db22bb93e8fe service nova] Acquired lock "refresh_cache-8e4684b2-7234-4a88-8571-89531c5dfa03" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:21:30 user nova-compute[74898]: DEBUG nova.network.neutron [req-a5ec5183-31b2-45c0-9d7d-c990d4aa62c1 req-7ea4217c-9362-4980-ab40-db22bb93e8fe service nova] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Refreshing network info cache for port c22de465-9b25-416b-bd4a-ff729ce99a18 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:21:30 user nova-compute[74898]: DEBUG nova.network.neutron [req-a5ec5183-31b2-45c0-9d7d-c990d4aa62c1 req-7ea4217c-9362-4980-ab40-db22bb93e8fe service nova] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Updated VIF entry in instance network info cache for port c22de465-9b25-416b-bd4a-ff729ce99a18. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:21:30 user nova-compute[74898]: DEBUG nova.network.neutron [req-a5ec5183-31b2-45c0-9d7d-c990d4aa62c1 req-7ea4217c-9362-4980-ab40-db22bb93e8fe service nova] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Updating instance_info_cache with network_info: [{"id": "c22de465-9b25-416b-bd4a-ff729ce99a18", "address": "fa:16:3e:f0:01:60", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22de465-9b", "ovs_interfaceid": "c22de465-9b25-416b-bd4a-ff729ce99a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:21:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a5ec5183-31b2-45c0-9d7d-c990d4aa62c1 req-7ea4217c-9362-4980-ab40-db22bb93e8fe service nova] Releasing lock "refresh_cache-8e4684b2-7234-4a88-8571-89531c5dfa03" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:21:30 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:21:31 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:21:32 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:21:32 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:21:33 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75 is timed out.
Nov 17 03:21:33 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Successfully detached device vdc from instance 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75 from the live domain config.
Nov 17 03:21:33 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eZosCwdm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:21:33 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:21:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2db8567-e183-4f55-92e8-6a55b7fdecf2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:21:33 user nova-compute[74898]: No targets found.
Nov 17 03:21:33 user nova-compute[74898]: iSNS:
Nov 17 03:21:33 user nova-compute[74898]: No targets found.
Nov 17 03:21:33 user nova-compute[74898]: STATIC:
Nov 17 03:21:33 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4
Nov 17 03:21:33 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:21:33 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:21:33 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42
Nov 17 03:21:33 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:21:33 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:21:33 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257
Nov 17 03:21:33 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:21:33 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:21:33 user nova-compute[74898]: FIRMWARE:
Nov 17 03:21:33 user nova-compute[74898]: No targets found.
Nov 17 03:21:33 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:21:33 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:21:33 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d556331-edf3-417f-8e3d-b7568e4cd283]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5be095-4758-4e2b-8bdb-7ee4c94ca16f]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:21:33 user nova-compute[74898]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)
Nov 17 03:21:33 user nova-compute[74898]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 (non-flash)
Nov 17 03:21:33 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:21:33 user nova-compute[74898]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)
Nov 17 03:21:33 user nova-compute[74898]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 (non-flash)
Nov 17 03:21:33 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf86c31c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257'): ({'sdf'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Removing single pathed devices sdf {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[17178794-c78d-4a19-ba22-f3ac08f092b6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd2dfe9-5e3b-403f-a41e-9e5b4f206140]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Flushing IO for device /dev/sdf {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cd834c-8f66-4234-8313-3bc466197241]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0321dcd0-7669-4317-9c95-c9ac78fbb399]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] SCSI volumes sdf have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c7c0a3-afc6-4ce7-8183-8a64ba5d0ca3]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49d5d2e-4a13-4318-9b55-2f9e3ecb9b76]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257, portal: 172.16.0.220,3260]
Nov 17 03:21:33 user nova-compute[74898]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257, portal: 172.16.0.220,3260] successful.
Nov 17 03:21:33 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68238c63-dadc-4967-be2d-3322aa95a257 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aad8405-0400-4ad1-bad1-4ccc2d1f7b16]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] <== disconnect_volume: return (299ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:21:33 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG nova.objects.instance [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'flavor' on Instance uuid 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4e2e40b6-09c4-4df1-8bdc-c1c096888497 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.599s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG nova.compute.manager [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:21:34 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Creating image(s)
Nov 17 03:21:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Did not create local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Ensure instance console log exists: /opt/stack/data/nova/instances/8e4684b2-7234-4a88-8571-89531c5dfa03/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Start _get_guest_xml network_info=[{"id": "c22de465-9b25-416b-bd4a-ff729ce99a18", "address": "fa:16:3e:f0:01:60", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22de465-9b", "ovs_interfaceid": "c22de465-9b25-416b-bd4a-ff729ce99a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QZsoXivM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8e4684b2-7234-4a88-8571-89531c5dfa03', 'attached_at': '', 'detached_at': '', 'volume_id': '8615ac1c-89ad-480d-b5c6-1b1eec7765c9', 'serial': '8615ac1c-89ad-480d-b5c6-1b1eec7765c9'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'b406a4df-9f71-4d10-b93b-73db39396819', 'volume_type': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:21:34 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:21:34 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:21:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QZsoXivM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:21:34 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:21:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:21:34 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:21:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:21:34 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[66188a2d-0282-4140-b3dd-8455b96847e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:21:34 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa6c26c-3853-44ba-863b-5ef9c59c5b12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9] added
Nov 17 03:21:34 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5577adb0-2457-4016-acbf-a08bb75138eb]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc68237-3fa7-4d07-a1e3-fed1c2360b79]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QZsoXivM {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QZsoXivM" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b735cd8-b79d-4ef0-a314-229299ea50da]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QZsoXivM'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4451eb-7205-4cae-a01f-e97957838b82]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b37188-7ba3-4f70-b25f-9c8d2bf575ec]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:21:34 user nova-compute[74898]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)
Nov 17 03:21:34 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:21:34 user nova-compute[74898]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)
Nov 17 03:21:34 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[000d8cbd-0ec2-44af-b6a7-01556826c196]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9, portal: 172.16.0.220,3260]
Nov 17 03:21:34 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9, portal: 172.16.0.220,3260] successful.
Nov 17 03:21:34 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[49042758-8c8b-4cd1-9211-f6da55f596b1]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[112ea6d7-682e-463b-8941-ef5f5b550ce5]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:21:34 user nova-compute[74898]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)
Nov 17 03:21:34 user nova-compute[74898]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 (non-flash)
Nov 17 03:21:34 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:21:34 user nova-compute[74898]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)
Nov 17 03:21:34 user nova-compute[74898]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 (non-flash)
Nov 17 03:21:34 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8907cdb-659e-4663-801e-250e84c75295]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QZsoXivM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:21:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90dd082b-900d-49b4-83be-db10c7ab9533/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90dd082b-900d-49b4-83be-db10c7ab9533/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90dd082b-900d-49b4-83be-db10c7ab9533/disk.rescue --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-702a32a1-307c-44a7-bfa8-d049e100d439 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-702a32a1-307c-44a7-bfa8-d049e100d439 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-702a32a1-307c-44a7-bfa8-d049e100d439 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-702a32a1-307c-44a7-bfa8-d049e100d439 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-702a32a1-307c-44a7-bfa8-d049e100d439 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:21:35 user nova-compute[74898]: INFO nova.compute.manager [None req-702a32a1-307c-44a7-bfa8-d049e100d439 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Terminating instance
Nov 17 03:21:35 user nova-compute[74898]: DEBUG nova.compute.manager [None req-702a32a1-307c-44a7-bfa8-d049e100d439 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90dd082b-900d-49b4-83be-db10c7ab9533/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG nova.compute.manager [req-a16d1ca0-3489-4f2b-9643-5ef97a04ca84 req-199ca385-3978-42f2-bcce-d285ade0741b service nova] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Received event network-vif-unplugged-bc143a47-d472-467b-a6a7-59523c7c3f0b {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a16d1ca0-3489-4f2b-9643-5ef97a04ca84 req-199ca385-3978-42f2-bcce-d285ade0741b service nova] Acquiring lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a16d1ca0-3489-4f2b-9643-5ef97a04ca84 req-199ca385-3978-42f2-bcce-d285ade0741b service nova] Lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a16d1ca0-3489-4f2b-9643-5ef97a04ca84 req-199ca385-3978-42f2-bcce-d285ade0741b service nova] Lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG nova.compute.manager [req-a16d1ca0-3489-4f2b-9643-5ef97a04ca84 req-199ca385-3978-42f2-bcce-d285ade0741b service nova] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] No waiting events found dispatching network-vif-unplugged-bc143a47-d472-467b-a6a7-59523c7c3f0b {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG nova.compute.manager [req-a16d1ca0-3489-4f2b-9643-5ef97a04ca84 req-199ca385-3978-42f2-bcce-d285ade0741b service nova] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Received event network-vif-unplugged-bc143a47-d472-467b-a6a7-59523c7c3f0b for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbd19c4-82c5-4c69-a236-1b3fda1e0a75/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26361316433353030', 'path': '/dev/sdb'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361316433353030', 'path': '/dev/sdb'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:21:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1829241204',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1829241204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1829241204',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAl233q3wHnChV0W9PwAfb8a+wLbKkGcMRHcHBfnbAXkdTBDb5aUR1KJFzi+8lgjjf8XFm7uP7VVfgifmAIIeTbf1o/HZAR0MKbTm5hgGGpiwPw0pAMtX5yZin46WyqtZg==',key_name='tempest-keypair-695375565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d36087cc8e842c0bfcae89553fb9841',ramdisk_id='',reservation_id='r-8k7r8kfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1382126375',owner_user_name='tempest-TestVolumeBootPattern-1382126375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:21:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa779a5f98394629b6b9fa9d04233e7a',uuid=8e4684b2-7234-4a88-8571-89531c5dfa03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c22de465-9b25-416b-bd4a-ff729ce99a18", "address": "fa:16:3e:f0:01:60", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22de465-9b", "ovs_interfaceid": "c22de465-9b25-416b-bd4a-ff729ce99a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converting VIF {"id": "c22de465-9b25-416b-bd4a-ff729ce99a18", "address": "fa:16:3e:f0:01:60", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22de465-9b", "ovs_interfaceid": "c22de465-9b25-416b-bd4a-ff729ce99a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:01:60,bridge_name='br-int',has_traffic_filtering=True,id=c22de465-9b25-416b-bd4a-ff729ce99a18,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc22de465-9b') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG nova.objects.instance [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e4684b2-7234-4a88-8571-89531c5dfa03 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:21:35 user nova-compute[74898]:   <uuid>8e4684b2-7234-4a88-8571-89531c5dfa03</uuid>
Nov 17 03:21:35 user nova-compute[74898]:   <name>instance-00000023</name>
Nov 17 03:21:35 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:21:35 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:21:35 user nova-compute[74898]:   <metadata>
Nov 17 03:21:35 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:21:35 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:21:35 user nova-compute[74898]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1829241204</nova:name>
Nov 17 03:21:35 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:21:34</nova:creationTime>
Nov 17 03:21:35 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:21:35 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:21:35 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:21:35 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:21:35 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:21:35 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:21:35 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:21:35 user nova-compute[74898]:       <nova:owner>
Nov 17 03:21:35 user nova-compute[74898]:         <nova:user uuid="aa779a5f98394629b6b9fa9d04233e7a">tempest-TestVolumeBootPattern-1382126375-project-member</nova:user>
Nov 17 03:21:35 user nova-compute[74898]:         <nova:project uuid="5d36087cc8e842c0bfcae89553fb9841">tempest-TestVolumeBootPattern-1382126375</nova:project>
Nov 17 03:21:35 user nova-compute[74898]:       </nova:owner>
Nov 17 03:21:35 user nova-compute[74898]:       <nova:ports>
Nov 17 03:21:35 user nova-compute[74898]:         <nova:port uuid="c22de465-9b25-416b-bd4a-ff729ce99a18">
Nov 17 03:21:35 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 17 03:21:35 user nova-compute[74898]:         </nova:port>
Nov 17 03:21:35 user nova-compute[74898]:       </nova:ports>
Nov 17 03:21:35 user nova-compute[74898]:     </nova:instance>
Nov 17 03:21:35 user nova-compute[74898]:   </metadata>
Nov 17 03:21:35 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:21:35 user nova-compute[74898]:     <system>
Nov 17 03:21:35 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:21:35 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:21:35 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:21:35 user nova-compute[74898]:       <entry name="serial">8e4684b2-7234-4a88-8571-89531c5dfa03</entry>
Nov 17 03:21:35 user nova-compute[74898]:       <entry name="uuid">8e4684b2-7234-4a88-8571-89531c5dfa03</entry>
Nov 17 03:21:35 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:21:35 user nova-compute[74898]:     </system>
Nov 17 03:21:35 user nova-compute[74898]:   </sysinfo>
Nov 17 03:21:35 user nova-compute[74898]:   <os>
Nov 17 03:21:35 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:21:35 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:21:35 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:21:35 user nova-compute[74898]:   </os>
Nov 17 03:21:35 user nova-compute[74898]:   <features>
Nov 17 03:21:35 user nova-compute[74898]:     <acpi/>
Nov 17 03:21:35 user nova-compute[74898]:     <apic/>
Nov 17 03:21:35 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:21:35 user nova-compute[74898]:   </features>
Nov 17 03:21:35 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:21:35 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:21:35 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:21:35 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:21:35 user nova-compute[74898]:   </clock>
Nov 17 03:21:35 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:21:35 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:21:35 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:21:35 user nova-compute[74898]:   </cpu>
Nov 17 03:21:35 user nova-compute[74898]:   <devices>
Nov 17 03:21:35 user nova-compute[74898]:     <disk type="block" device="disk">
Nov 17 03:21:35 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:21:35 user nova-compute[74898]:       <source dev="/dev/sdb"/>
Nov 17 03:21:35 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:21:35 user nova-compute[74898]:       <serial>8615ac1c-89ad-480d-b5c6-1b1eec7765c9</serial>
Nov 17 03:21:35 user nova-compute[74898]:     </disk>
Nov 17 03:21:35 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:21:35 user nova-compute[74898]:       <mac address="fa:16:3e:f0:01:60"/>
Nov 17 03:21:35 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:21:35 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:21:35 user nova-compute[74898]:       <target dev="tapc22de465-9b"/>
Nov 17 03:21:35 user nova-compute[74898]:     </interface>
Nov 17 03:21:35 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:21:35 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/8e4684b2-7234-4a88-8571-89531c5dfa03/console.log" append="off"/>
Nov 17 03:21:35 user nova-compute[74898]:     </serial>
Nov 17 03:21:35 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:21:35 user nova-compute[74898]:     <video>
Nov 17 03:21:35 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:21:35 user nova-compute[74898]:     </video>
Nov 17 03:21:35 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:21:35 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:21:35 user nova-compute[74898]:     </rng>
Nov 17 03:21:35 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:21:35 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:21:35 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:21:35 user nova-compute[74898]:     </memballoon>
Nov 17 03:21:35 user nova-compute[74898]:   </devices>
Nov 17 03:21:35 user nova-compute[74898]: </domain>
Nov 17 03:21:35 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:21:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1829241204',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1829241204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1829241204',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAl233q3wHnChV0W9PwAfb8a+wLbKkGcMRHcHBfnbAXkdTBDb5aUR1KJFzi+8lgjjf8XFm7uP7VVfgifmAIIeTbf1o/HZAR0MKbTm5hgGGpiwPw0pAMtX5yZin46WyqtZg==',key_name='tempest-keypair-695375565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d36087cc8e842c0bfcae89553fb9841',ramdisk_id='',reservation_id='r-8k7r8kfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1382126375',owner_user_name='tempest-TestVolumeBootPattern-1382126375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:21:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa779a5f98394629b6b9fa9d04233e7a',uuid=8e4684b2-7234-4a88-8571-89531c5dfa03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c22de465-9b25-416b-bd4a-ff729ce99a18", "address": "fa:16:3e:f0:01:60", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22de465-9b", "ovs_interfaceid": "c22de465-9b25-416b-bd4a-ff729ce99a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converting VIF {"id": "c22de465-9b25-416b-bd4a-ff729ce99a18", "address": "fa:16:3e:f0:01:60", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22de465-9b", "ovs_interfaceid": "c22de465-9b25-416b-bd4a-ff729ce99a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:01:60,bridge_name='br-int',has_traffic_filtering=True,id=c22de465-9b25-416b-bd4a-ff729ce99a18,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc22de465-9b') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG os_vif [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:01:60,bridge_name='br-int',has_traffic_filtering=True,id=c22de465-9b25-416b-bd4a-ff729ce99a18,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc22de465-9b') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d165e9d-f2af-541f-9ed5-53075fc1ab3c', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc22de465-9b, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc22de465-9b, col_values=(('qos', UUID('d840383e-65f1-4066-823d-0185f0f51319')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc22de465-9b, col_values=(('external_ids', {'iface-id': 'c22de465-9b25-416b-bd4a-ff729ce99a18', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:01:60', 'vm-uuid': '8e4684b2-7234-4a88-8571-89531c5dfa03'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbd19c4-82c5-4c69-a236-1b3fda1e0a75/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbd19c4-82c5-4c69-a236-1b3fda1e0a75/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:21:35 user nova-compute[74898]: INFO os_vif [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:01:60,bridge_name='br-int',has_traffic_filtering=True,id=c22de465-9b25-416b-bd4a-ff729ce99a18,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc22de465-9b')
Nov 17 03:21:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:21:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] No VIF found with MAC fa:16:3e:f0:01:60, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:21:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbd19c4-82c5-4c69-a236-1b3fda1e0a75/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:36 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Instance destroyed successfully.
Nov 17 03:21:36 user nova-compute[74898]: DEBUG nova.objects.instance [None req-702a32a1-307c-44a7-bfa8-d049e100d439 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lazy-loading 'resources' on Instance uuid 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:21:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-702a32a1-307c-44a7-bfa8-d049e100d439 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:18:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-440730337',display_name='tempest-AttachVolumeTestJSON-server-440730337',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-440730337',id=33,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJy0/eL2ms1WVq2yYJ6Ajg5L5vGylcmeEEEGpSFVF9VCRO9fpOBZR/n/zWa2GV3Snqi94ZVaAwK1bKkXfemaEi1iwwXNwl1AD142SFiPmtlMYf9QLErpZF6sCPjAvWZTjg==',key_name='tempest-keypair-1333753592',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:18:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08b13b86a294437da9a38ca4fd9b98e1',ramdisk_id='',reservation_id='r-9945lqvw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1097544794',owner_user_name='tempest-AttachVolumeTestJSON-1097544794-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:18:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f67341bd3d3a47698364dcfc7a7c8a9a',uuid=3fbd19c4-82c5-4c69-a236-1b3fda1e0a75,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc143a47-d472-467b-a6a7-59523c7c3f0b", "address": "fa:16:3e:e3:34:2a", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc143a47-d4", "ovs_interfaceid": "bc143a47-d472-467b-a6a7-59523c7c3f0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:21:36 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-702a32a1-307c-44a7-bfa8-d049e100d439 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Converting VIF {"id": "bc143a47-d472-467b-a6a7-59523c7c3f0b", "address": "fa:16:3e:e3:34:2a", "network": {"id": "b4bcd1f2-7a46-421a-8979-8ba9aca50ec2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2078678441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b13b86a294437da9a38ca4fd9b98e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc143a47-d4", "ovs_interfaceid": "bc143a47-d472-467b-a6a7-59523c7c3f0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:21:36 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-702a32a1-307c-44a7-bfa8-d049e100d439 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:34:2a,bridge_name='br-int',has_traffic_filtering=True,id=bc143a47-d472-467b-a6a7-59523c7c3f0b,network=Network(b4bcd1f2-7a46-421a-8979-8ba9aca50ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc143a47-d4') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:21:36 user nova-compute[74898]: DEBUG os_vif [None req-702a32a1-307c-44a7-bfa8-d049e100d439 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:34:2a,bridge_name='br-int',has_traffic_filtering=True,id=bc143a47-d472-467b-a6a7-59523c7c3f0b,network=Network(b4bcd1f2-7a46-421a-8979-8ba9aca50ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc143a47-d4') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:21:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc143a47-d4, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:21:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:21:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e860469-1afc-4cfc-aa6f-012c67f86527) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:21:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:21:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:36 user nova-compute[74898]: INFO os_vif [None req-702a32a1-307c-44a7-bfa8-d049e100d439 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:34:2a,bridge_name='br-int',has_traffic_filtering=True,id=bc143a47-d472-467b-a6a7-59523c7c3f0b,network=Network(b4bcd1f2-7a46-421a-8979-8ba9aca50ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc143a47-d4')
Nov 17 03:21:36 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-702a32a1-307c-44a7-bfa8-d049e100d439 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Deleting instance files /opt/stack/data/nova/instances/3fbd19c4-82c5-4c69-a236-1b3fda1e0a75_del
Nov 17 03:21:36 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-702a32a1-307c-44a7-bfa8-d049e100d439 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Deletion of /opt/stack/data/nova/instances/3fbd19c4-82c5-4c69-a236-1b3fda1e0a75_del complete
Nov 17 03:21:36 user nova-compute[74898]: INFO nova.compute.manager [None req-702a32a1-307c-44a7-bfa8-d049e100d439 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Took 1.39 seconds to destroy the instance on the hypervisor.
Nov 17 03:21:36 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-702a32a1-307c-44a7-bfa8-d049e100d439 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:21:36 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:21:36 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:21:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:21:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:21:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:21:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-14331061-5fe4-4637-afb1-ab3859f88210 req-b57091a6-c86c-40c0-a12a-b60dfe8f2858 service nova] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Received event network-vif-plugged-bc143a47-d472-467b-a6a7-59523c7c3f0b {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:21:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-14331061-5fe4-4637-afb1-ab3859f88210 req-b57091a6-c86c-40c0-a12a-b60dfe8f2858 service nova] Acquiring lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:21:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-14331061-5fe4-4637-afb1-ab3859f88210 req-b57091a6-c86c-40c0-a12a-b60dfe8f2858 service nova] Lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:21:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-14331061-5fe4-4637-afb1-ab3859f88210 req-b57091a6-c86c-40c0-a12a-b60dfe8f2858 service nova] Lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:21:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-14331061-5fe4-4637-afb1-ab3859f88210 req-b57091a6-c86c-40c0-a12a-b60dfe8f2858 service nova] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] No waiting events found dispatching network-vif-plugged-bc143a47-d472-467b-a6a7-59523c7c3f0b {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:21:39 user nova-compute[74898]: WARNING nova.compute.manager [req-14331061-5fe4-4637-afb1-ab3859f88210 req-b57091a6-c86c-40c0-a12a-b60dfe8f2858 service nova] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Received unexpected event network-vif-plugged-bc143a47-d472-467b-a6a7-59523c7c3f0b for instance with vm_state active and task_state deleting.
Nov 17 03:21:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-5adb0e2b-9c8b-4617-a16f-0dcfd1cd1592 req-6f5c397a-6486-467e-8ae7-41387a92df9c service nova] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Received event network-vif-deleted-bc143a47-d472-467b-a6a7-59523c7c3f0b {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:21:39 user nova-compute[74898]: INFO nova.compute.manager [req-5adb0e2b-9c8b-4617-a16f-0dcfd1cd1592 req-6f5c397a-6486-467e-8ae7-41387a92df9c service nova] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Neutron deleted interface bc143a47-d472-467b-a6a7-59523c7c3f0b; detaching it from the instance and deleting it from the info cache
Nov 17 03:21:39 user nova-compute[74898]: DEBUG nova.network.neutron [req-5adb0e2b-9c8b-4617-a16f-0dcfd1cd1592 req-6f5c397a-6486-467e-8ae7-41387a92df9c service nova] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:21:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-76686813-6a90-4f1f-a4e1-1dafd712863a req-485c6a80-ccfe-4ac4-86a1-31205bfa9e1c service nova] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Received event network-vif-plugged-c22de465-9b25-416b-bd4a-ff729ce99a18 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:21:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-76686813-6a90-4f1f-a4e1-1dafd712863a req-485c6a80-ccfe-4ac4-86a1-31205bfa9e1c service nova] Acquiring lock "8e4684b2-7234-4a88-8571-89531c5dfa03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:21:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-76686813-6a90-4f1f-a4e1-1dafd712863a req-485c6a80-ccfe-4ac4-86a1-31205bfa9e1c service nova] Lock "8e4684b2-7234-4a88-8571-89531c5dfa03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:21:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-76686813-6a90-4f1f-a4e1-1dafd712863a req-485c6a80-ccfe-4ac4-86a1-31205bfa9e1c service nova] Lock "8e4684b2-7234-4a88-8571-89531c5dfa03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:21:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-76686813-6a90-4f1f-a4e1-1dafd712863a req-485c6a80-ccfe-4ac4-86a1-31205bfa9e1c service nova] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] No waiting events found dispatching network-vif-plugged-c22de465-9b25-416b-bd4a-ff729ce99a18 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:21:39 user nova-compute[74898]: WARNING nova.compute.manager [req-76686813-6a90-4f1f-a4e1-1dafd712863a req-485c6a80-ccfe-4ac4-86a1-31205bfa9e1c service nova] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Received unexpected event network-vif-plugged-c22de465-9b25-416b-bd4a-ff729ce99a18 for instance with vm_state building and task_state spawning.
Nov 17 03:21:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-9d43f881-123d-46f9-bf85-31068fc7874e req-b39c2a6f-af65-4cab-bebc-ac593f4b1d65 service nova] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Received event network-vif-plugged-c22de465-9b25-416b-bd4a-ff729ce99a18 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:21:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9d43f881-123d-46f9-bf85-31068fc7874e req-b39c2a6f-af65-4cab-bebc-ac593f4b1d65 service nova] Acquiring lock "8e4684b2-7234-4a88-8571-89531c5dfa03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:21:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9d43f881-123d-46f9-bf85-31068fc7874e req-b39c2a6f-af65-4cab-bebc-ac593f4b1d65 service nova] Lock "8e4684b2-7234-4a88-8571-89531c5dfa03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:21:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9d43f881-123d-46f9-bf85-31068fc7874e req-b39c2a6f-af65-4cab-bebc-ac593f4b1d65 service nova] Lock "8e4684b2-7234-4a88-8571-89531c5dfa03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:21:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-9d43f881-123d-46f9-bf85-31068fc7874e req-b39c2a6f-af65-4cab-bebc-ac593f4b1d65 service nova] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] No waiting events found dispatching network-vif-plugged-c22de465-9b25-416b-bd4a-ff729ce99a18 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:21:39 user nova-compute[74898]: WARNING nova.compute.manager [req-9d43f881-123d-46f9-bf85-31068fc7874e req-b39c2a6f-af65-4cab-bebc-ac593f4b1d65 service nova] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Received unexpected event network-vif-plugged-c22de465-9b25-416b-bd4a-ff729ce99a18 for instance with vm_state building and task_state spawning.
Nov 17 03:21:39 user nova-compute[74898]: DEBUG nova.compute.manager [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:21:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:21:39 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:21:40 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:21:40 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:21:40 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=8488MB free_disk=25.102981567382812GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:21:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:21:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:21:40 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Instance spawned successfully.
Nov 17 03:21:40 user nova-compute[74898]: DEBUG nova.compute.manager [req-5adb0e2b-9c8b-4617-a16f-0dcfd1cd1592 req-6f5c397a-6486-467e-8ae7-41387a92df9c service nova] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Detach interface failed, port_id=bc143a47-d472-467b-a6a7-59523c7c3f0b, reason: Instance 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75 could not be found. {{(pid=74898) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 03:21:40 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75] Took 3.30 seconds to deallocate network for instance.
Nov 17 03:21:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:21:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:21:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:21:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:21:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:21:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:21:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:21:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-702a32a1-307c-44a7-bfa8-d049e100d439 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:21:40 user nova-compute[74898]: INFO nova.compute.manager [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Took 5.66 seconds to spawn the instance on the hypervisor.
Nov 17 03:21:40 user nova-compute[74898]: DEBUG nova.compute.manager [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:21:40 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 42994e39-187a-4fb6-a293-24a4eb57177b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:21:40 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 13449e5c-809b-4db2-af0b-53f5865eb3a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:21:40 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 24cd7ac4-3724-4189-82a7-ba61ba46097a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:21:40 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 6eee4731-60ed-41ab-905e-395aa4d5e568 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:21:40 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:21:40 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 90dd082b-900d-49b4-83be-db10c7ab9533 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:21:40 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 8e4684b2-7234-4a88-8571-89531c5dfa03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:21:40 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:21:40 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:21:40 user nova-compute[74898]: INFO nova.compute.manager [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Took 12.09 seconds to build instance.
Nov 17 03:21:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2e81ef47-937f-4b95-93b6-a552814fc0a2 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "8e4684b2-7234-4a88-8571-89531c5dfa03" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.186s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:21:40 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:21:40 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:21:40 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:21:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.408s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:21:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-702a32a1-307c-44a7-bfa8-d049e100d439 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.340s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:21:40 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-702a32a1-307c-44a7-bfa8-d049e100d439 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:21:40 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-702a32a1-307c-44a7-bfa8-d049e100d439 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:21:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-702a32a1-307c-44a7-bfa8-d049e100d439 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.302s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:21:40 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-702a32a1-307c-44a7-bfa8-d049e100d439 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Deleted allocations for instance 3fbd19c4-82c5-4c69-a236-1b3fda1e0a75
Nov 17 03:21:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-702a32a1-307c-44a7-bfa8-d049e100d439 tempest-AttachVolumeTestJSON-1097544794 tempest-AttachVolumeTestJSON-1097544794-project-member] Lock "3fbd19c4-82c5-4c69-a236-1b3fda1e0a75" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.527s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:21:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:41 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:21:41 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:21:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-13449e5c-809b-4db2-af0b-53f5865eb3a4" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:21:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-13449e5c-809b-4db2-af0b-53f5865eb3a4" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:21:41 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:21:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:42 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Updating instance_info_cache with network_info: [{"id": "2bdfdbe2-b457-4078-b4be-979a51ba442a", "address": "fa:16:3e:a1:96:f0", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdfdbe2-b4", "ovs_interfaceid": "2bdfdbe2-b457-4078-b4be-979a51ba442a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:21:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-13449e5c-809b-4db2-af0b-53f5865eb3a4" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:21:42 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:21:42 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:21:42 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:21:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:21:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:21:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:21:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:21:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:21:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:21:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6c543ff4-60b4-4f6a-819a-525ae1d7e461 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "42994e39-187a-4fb6-a293-24a4eb57177b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:21:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6c543ff4-60b4-4f6a-819a-525ae1d7e461 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "42994e39-187a-4fb6-a293-24a4eb57177b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:21:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6c543ff4-60b4-4f6a-819a-525ae1d7e461 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "42994e39-187a-4fb6-a293-24a4eb57177b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:21:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6c543ff4-60b4-4f6a-819a-525ae1d7e461 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "42994e39-187a-4fb6-a293-24a4eb57177b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:21:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6c543ff4-60b4-4f6a-819a-525ae1d7e461 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "42994e39-187a-4fb6-a293-24a4eb57177b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:21:51 user nova-compute[74898]: INFO nova.compute.manager [None req-6c543ff4-60b4-4f6a-819a-525ae1d7e461 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Terminating instance
Nov 17 03:21:51 user nova-compute[74898]: DEBUG nova.compute.manager [None req-6c543ff4-60b4-4f6a-819a-525ae1d7e461 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:21:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:52 user nova-compute[74898]: DEBUG nova.compute.manager [req-8644eee3-cba6-4ef2-96bf-8d7f8b1aa705 req-02a350f5-a8c9-40ff-b43a-4c771cd76ded service nova] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Received event network-vif-unplugged-92a5885a-8cb1-43f8-906a-97d7fa08eb62 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:21:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8644eee3-cba6-4ef2-96bf-8d7f8b1aa705 req-02a350f5-a8c9-40ff-b43a-4c771cd76ded service nova] Acquiring lock "42994e39-187a-4fb6-a293-24a4eb57177b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:21:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8644eee3-cba6-4ef2-96bf-8d7f8b1aa705 req-02a350f5-a8c9-40ff-b43a-4c771cd76ded service nova] Lock "42994e39-187a-4fb6-a293-24a4eb57177b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:21:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8644eee3-cba6-4ef2-96bf-8d7f8b1aa705 req-02a350f5-a8c9-40ff-b43a-4c771cd76ded service nova] Lock "42994e39-187a-4fb6-a293-24a4eb57177b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:21:52 user nova-compute[74898]: DEBUG nova.compute.manager [req-8644eee3-cba6-4ef2-96bf-8d7f8b1aa705 req-02a350f5-a8c9-40ff-b43a-4c771cd76ded service nova] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] No waiting events found dispatching network-vif-unplugged-92a5885a-8cb1-43f8-906a-97d7fa08eb62 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:21:52 user nova-compute[74898]: DEBUG nova.compute.manager [req-8644eee3-cba6-4ef2-96bf-8d7f8b1aa705 req-02a350f5-a8c9-40ff-b43a-4c771cd76ded service nova] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Received event network-vif-unplugged-92a5885a-8cb1-43f8-906a-97d7fa08eb62 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:21:52 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Instance destroyed successfully.
Nov 17 03:21:52 user nova-compute[74898]: DEBUG nova.objects.instance [None req-6c543ff4-60b4-4f6a-819a-525ae1d7e461 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lazy-loading 'resources' on Instance uuid 42994e39-187a-4fb6-a293-24a4eb57177b {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:21:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-6c543ff4-60b4-4f6a-819a-525ae1d7e461 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:03:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1688090851',display_name='tempest-ServerActionsTestOtherA-server-1688090851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1688090851',id=16,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGXK5tLG9vQRvq8SJwGRy2Vz7FVpdMueKXoroRQhoaTXP+S/vHTHRNXWHjGdbL7ZfWa7nQ7EpuIvdSjNY8pD+Io25QXwMjrtjgT3+jZPylEXHxX7Pj0OQhFvC17oY0/CA==',key_name='tempest-keypair-1226860529',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:03:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ff82629b7d7486a86574994974fabda',ramdisk_id='',reservation_id='r-dvxy70tq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-214359699',owner_user_name='tempest-ServerActionsTestOtherA-214359699-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:03:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28445b2b2360414bac2607ec94166369',uuid=42994e39-187a-4fb6-a293-24a4eb57177b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92a5885a-8cb1-43f8-906a-97d7fa08eb62", "address": "fa:16:3e:ab:28:fe", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a5885a-8c", "ovs_interfaceid": "92a5885a-8cb1-43f8-906a-97d7fa08eb62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:21:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6c543ff4-60b4-4f6a-819a-525ae1d7e461 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Converting VIF {"id": "92a5885a-8cb1-43f8-906a-97d7fa08eb62", "address": "fa:16:3e:ab:28:fe", "network": {"id": "1482128a-723a-43c4-9c33-674ce03acc89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-216048622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ff82629b7d7486a86574994974fabda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a5885a-8c", "ovs_interfaceid": "92a5885a-8cb1-43f8-906a-97d7fa08eb62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:21:52 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6c543ff4-60b4-4f6a-819a-525ae1d7e461 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:28:fe,bridge_name='br-int',has_traffic_filtering=True,id=92a5885a-8cb1-43f8-906a-97d7fa08eb62,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92a5885a-8c') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:21:52 user nova-compute[74898]: DEBUG os_vif [None req-6c543ff4-60b4-4f6a-819a-525ae1d7e461 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:28:fe,bridge_name='br-int',has_traffic_filtering=True,id=92a5885a-8cb1-43f8-906a-97d7fa08eb62,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92a5885a-8c') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:21:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92a5885a-8c, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:21:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:21:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f69eea3-1e39-4924-87a1-15447e9a9a71) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:21:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:52 user nova-compute[74898]: INFO os_vif [None req-6c543ff4-60b4-4f6a-819a-525ae1d7e461 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:28:fe,bridge_name='br-int',has_traffic_filtering=True,id=92a5885a-8cb1-43f8-906a-97d7fa08eb62,network=Network(1482128a-723a-43c4-9c33-674ce03acc89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92a5885a-8c')
Nov 17 03:21:52 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-6c543ff4-60b4-4f6a-819a-525ae1d7e461 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Deleting instance files /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b_del
Nov 17 03:21:52 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-6c543ff4-60b4-4f6a-819a-525ae1d7e461 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Deletion of /opt/stack/data/nova/instances/42994e39-187a-4fb6-a293-24a4eb57177b_del complete
Nov 17 03:21:52 user nova-compute[74898]: INFO nova.compute.manager [None req-6c543ff4-60b4-4f6a-819a-525ae1d7e461 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 17 03:21:52 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-6c543ff4-60b4-4f6a-819a-525ae1d7e461 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:21:52 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:21:52 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:21:53 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:21:53 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Took 0.83 seconds to deallocate network for instance.
Nov 17 03:21:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6c543ff4-60b4-4f6a-819a-525ae1d7e461 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:21:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6c543ff4-60b4-4f6a-819a-525ae1d7e461 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:21:53 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-6c543ff4-60b4-4f6a-819a-525ae1d7e461 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:21:53 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-6c543ff4-60b4-4f6a-819a-525ae1d7e461 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:21:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6c543ff4-60b4-4f6a-819a-525ae1d7e461 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:21:53 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-6c543ff4-60b4-4f6a-819a-525ae1d7e461 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Deleted allocations for instance 42994e39-187a-4fb6-a293-24a4eb57177b
Nov 17 03:21:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6c543ff4-60b4-4f6a-819a-525ae1d7e461 tempest-ServerActionsTestOtherA-214359699 tempest-ServerActionsTestOtherA-214359699-project-member] Lock "42994e39-187a-4fb6-a293-24a4eb57177b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.104s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:21:54 user nova-compute[74898]: DEBUG nova.compute.manager [req-47a81429-28fa-421c-a6e4-e4b2ebecb479 req-bf51e6a5-5659-4484-a18b-1b18f9073192 service nova] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Received event network-vif-plugged-92a5885a-8cb1-43f8-906a-97d7fa08eb62 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:21:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-47a81429-28fa-421c-a6e4-e4b2ebecb479 req-bf51e6a5-5659-4484-a18b-1b18f9073192 service nova] Acquiring lock "42994e39-187a-4fb6-a293-24a4eb57177b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:21:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-47a81429-28fa-421c-a6e4-e4b2ebecb479 req-bf51e6a5-5659-4484-a18b-1b18f9073192 service nova] Lock "42994e39-187a-4fb6-a293-24a4eb57177b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:21:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-47a81429-28fa-421c-a6e4-e4b2ebecb479 req-bf51e6a5-5659-4484-a18b-1b18f9073192 service nova] Lock "42994e39-187a-4fb6-a293-24a4eb57177b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:21:54 user nova-compute[74898]: DEBUG nova.compute.manager [req-47a81429-28fa-421c-a6e4-e4b2ebecb479 req-bf51e6a5-5659-4484-a18b-1b18f9073192 service nova] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] No waiting events found dispatching network-vif-plugged-92a5885a-8cb1-43f8-906a-97d7fa08eb62 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:21:54 user nova-compute[74898]: WARNING nova.compute.manager [req-47a81429-28fa-421c-a6e4-e4b2ebecb479 req-bf51e6a5-5659-4484-a18b-1b18f9073192 service nova] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Received unexpected event network-vif-plugged-92a5885a-8cb1-43f8-906a-97d7fa08eb62 for instance with vm_state deleted and task_state None.
Nov 17 03:21:54 user nova-compute[74898]: DEBUG nova.compute.manager [req-47a81429-28fa-421c-a6e4-e4b2ebecb479 req-bf51e6a5-5659-4484-a18b-1b18f9073192 service nova] [instance: 42994e39-187a-4fb6-a293-24a4eb57177b] Received event network-vif-deleted-92a5885a-8cb1-43f8-906a-97d7fa08eb62 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:21:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:21:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:22:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:22:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:22:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:22:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:22:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:27 user nova-compute[74898]: INFO nova.compute.manager [None req-5d4f83ea-3c22-4d17-b27c-714b80c014a8 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Unrescuing
Nov 17 03:22:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-5d4f83ea-3c22-4d17-b27c-714b80c014a8 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "refresh_cache-90dd082b-900d-49b4-83be-db10c7ab9533" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:22:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-5d4f83ea-3c22-4d17-b27c-714b80c014a8 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquired lock "refresh_cache-90dd082b-900d-49b4-83be-db10c7ab9533" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:22:27 user nova-compute[74898]: DEBUG nova.network.neutron [None req-5d4f83ea-3c22-4d17-b27c-714b80c014a8 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:22:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:27 user nova-compute[74898]: DEBUG nova.network.neutron [None req-5d4f83ea-3c22-4d17-b27c-714b80c014a8 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Updating instance_info_cache with network_info: [{"id": "014195e4-69ec-44a5-bdbf-17a716389fa8", "address": "fa:16:3e:23:b7:2d", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014195e4-69", "ovs_interfaceid": "014195e4-69ec-44a5-bdbf-17a716389fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:22:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-5d4f83ea-3c22-4d17-b27c-714b80c014a8 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Releasing lock "refresh_cache-90dd082b-900d-49b4-83be-db10c7ab9533" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:22:27 user nova-compute[74898]: DEBUG nova.objects.instance [None req-5d4f83ea-3c22-4d17-b27c-714b80c014a8 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lazy-loading 'flavor' on Instance uuid 90dd082b-900d-49b4-83be-db10c7ab9533 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:22:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:28 user nova-compute[74898]: DEBUG nova.compute.manager [req-551c7bc4-0fd8-49ed-8bd6-800e7a0a1881 req-64ccbc13-6da1-42e7-b832-f39fd8a5c678 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Received event network-vif-unplugged-014195e4-69ec-44a5-bdbf-17a716389fa8 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:22:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-551c7bc4-0fd8-49ed-8bd6-800e7a0a1881 req-64ccbc13-6da1-42e7-b832-f39fd8a5c678 service nova] Acquiring lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:22:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-551c7bc4-0fd8-49ed-8bd6-800e7a0a1881 req-64ccbc13-6da1-42e7-b832-f39fd8a5c678 service nova] Lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:22:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-551c7bc4-0fd8-49ed-8bd6-800e7a0a1881 req-64ccbc13-6da1-42e7-b832-f39fd8a5c678 service nova] Lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:22:28 user nova-compute[74898]: DEBUG nova.compute.manager [req-551c7bc4-0fd8-49ed-8bd6-800e7a0a1881 req-64ccbc13-6da1-42e7-b832-f39fd8a5c678 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] No waiting events found dispatching network-vif-unplugged-014195e4-69ec-44a5-bdbf-17a716389fa8 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:22:28 user nova-compute[74898]: WARNING nova.compute.manager [req-551c7bc4-0fd8-49ed-8bd6-800e7a0a1881 req-64ccbc13-6da1-42e7-b832-f39fd8a5c678 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Received unexpected event network-vif-unplugged-014195e4-69ec-44a5-bdbf-17a716389fa8 for instance with vm_state rescued and task_state unrescuing.
Nov 17 03:22:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:28 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Instance destroyed successfully.
Nov 17 03:22:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:30 user nova-compute[74898]: DEBUG nova.compute.manager [req-3f2a292b-4244-4ac0-8600-ef8aec3ebb5f req-71d25997-8eb3-4e8a-ad9c-9dd85ad66495 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Received event network-vif-plugged-014195e4-69ec-44a5-bdbf-17a716389fa8 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:22:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3f2a292b-4244-4ac0-8600-ef8aec3ebb5f req-71d25997-8eb3-4e8a-ad9c-9dd85ad66495 service nova] Acquiring lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:22:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3f2a292b-4244-4ac0-8600-ef8aec3ebb5f req-71d25997-8eb3-4e8a-ad9c-9dd85ad66495 service nova] Lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:22:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3f2a292b-4244-4ac0-8600-ef8aec3ebb5f req-71d25997-8eb3-4e8a-ad9c-9dd85ad66495 service nova] Lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:22:30 user nova-compute[74898]: DEBUG nova.compute.manager [req-3f2a292b-4244-4ac0-8600-ef8aec3ebb5f req-71d25997-8eb3-4e8a-ad9c-9dd85ad66495 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] No waiting events found dispatching network-vif-plugged-014195e4-69ec-44a5-bdbf-17a716389fa8 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:22:30 user nova-compute[74898]: WARNING nova.compute.manager [req-3f2a292b-4244-4ac0-8600-ef8aec3ebb5f req-71d25997-8eb3-4e8a-ad9c-9dd85ad66495 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Received unexpected event network-vif-plugged-014195e4-69ec-44a5-bdbf-17a716389fa8 for instance with vm_state rescued and task_state unrescuing.
Nov 17 03:22:30 user nova-compute[74898]: DEBUG nova.compute.manager [req-3f2a292b-4244-4ac0-8600-ef8aec3ebb5f req-71d25997-8eb3-4e8a-ad9c-9dd85ad66495 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Received event network-vif-plugged-014195e4-69ec-44a5-bdbf-17a716389fa8 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:22:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3f2a292b-4244-4ac0-8600-ef8aec3ebb5f req-71d25997-8eb3-4e8a-ad9c-9dd85ad66495 service nova] Acquiring lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:22:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3f2a292b-4244-4ac0-8600-ef8aec3ebb5f req-71d25997-8eb3-4e8a-ad9c-9dd85ad66495 service nova] Lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:22:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3f2a292b-4244-4ac0-8600-ef8aec3ebb5f req-71d25997-8eb3-4e8a-ad9c-9dd85ad66495 service nova] Lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:22:30 user nova-compute[74898]: DEBUG nova.compute.manager [req-3f2a292b-4244-4ac0-8600-ef8aec3ebb5f req-71d25997-8eb3-4e8a-ad9c-9dd85ad66495 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] No waiting events found dispatching network-vif-plugged-014195e4-69ec-44a5-bdbf-17a716389fa8 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:22:30 user nova-compute[74898]: WARNING nova.compute.manager [req-3f2a292b-4244-4ac0-8600-ef8aec3ebb5f req-71d25997-8eb3-4e8a-ad9c-9dd85ad66495 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Received unexpected event network-vif-plugged-014195e4-69ec-44a5-bdbf-17a716389fa8 for instance with vm_state rescued and task_state unrescuing.
Nov 17 03:22:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:30 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:22:30 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:22:30 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:22:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:32 user nova-compute[74898]: DEBUG nova.compute.manager [req-d13b9a36-f5fe-4515-81e7-73f7c9551529 req-5ff68d8d-5502-4768-856c-8d93ab1e9f0c service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Received event network-vif-plugged-014195e4-69ec-44a5-bdbf-17a716389fa8 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:22:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d13b9a36-f5fe-4515-81e7-73f7c9551529 req-5ff68d8d-5502-4768-856c-8d93ab1e9f0c service nova] Acquiring lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:22:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d13b9a36-f5fe-4515-81e7-73f7c9551529 req-5ff68d8d-5502-4768-856c-8d93ab1e9f0c service nova] Lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:22:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d13b9a36-f5fe-4515-81e7-73f7c9551529 req-5ff68d8d-5502-4768-856c-8d93ab1e9f0c service nova] Lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:22:32 user nova-compute[74898]: DEBUG nova.compute.manager [req-d13b9a36-f5fe-4515-81e7-73f7c9551529 req-5ff68d8d-5502-4768-856c-8d93ab1e9f0c service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] No waiting events found dispatching network-vif-plugged-014195e4-69ec-44a5-bdbf-17a716389fa8 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:22:32 user nova-compute[74898]: WARNING nova.compute.manager [req-d13b9a36-f5fe-4515-81e7-73f7c9551529 req-5ff68d8d-5502-4768-856c-8d93ab1e9f0c service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Received unexpected event network-vif-plugged-014195e4-69ec-44a5-bdbf-17a716389fa8 for instance with vm_state rescued and task_state unrescuing.
Nov 17 03:22:32 user nova-compute[74898]: DEBUG nova.compute.manager [None req-5d4f83ea-3c22-4d17-b27c-714b80c014a8 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:22:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:33 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:22:33 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:22:34 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:22:35 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:22:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:36 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:22:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:22:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:22:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:22:36 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:22:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:22:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:22:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:22:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:22:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:22:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:22:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:22:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:22:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:22:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:22:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:22:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:38 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:22:38 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:22:38 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=8566MB free_disk=25.157329559326172GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:22:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:22:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:22:38 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 13449e5c-809b-4db2-af0b-53f5865eb3a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:22:38 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 24cd7ac4-3724-4189-82a7-ba61ba46097a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:22:38 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 6eee4731-60ed-41ab-905e-395aa4d5e568 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:22:38 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 90dd082b-900d-49b4-83be-db10c7ab9533 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:22:38 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 8e4684b2-7234-4a88-8571-89531c5dfa03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:22:38 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:22:38 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:22:38 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:22:38 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:22:38 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:22:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.304s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:22:39 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:22:39 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:22:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-24cd7ac4-3724-4189-82a7-ba61ba46097a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:22:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-24cd7ac4-3724-4189-82a7-ba61ba46097a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:22:39 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:22:39 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Updating instance_info_cache with network_info: [{"id": "b7880813-a5fe-4eb7-b6aa-f91832114171", "address": "fa:16:3e:da:6b:da", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7880813-a5", "ovs_interfaceid": "b7880813-a5fe-4eb7-b6aa-f91832114171", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:22:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-24cd7ac4-3724-4189-82a7-ba61ba46097a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:22:40 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:22:40 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:22:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:22:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:22:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:22:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:22:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:22:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:22:55 user nova-compute[74898]: DEBUG nova.compute.manager [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:22:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:22:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:22:56 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:22:56 user nova-compute[74898]: INFO nova.compute.claims [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Claim successful on node user
Nov 17 03:22:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:56 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:22:56 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:22:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:22:56 user nova-compute[74898]: DEBUG nova.compute.manager [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:22:56 user nova-compute[74898]: DEBUG nova.compute.manager [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:22:56 user nova-compute[74898]: DEBUG nova.network.neutron [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:22:56 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:22:56 user nova-compute[74898]: DEBUG nova.compute.manager [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:22:56 user nova-compute[74898]: DEBUG nova.policy [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7660b84c605b4a459065b10fda42043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498d9d0f6667441791a7175256e4c557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:22:56 user nova-compute[74898]: DEBUG nova.compute.manager [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:22:56 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:22:56 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Creating image(s)
Nov 17 03:22:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "/opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:22:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "/opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:22:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "/opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:22:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:22:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.179s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:22:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:22:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:22:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:22:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:22:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:22:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/disk 1073741824" returned: 0 in 0.053s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:22:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:22:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:22:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.185s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:22:57 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Checking if we can resize image /opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:22:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:22:57 user nova-compute[74898]: DEBUG nova.network.neutron [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Successfully created port: 207dd9ce-91f5-4dcf-b77f-18501d94908c {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:22:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:22:57 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Cannot resize image /opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:22:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:22:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Ensure instance console log exists: /opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:22:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:22:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:22:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:22:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.network.neutron [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Successfully updated port: 207dd9ce-91f5-4dcf-b77f-18501d94908c {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "refresh_cache-151bb1e2-b109-4f9c-a85c-bfed05bec7dd" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquired lock "refresh_cache-151bb1e2-b109-4f9c-a85c-bfed05bec7dd" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.network.neutron [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.compute.manager [req-3cb8e6d4-3f10-4cb4-9d28-daa3eb3e38ac req-cfb51933-bc9b-4b41-99c0-58bf9e532cf5 service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Received event network-changed-207dd9ce-91f5-4dcf-b77f-18501d94908c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.compute.manager [req-3cb8e6d4-3f10-4cb4-9d28-daa3eb3e38ac req-cfb51933-bc9b-4b41-99c0-58bf9e532cf5 service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Refreshing instance network info cache due to event network-changed-207dd9ce-91f5-4dcf-b77f-18501d94908c. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3cb8e6d4-3f10-4cb4-9d28-daa3eb3e38ac req-cfb51933-bc9b-4b41-99c0-58bf9e532cf5 service nova] Acquiring lock "refresh_cache-151bb1e2-b109-4f9c-a85c-bfed05bec7dd" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.network.neutron [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.network.neutron [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Updating instance_info_cache with network_info: [{"id": "207dd9ce-91f5-4dcf-b77f-18501d94908c", "address": "fa:16:3e:a9:62:c3", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207dd9ce-91", "ovs_interfaceid": "207dd9ce-91f5-4dcf-b77f-18501d94908c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Releasing lock "refresh_cache-151bb1e2-b109-4f9c-a85c-bfed05bec7dd" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.compute.manager [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Instance network_info: |[{"id": "207dd9ce-91f5-4dcf-b77f-18501d94908c", "address": "fa:16:3e:a9:62:c3", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207dd9ce-91", "ovs_interfaceid": "207dd9ce-91f5-4dcf-b77f-18501d94908c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3cb8e6d4-3f10-4cb4-9d28-daa3eb3e38ac req-cfb51933-bc9b-4b41-99c0-58bf9e532cf5 service nova] Acquired lock "refresh_cache-151bb1e2-b109-4f9c-a85c-bfed05bec7dd" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.network.neutron [req-3cb8e6d4-3f10-4cb4-9d28-daa3eb3e38ac req-cfb51933-bc9b-4b41-99c0-58bf9e532cf5 service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Refreshing network info cache for port 207dd9ce-91f5-4dcf-b77f-18501d94908c {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Start _get_guest_xml network_info=[{"id": "207dd9ce-91f5-4dcf-b77f-18501d94908c", "address": "fa:16:3e:a9:62:c3", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207dd9ce-91", "ovs_interfaceid": "207dd9ce-91f5-4dcf-b77f-18501d94908c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:22:58 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:22:58 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:22:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2092642174',display_name='tempest-AttachVolumeNegativeTest-server-2092642174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2092642174',id=36,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtlckbxQcrXLRHqNIZUPzA6rU4pOrQcwGoq464PbkE81jDIakEtbJ7JOTwsODgDV8PXueRZhcmfyBf0PjHjG3tDDXsg1QlbJUU1+zWVAciLRmsZfGwH8b/INMWCufsKPw==',key_name='tempest-keypair-710022783',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='498d9d0f6667441791a7175256e4c557',ramdisk_id='',reservation_id='r-zkdzg80k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1401299497',owner_user_name='tempest-AttachVolumeNegativeTest-1401299497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:22:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7660b84c605b4a459065b10fda42043f',uuid=151bb1e2-b109-4f9c-a85c-bfed05bec7dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "207dd9ce-91f5-4dcf-b77f-18501d94908c", "address": "fa:16:3e:a9:62:c3", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207dd9ce-91", "ovs_interfaceid": "207dd9ce-91f5-4dcf-b77f-18501d94908c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Converting VIF {"id": "207dd9ce-91f5-4dcf-b77f-18501d94908c", "address": "fa:16:3e:a9:62:c3", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207dd9ce-91", "ovs_interfaceid": "207dd9ce-91f5-4dcf-b77f-18501d94908c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:62:c3,bridge_name='br-int',has_traffic_filtering=True,id=207dd9ce-91f5-4dcf-b77f-18501d94908c,network=Network(d02a6f85-70ee-4ed7-ae00-decabd94d542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap207dd9ce-91') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.objects.instance [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lazy-loading 'pci_devices' on Instance uuid 151bb1e2-b109-4f9c-a85c-bfed05bec7dd {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:22:58 user nova-compute[74898]:   <uuid>151bb1e2-b109-4f9c-a85c-bfed05bec7dd</uuid>
Nov 17 03:22:58 user nova-compute[74898]:   <name>instance-00000024</name>
Nov 17 03:22:58 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:22:58 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:22:58 user nova-compute[74898]:   <metadata>
Nov 17 03:22:58 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:22:58 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:22:58 user nova-compute[74898]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2092642174</nova:name>
Nov 17 03:22:58 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:22:58</nova:creationTime>
Nov 17 03:22:58 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:22:58 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:22:58 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:22:58 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:22:58 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:22:58 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:22:58 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:22:58 user nova-compute[74898]:       <nova:owner>
Nov 17 03:22:58 user nova-compute[74898]:         <nova:user uuid="7660b84c605b4a459065b10fda42043f">tempest-AttachVolumeNegativeTest-1401299497-project-member</nova:user>
Nov 17 03:22:58 user nova-compute[74898]:         <nova:project uuid="498d9d0f6667441791a7175256e4c557">tempest-AttachVolumeNegativeTest-1401299497</nova:project>
Nov 17 03:22:58 user nova-compute[74898]:       </nova:owner>
Nov 17 03:22:58 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:22:58 user nova-compute[74898]:       <nova:ports>
Nov 17 03:22:58 user nova-compute[74898]:         <nova:port uuid="207dd9ce-91f5-4dcf-b77f-18501d94908c">
Nov 17 03:22:58 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 17 03:22:58 user nova-compute[74898]:         </nova:port>
Nov 17 03:22:58 user nova-compute[74898]:       </nova:ports>
Nov 17 03:22:58 user nova-compute[74898]:     </nova:instance>
Nov 17 03:22:58 user nova-compute[74898]:   </metadata>
Nov 17 03:22:58 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:22:58 user nova-compute[74898]:     <system>
Nov 17 03:22:58 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:22:58 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:22:58 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:22:58 user nova-compute[74898]:       <entry name="serial">151bb1e2-b109-4f9c-a85c-bfed05bec7dd</entry>
Nov 17 03:22:58 user nova-compute[74898]:       <entry name="uuid">151bb1e2-b109-4f9c-a85c-bfed05bec7dd</entry>
Nov 17 03:22:58 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:22:58 user nova-compute[74898]:     </system>
Nov 17 03:22:58 user nova-compute[74898]:   </sysinfo>
Nov 17 03:22:58 user nova-compute[74898]:   <os>
Nov 17 03:22:58 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:22:58 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:22:58 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:22:58 user nova-compute[74898]:   </os>
Nov 17 03:22:58 user nova-compute[74898]:   <features>
Nov 17 03:22:58 user nova-compute[74898]:     <acpi/>
Nov 17 03:22:58 user nova-compute[74898]:     <apic/>
Nov 17 03:22:58 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:22:58 user nova-compute[74898]:   </features>
Nov 17 03:22:58 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:22:58 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:22:58 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:22:58 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:22:58 user nova-compute[74898]:   </clock>
Nov 17 03:22:58 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:22:58 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:22:58 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:22:58 user nova-compute[74898]:   </cpu>
Nov 17 03:22:58 user nova-compute[74898]:   <devices>
Nov 17 03:22:58 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:22:58 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:22:58 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/disk"/>
Nov 17 03:22:58 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:22:58 user nova-compute[74898]:     </disk>
Nov 17 03:22:58 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:22:58 user nova-compute[74898]:       <mac address="fa:16:3e:a9:62:c3"/>
Nov 17 03:22:58 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:22:58 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:22:58 user nova-compute[74898]:       <target dev="tap207dd9ce-91"/>
Nov 17 03:22:58 user nova-compute[74898]:     </interface>
Nov 17 03:22:58 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:22:58 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/console.log" append="off"/>
Nov 17 03:22:58 user nova-compute[74898]:     </serial>
Nov 17 03:22:58 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:22:58 user nova-compute[74898]:     <video>
Nov 17 03:22:58 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:22:58 user nova-compute[74898]:     </video>
Nov 17 03:22:58 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:22:58 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:22:58 user nova-compute[74898]:     </rng>
Nov 17 03:22:58 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:22:58 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:22:58 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:22:58 user nova-compute[74898]:     </memballoon>
Nov 17 03:22:58 user nova-compute[74898]:   </devices>
Nov 17 03:22:58 user nova-compute[74898]: </domain>
Nov 17 03:22:58 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:22:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2092642174',display_name='tempest-AttachVolumeNegativeTest-server-2092642174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2092642174',id=36,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtlckbxQcrXLRHqNIZUPzA6rU4pOrQcwGoq464PbkE81jDIakEtbJ7JOTwsODgDV8PXueRZhcmfyBf0PjHjG3tDDXsg1QlbJUU1+zWVAciLRmsZfGwH8b/INMWCufsKPw==',key_name='tempest-keypair-710022783',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='498d9d0f6667441791a7175256e4c557',ramdisk_id='',reservation_id='r-zkdzg80k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1401299497',owner_user_name='tempest-AttachVolumeNegativeTest-1401299497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:22:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7660b84c605b4a459065b10fda42043f',uuid=151bb1e2-b109-4f9c-a85c-bfed05bec7dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "207dd9ce-91f5-4dcf-b77f-18501d94908c", "address": "fa:16:3e:a9:62:c3", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207dd9ce-91", "ovs_interfaceid": "207dd9ce-91f5-4dcf-b77f-18501d94908c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Converting VIF {"id": "207dd9ce-91f5-4dcf-b77f-18501d94908c", "address": "fa:16:3e:a9:62:c3", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207dd9ce-91", "ovs_interfaceid": "207dd9ce-91f5-4dcf-b77f-18501d94908c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:62:c3,bridge_name='br-int',has_traffic_filtering=True,id=207dd9ce-91f5-4dcf-b77f-18501d94908c,network=Network(d02a6f85-70ee-4ed7-ae00-decabd94d542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap207dd9ce-91') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG os_vif [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:62:c3,bridge_name='br-int',has_traffic_filtering=True,id=207dd9ce-91f5-4dcf-b77f-18501d94908c,network=Network(d02a6f85-70ee-4ed7-ae00-decabd94d542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap207dd9ce-91') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1bc9bbf7-2015-5b55-9306-093103fabb67', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap207dd9ce-91, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap207dd9ce-91, col_values=(('qos', UUID('a5231904-a115-4953-b342-c86b20eba080')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap207dd9ce-91, col_values=(('external_ids', {'iface-id': '207dd9ce-91f5-4dcf-b77f-18501d94908c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:62:c3', 'vm-uuid': '151bb1e2-b109-4f9c-a85c-bfed05bec7dd'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:58 user nova-compute[74898]: INFO os_vif [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:62:c3,bridge_name='br-int',has_traffic_filtering=True,id=207dd9ce-91f5-4dcf-b77f-18501d94908c,network=Network(d02a6f85-70ee-4ed7-ae00-decabd94d542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap207dd9ce-91')
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] No VIF found with MAC fa:16:3e:a9:62:c3, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.network.neutron [req-3cb8e6d4-3f10-4cb4-9d28-daa3eb3e38ac req-cfb51933-bc9b-4b41-99c0-58bf9e532cf5 service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Updated VIF entry in instance network info cache for port 207dd9ce-91f5-4dcf-b77f-18501d94908c. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG nova.network.neutron [req-3cb8e6d4-3f10-4cb4-9d28-daa3eb3e38ac req-cfb51933-bc9b-4b41-99c0-58bf9e532cf5 service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Updating instance_info_cache with network_info: [{"id": "207dd9ce-91f5-4dcf-b77f-18501d94908c", "address": "fa:16:3e:a9:62:c3", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207dd9ce-91", "ovs_interfaceid": "207dd9ce-91f5-4dcf-b77f-18501d94908c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:22:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3cb8e6d4-3f10-4cb4-9d28-daa3eb3e38ac req-cfb51933-bc9b-4b41-99c0-58bf9e532cf5 service nova] Releasing lock "refresh_cache-151bb1e2-b109-4f9c-a85c-bfed05bec7dd" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:22:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:22:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:00 user nova-compute[74898]: DEBUG nova.compute.manager [req-efc79724-d90c-4613-97fe-2d663212255f req-311cbc5d-ec8b-4006-94cb-7abac3ce229c service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Received event network-vif-plugged-207dd9ce-91f5-4dcf-b77f-18501d94908c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:23:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-efc79724-d90c-4613-97fe-2d663212255f req-311cbc5d-ec8b-4006-94cb-7abac3ce229c service nova] Acquiring lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:23:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-efc79724-d90c-4613-97fe-2d663212255f req-311cbc5d-ec8b-4006-94cb-7abac3ce229c service nova] Lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:23:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-efc79724-d90c-4613-97fe-2d663212255f req-311cbc5d-ec8b-4006-94cb-7abac3ce229c service nova] Lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:23:00 user nova-compute[74898]: DEBUG nova.compute.manager [req-efc79724-d90c-4613-97fe-2d663212255f req-311cbc5d-ec8b-4006-94cb-7abac3ce229c service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] No waiting events found dispatching network-vif-plugged-207dd9ce-91f5-4dcf-b77f-18501d94908c {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:23:00 user nova-compute[74898]: WARNING nova.compute.manager [req-efc79724-d90c-4613-97fe-2d663212255f req-311cbc5d-ec8b-4006-94cb-7abac3ce229c service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Received unexpected event network-vif-plugged-207dd9ce-91f5-4dcf-b77f-18501d94908c for instance with vm_state building and task_state spawning.
Nov 17 03:23:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:01 user nova-compute[74898]: DEBUG nova.compute.manager [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:23:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:23:01 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Instance spawned successfully.
Nov 17 03:23:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:23:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:23:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:23:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:23:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:23:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:23:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:23:02 user nova-compute[74898]: INFO nova.compute.manager [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Took 5.31 seconds to spawn the instance on the hypervisor.
Nov 17 03:23:02 user nova-compute[74898]: DEBUG nova.compute.manager [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:23:02 user nova-compute[74898]: INFO nova.compute.manager [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Took 6.11 seconds to build instance.
Nov 17 03:23:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-030130fc-7383-4e59-a329-2df976913f24 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.221s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:23:02 user nova-compute[74898]: DEBUG nova.compute.manager [req-d6d5cb56-6984-4766-9ec2-5e494a13c606 req-b604bb2b-abe4-4878-b1ce-3e0e2d71f313 service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Received event network-vif-plugged-207dd9ce-91f5-4dcf-b77f-18501d94908c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:23:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d6d5cb56-6984-4766-9ec2-5e494a13c606 req-b604bb2b-abe4-4878-b1ce-3e0e2d71f313 service nova] Acquiring lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:23:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d6d5cb56-6984-4766-9ec2-5e494a13c606 req-b604bb2b-abe4-4878-b1ce-3e0e2d71f313 service nova] Lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:23:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d6d5cb56-6984-4766-9ec2-5e494a13c606 req-b604bb2b-abe4-4878-b1ce-3e0e2d71f313 service nova] Lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:23:02 user nova-compute[74898]: DEBUG nova.compute.manager [req-d6d5cb56-6984-4766-9ec2-5e494a13c606 req-b604bb2b-abe4-4878-b1ce-3e0e2d71f313 service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] No waiting events found dispatching network-vif-plugged-207dd9ce-91f5-4dcf-b77f-18501d94908c {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:23:02 user nova-compute[74898]: WARNING nova.compute.manager [req-d6d5cb56-6984-4766-9ec2-5e494a13c606 req-b604bb2b-abe4-4878-b1ce-3e0e2d71f313 service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Received unexpected event network-vif-plugged-207dd9ce-91f5-4dcf-b77f-18501d94908c for instance with vm_state active and task_state None.
Nov 17 03:23:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Acquiring lock "7c8ddefc-bbda-4f10-bac4-7f82be3f802f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:23:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Lock "7c8ddefc-bbda-4f10-bac4-7f82be3f802f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:23:15 user nova-compute[74898]: DEBUG nova.compute.manager [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:23:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:23:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:23:15 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:23:15 user nova-compute[74898]: INFO nova.compute.claims [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Claim successful on node user
Nov 17 03:23:15 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:23:15 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:23:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.350s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:23:15 user nova-compute[74898]: DEBUG nova.compute.manager [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:23:15 user nova-compute[74898]: DEBUG nova.compute.manager [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:23:15 user nova-compute[74898]: DEBUG nova.network.neutron [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:23:15 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:23:15 user nova-compute[74898]: DEBUG nova.compute.manager [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:23:15 user nova-compute[74898]: DEBUG nova.policy [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13208fa3ffc242e8a34887824391a6bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9795de0c02b4436da1fac5b8cc847818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:23:15 user nova-compute[74898]: DEBUG nova.compute.manager [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:23:15 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:23:15 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Creating image(s)
Nov 17 03:23:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c8ddefc-bbda-4f10-bac4-7f82be3f802f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:23:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Lock "/opt/stack/data/nova/instances/7c8ddefc-bbda-4f10-bac4-7f82be3f802f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:23:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Lock "/opt/stack/data/nova/instances/7c8ddefc-bbda-4f10-bac4-7f82be3f802f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:23:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:23:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.179s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:23:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:23:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:23:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:23:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.204s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:23:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/7c8ddefc-bbda-4f10-bac4-7f82be3f802f/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:23:16 user nova-compute[74898]: DEBUG nova.network.neutron [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Successfully created port: 118abb8a-a6b9-489b-af83-d659253c60d2 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:23:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/7c8ddefc-bbda-4f10-bac4-7f82be3f802f/disk 1073741824" returned: 0 in 0.087s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:23:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:23:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:23:16 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.201s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:23:16 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c8ddefc-bbda-4f10-bac4-7f82be3f802f/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:23:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c8ddefc-bbda-4f10-bac4-7f82be3f802f/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:23:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c8ddefc-bbda-4f10-bac4-7f82be3f802f/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:23:16 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Cannot resize image /opt/stack/data/nova/instances/7c8ddefc-bbda-4f10-bac4-7f82be3f802f/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:23:16 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:23:16 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Ensure instance console log exists: /opt/stack/data/nova/instances/7c8ddefc-bbda-4f10-bac4-7f82be3f802f/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:23:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:23:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:23:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:23:16 user nova-compute[74898]: DEBUG nova.network.neutron [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Successfully updated port: 118abb8a-a6b9-489b-af83-d659253c60d2 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:23:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Acquiring lock "refresh_cache-7c8ddefc-bbda-4f10-bac4-7f82be3f802f" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:23:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Acquired lock "refresh_cache-7c8ddefc-bbda-4f10-bac4-7f82be3f802f" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:23:16 user nova-compute[74898]: DEBUG nova.network.neutron [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:23:16 user nova-compute[74898]: DEBUG nova.compute.manager [req-9dc53c8b-64f1-4592-80e1-896282f252b3 req-33b8c217-fb75-45de-a978-14b68696f6c1 service nova] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Received event network-changed-118abb8a-a6b9-489b-af83-d659253c60d2 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:23:16 user nova-compute[74898]: DEBUG nova.compute.manager [req-9dc53c8b-64f1-4592-80e1-896282f252b3 req-33b8c217-fb75-45de-a978-14b68696f6c1 service nova] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Refreshing instance network info cache due to event network-changed-118abb8a-a6b9-489b-af83-d659253c60d2. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:23:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9dc53c8b-64f1-4592-80e1-896282f252b3 req-33b8c217-fb75-45de-a978-14b68696f6c1 service nova] Acquiring lock "refresh_cache-7c8ddefc-bbda-4f10-bac4-7f82be3f802f" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:23:16 user nova-compute[74898]: DEBUG nova.network.neutron [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.network.neutron [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Updating instance_info_cache with network_info: [{"id": "118abb8a-a6b9-489b-af83-d659253c60d2", "address": "fa:16:3e:49:be:2d", "network": {"id": "de39b2ff-813f-41bd-9387-acd359bb8e9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-34116215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9795de0c02b4436da1fac5b8cc847818", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap118abb8a-a6", "ovs_interfaceid": "118abb8a-a6b9-489b-af83-d659253c60d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Releasing lock "refresh_cache-7c8ddefc-bbda-4f10-bac4-7f82be3f802f" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.compute.manager [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Instance network_info: |[{"id": "118abb8a-a6b9-489b-af83-d659253c60d2", "address": "fa:16:3e:49:be:2d", "network": {"id": "de39b2ff-813f-41bd-9387-acd359bb8e9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-34116215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9795de0c02b4436da1fac5b8cc847818", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap118abb8a-a6", "ovs_interfaceid": "118abb8a-a6b9-489b-af83-d659253c60d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9dc53c8b-64f1-4592-80e1-896282f252b3 req-33b8c217-fb75-45de-a978-14b68696f6c1 service nova] Acquired lock "refresh_cache-7c8ddefc-bbda-4f10-bac4-7f82be3f802f" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.network.neutron [req-9dc53c8b-64f1-4592-80e1-896282f252b3 req-33b8c217-fb75-45de-a978-14b68696f6c1 service nova] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Refreshing network info cache for port 118abb8a-a6b9-489b-af83-d659253c60d2 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Start _get_guest_xml network_info=[{"id": "118abb8a-a6b9-489b-af83-d659253c60d2", "address": "fa:16:3e:49:be:2d", "network": {"id": "de39b2ff-813f-41bd-9387-acd359bb8e9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-34116215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9795de0c02b4436da1fac5b8cc847818", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap118abb8a-a6", "ovs_interfaceid": "118abb8a-a6b9-489b-af83-d659253c60d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:23:17 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:23:17 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:23:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1794727982',display_name='tempest-VolumesActionsTest-instance-1794727982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1794727982',id=37,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9795de0c02b4436da1fac5b8cc847818',ramdisk_id='',reservation_id='r-57yu0ywq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1147633224',owner_user_name='tempest-VolumesActionsTest-1147633224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:23:16Z,user_data=None,user_id='13208fa3ffc242e8a34887824391a6bf',uuid=7c8ddefc-bbda-4f10-bac4-7f82be3f802f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "118abb8a-a6b9-489b-af83-d659253c60d2", "address": "fa:16:3e:49:be:2d", "network": {"id": "de39b2ff-813f-41bd-9387-acd359bb8e9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-34116215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9795de0c02b4436da1fac5b8cc847818", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap118abb8a-a6", "ovs_interfaceid": "118abb8a-a6b9-489b-af83-d659253c60d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Converting VIF {"id": "118abb8a-a6b9-489b-af83-d659253c60d2", "address": "fa:16:3e:49:be:2d", "network": {"id": "de39b2ff-813f-41bd-9387-acd359bb8e9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-34116215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9795de0c02b4436da1fac5b8cc847818", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap118abb8a-a6", "ovs_interfaceid": "118abb8a-a6b9-489b-af83-d659253c60d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:be:2d,bridge_name='br-int',has_traffic_filtering=True,id=118abb8a-a6b9-489b-af83-d659253c60d2,network=Network(de39b2ff-813f-41bd-9387-acd359bb8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap118abb8a-a6') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.objects.instance [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c8ddefc-bbda-4f10-bac4-7f82be3f802f {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:23:17 user nova-compute[74898]:   <uuid>7c8ddefc-bbda-4f10-bac4-7f82be3f802f</uuid>
Nov 17 03:23:17 user nova-compute[74898]:   <name>instance-00000025</name>
Nov 17 03:23:17 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:23:17 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:23:17 user nova-compute[74898]:   <metadata>
Nov 17 03:23:17 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:23:17 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:23:17 user nova-compute[74898]:       <nova:name>tempest-VolumesActionsTest-instance-1794727982</nova:name>
Nov 17 03:23:17 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:23:17</nova:creationTime>
Nov 17 03:23:17 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:23:17 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:23:17 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:23:17 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:23:17 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:23:17 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:23:17 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:23:17 user nova-compute[74898]:       <nova:owner>
Nov 17 03:23:17 user nova-compute[74898]:         <nova:user uuid="13208fa3ffc242e8a34887824391a6bf">tempest-VolumesActionsTest-1147633224-project-member</nova:user>
Nov 17 03:23:17 user nova-compute[74898]:         <nova:project uuid="9795de0c02b4436da1fac5b8cc847818">tempest-VolumesActionsTest-1147633224</nova:project>
Nov 17 03:23:17 user nova-compute[74898]:       </nova:owner>
Nov 17 03:23:17 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:23:17 user nova-compute[74898]:       <nova:ports>
Nov 17 03:23:17 user nova-compute[74898]:         <nova:port uuid="118abb8a-a6b9-489b-af83-d659253c60d2">
Nov 17 03:23:17 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 17 03:23:17 user nova-compute[74898]:         </nova:port>
Nov 17 03:23:17 user nova-compute[74898]:       </nova:ports>
Nov 17 03:23:17 user nova-compute[74898]:     </nova:instance>
Nov 17 03:23:17 user nova-compute[74898]:   </metadata>
Nov 17 03:23:17 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:23:17 user nova-compute[74898]:     <system>
Nov 17 03:23:17 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:23:17 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:23:17 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:23:17 user nova-compute[74898]:       <entry name="serial">7c8ddefc-bbda-4f10-bac4-7f82be3f802f</entry>
Nov 17 03:23:17 user nova-compute[74898]:       <entry name="uuid">7c8ddefc-bbda-4f10-bac4-7f82be3f802f</entry>
Nov 17 03:23:17 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:23:17 user nova-compute[74898]:     </system>
Nov 17 03:23:17 user nova-compute[74898]:   </sysinfo>
Nov 17 03:23:17 user nova-compute[74898]:   <os>
Nov 17 03:23:17 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:23:17 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:23:17 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:23:17 user nova-compute[74898]:   </os>
Nov 17 03:23:17 user nova-compute[74898]:   <features>
Nov 17 03:23:17 user nova-compute[74898]:     <acpi/>
Nov 17 03:23:17 user nova-compute[74898]:     <apic/>
Nov 17 03:23:17 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:23:17 user nova-compute[74898]:   </features>
Nov 17 03:23:17 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:23:17 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:23:17 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:23:17 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:23:17 user nova-compute[74898]:   </clock>
Nov 17 03:23:17 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:23:17 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:23:17 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:23:17 user nova-compute[74898]:   </cpu>
Nov 17 03:23:17 user nova-compute[74898]:   <devices>
Nov 17 03:23:17 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:23:17 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:23:17 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/7c8ddefc-bbda-4f10-bac4-7f82be3f802f/disk"/>
Nov 17 03:23:17 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:23:17 user nova-compute[74898]:     </disk>
Nov 17 03:23:17 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:23:17 user nova-compute[74898]:       <mac address="fa:16:3e:49:be:2d"/>
Nov 17 03:23:17 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:23:17 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:23:17 user nova-compute[74898]:       <target dev="tap118abb8a-a6"/>
Nov 17 03:23:17 user nova-compute[74898]:     </interface>
Nov 17 03:23:17 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:23:17 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/7c8ddefc-bbda-4f10-bac4-7f82be3f802f/console.log" append="off"/>
Nov 17 03:23:17 user nova-compute[74898]:     </serial>
Nov 17 03:23:17 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:23:17 user nova-compute[74898]:     <video>
Nov 17 03:23:17 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:23:17 user nova-compute[74898]:     </video>
Nov 17 03:23:17 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:23:17 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:23:17 user nova-compute[74898]:     </rng>
Nov 17 03:23:17 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:23:17 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:23:17 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:23:17 user nova-compute[74898]:     </memballoon>
Nov 17 03:23:17 user nova-compute[74898]:   </devices>
Nov 17 03:23:17 user nova-compute[74898]: </domain>
Nov 17 03:23:17 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:23:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1794727982',display_name='tempest-VolumesActionsTest-instance-1794727982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1794727982',id=37,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9795de0c02b4436da1fac5b8cc847818',ramdisk_id='',reservation_id='r-57yu0ywq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1147633224',owner_user_name='tempest-VolumesActionsTest-1147633224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:23:16Z,user_data=None,user_id='13208fa3ffc242e8a34887824391a6bf',uuid=7c8ddefc-bbda-4f10-bac4-7f82be3f802f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "118abb8a-a6b9-489b-af83-d659253c60d2", "address": "fa:16:3e:49:be:2d", "network": {"id": "de39b2ff-813f-41bd-9387-acd359bb8e9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-34116215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9795de0c02b4436da1fac5b8cc847818", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap118abb8a-a6", "ovs_interfaceid": "118abb8a-a6b9-489b-af83-d659253c60d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Converting VIF {"id": "118abb8a-a6b9-489b-af83-d659253c60d2", "address": "fa:16:3e:49:be:2d", "network": {"id": "de39b2ff-813f-41bd-9387-acd359bb8e9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-34116215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9795de0c02b4436da1fac5b8cc847818", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap118abb8a-a6", "ovs_interfaceid": "118abb8a-a6b9-489b-af83-d659253c60d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:be:2d,bridge_name='br-int',has_traffic_filtering=True,id=118abb8a-a6b9-489b-af83-d659253c60d2,network=Network(de39b2ff-813f-41bd-9387-acd359bb8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap118abb8a-a6') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG os_vif [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:be:2d,bridge_name='br-int',has_traffic_filtering=True,id=118abb8a-a6b9-489b-af83-d659253c60d2,network=Network(de39b2ff-813f-41bd-9387-acd359bb8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap118abb8a-a6') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ca5a634c-d7c0-58aa-a133-9513d6ede1c0', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap118abb8a-a6, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap118abb8a-a6, col_values=(('qos', UUID('1b09aa20-a164-4d5a-ae4e-d72cf2e23e7e')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap118abb8a-a6, col_values=(('external_ids', {'iface-id': '118abb8a-a6b9-489b-af83-d659253c60d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:be:2d', 'vm-uuid': '7c8ddefc-bbda-4f10-bac4-7f82be3f802f'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:17 user nova-compute[74898]: INFO os_vif [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:be:2d,bridge_name='br-int',has_traffic_filtering=True,id=118abb8a-a6b9-489b-af83-d659253c60d2,network=Network(de39b2ff-813f-41bd-9387-acd359bb8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap118abb8a-a6')
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] No VIF found with MAC fa:16:3e:49:be:2d, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.network.neutron [req-9dc53c8b-64f1-4592-80e1-896282f252b3 req-33b8c217-fb75-45de-a978-14b68696f6c1 service nova] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Updated VIF entry in instance network info cache for port 118abb8a-a6b9-489b-af83-d659253c60d2. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG nova.network.neutron [req-9dc53c8b-64f1-4592-80e1-896282f252b3 req-33b8c217-fb75-45de-a978-14b68696f6c1 service nova] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Updating instance_info_cache with network_info: [{"id": "118abb8a-a6b9-489b-af83-d659253c60d2", "address": "fa:16:3e:49:be:2d", "network": {"id": "de39b2ff-813f-41bd-9387-acd359bb8e9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-34116215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9795de0c02b4436da1fac5b8cc847818", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap118abb8a-a6", "ovs_interfaceid": "118abb8a-a6b9-489b-af83-d659253c60d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:23:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9dc53c8b-64f1-4592-80e1-896282f252b3 req-33b8c217-fb75-45de-a978-14b68696f6c1 service nova] Releasing lock "refresh_cache-7c8ddefc-bbda-4f10-bac4-7f82be3f802f" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:23:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:18 user nova-compute[74898]: DEBUG nova.compute.manager [req-f7f32ed8-c78f-44eb-9f87-e65981a903f4 req-3ad7b543-cdd6-43d4-b025-ac8498ee3507 service nova] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Received event network-changed-c22de465-9b25-416b-bd4a-ff729ce99a18 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:23:18 user nova-compute[74898]: DEBUG nova.compute.manager [req-f7f32ed8-c78f-44eb-9f87-e65981a903f4 req-3ad7b543-cdd6-43d4-b025-ac8498ee3507 service nova] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Refreshing instance network info cache due to event network-changed-c22de465-9b25-416b-bd4a-ff729ce99a18. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:23:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f7f32ed8-c78f-44eb-9f87-e65981a903f4 req-3ad7b543-cdd6-43d4-b025-ac8498ee3507 service nova] Acquiring lock "refresh_cache-8e4684b2-7234-4a88-8571-89531c5dfa03" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:23:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f7f32ed8-c78f-44eb-9f87-e65981a903f4 req-3ad7b543-cdd6-43d4-b025-ac8498ee3507 service nova] Acquired lock "refresh_cache-8e4684b2-7234-4a88-8571-89531c5dfa03" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:23:18 user nova-compute[74898]: DEBUG nova.network.neutron [req-f7f32ed8-c78f-44eb-9f87-e65981a903f4 req-3ad7b543-cdd6-43d4-b025-ac8498ee3507 service nova] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Refreshing network info cache for port c22de465-9b25-416b-bd4a-ff729ce99a18 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:23:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:19 user nova-compute[74898]: DEBUG nova.network.neutron [req-f7f32ed8-c78f-44eb-9f87-e65981a903f4 req-3ad7b543-cdd6-43d4-b025-ac8498ee3507 service nova] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Updated VIF entry in instance network info cache for port c22de465-9b25-416b-bd4a-ff729ce99a18. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:23:19 user nova-compute[74898]: DEBUG nova.network.neutron [req-f7f32ed8-c78f-44eb-9f87-e65981a903f4 req-3ad7b543-cdd6-43d4-b025-ac8498ee3507 service nova] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Updating instance_info_cache with network_info: [{"id": "c22de465-9b25-416b-bd4a-ff729ce99a18", "address": "fa:16:3e:f0:01:60", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22de465-9b", "ovs_interfaceid": "c22de465-9b25-416b-bd4a-ff729ce99a18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:23:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f7f32ed8-c78f-44eb-9f87-e65981a903f4 req-3ad7b543-cdd6-43d4-b025-ac8498ee3507 service nova] Releasing lock "refresh_cache-8e4684b2-7234-4a88-8571-89531c5dfa03" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:23:19 user nova-compute[74898]: DEBUG nova.compute.manager [req-f7f32ed8-c78f-44eb-9f87-e65981a903f4 req-3ad7b543-cdd6-43d4-b025-ac8498ee3507 service nova] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Received event network-vif-plugged-118abb8a-a6b9-489b-af83-d659253c60d2 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:23:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f7f32ed8-c78f-44eb-9f87-e65981a903f4 req-3ad7b543-cdd6-43d4-b025-ac8498ee3507 service nova] Acquiring lock "7c8ddefc-bbda-4f10-bac4-7f82be3f802f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:23:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f7f32ed8-c78f-44eb-9f87-e65981a903f4 req-3ad7b543-cdd6-43d4-b025-ac8498ee3507 service nova] Lock "7c8ddefc-bbda-4f10-bac4-7f82be3f802f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:23:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f7f32ed8-c78f-44eb-9f87-e65981a903f4 req-3ad7b543-cdd6-43d4-b025-ac8498ee3507 service nova] Lock "7c8ddefc-bbda-4f10-bac4-7f82be3f802f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:23:19 user nova-compute[74898]: DEBUG nova.compute.manager [req-f7f32ed8-c78f-44eb-9f87-e65981a903f4 req-3ad7b543-cdd6-43d4-b025-ac8498ee3507 service nova] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] No waiting events found dispatching network-vif-plugged-118abb8a-a6b9-489b-af83-d659253c60d2 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:23:19 user nova-compute[74898]: WARNING nova.compute.manager [req-f7f32ed8-c78f-44eb-9f87-e65981a903f4 req-3ad7b543-cdd6-43d4-b025-ac8498ee3507 service nova] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Received unexpected event network-vif-plugged-118abb8a-a6b9-489b-af83-d659253c60d2 for instance with vm_state building and task_state spawning.
Nov 17 03:23:20 user nova-compute[74898]: DEBUG nova.compute.manager [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:23:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:23:20 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Instance spawned successfully.
Nov 17 03:23:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:23:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:23:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:23:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:23:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:23:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:23:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:23:20 user nova-compute[74898]: INFO nova.compute.manager [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Took 5.04 seconds to spawn the instance on the hypervisor.
Nov 17 03:23:20 user nova-compute[74898]: DEBUG nova.compute.manager [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:23:20 user nova-compute[74898]: INFO nova.compute.manager [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Took 5.84 seconds to build instance.
Nov 17 03:23:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-62252cd1-5ab3-49db-9973-7e4e47de9a2f tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Lock "7c8ddefc-bbda-4f10-bac4-7f82be3f802f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.931s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:23:21 user nova-compute[74898]: DEBUG nova.compute.manager [req-8ab9ff48-5074-4009-afb7-eb7db052f6e6 req-f070c24a-a2ab-40b4-83a9-afa0f387231f service nova] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Received event network-vif-plugged-118abb8a-a6b9-489b-af83-d659253c60d2 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:23:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8ab9ff48-5074-4009-afb7-eb7db052f6e6 req-f070c24a-a2ab-40b4-83a9-afa0f387231f service nova] Acquiring lock "7c8ddefc-bbda-4f10-bac4-7f82be3f802f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:23:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8ab9ff48-5074-4009-afb7-eb7db052f6e6 req-f070c24a-a2ab-40b4-83a9-afa0f387231f service nova] Lock "7c8ddefc-bbda-4f10-bac4-7f82be3f802f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:23:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8ab9ff48-5074-4009-afb7-eb7db052f6e6 req-f070c24a-a2ab-40b4-83a9-afa0f387231f service nova] Lock "7c8ddefc-bbda-4f10-bac4-7f82be3f802f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:23:21 user nova-compute[74898]: DEBUG nova.compute.manager [req-8ab9ff48-5074-4009-afb7-eb7db052f6e6 req-f070c24a-a2ab-40b4-83a9-afa0f387231f service nova] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] No waiting events found dispatching network-vif-plugged-118abb8a-a6b9-489b-af83-d659253c60d2 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:23:21 user nova-compute[74898]: WARNING nova.compute.manager [req-8ab9ff48-5074-4009-afb7-eb7db052f6e6 req-f070c24a-a2ab-40b4-83a9-afa0f387231f service nova] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Received unexpected event network-vif-plugged-118abb8a-a6b9-489b-af83-d659253c60d2 for instance with vm_state active and task_state None.
Nov 17 03:23:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "d85e6107-2833-4537-8705-2c5b78fd7ab4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:23:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "d85e6107-2833-4537-8705-2c5b78fd7ab4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:23:25 user nova-compute[74898]: DEBUG nova.compute.manager [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:23:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:23:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:23:26 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:23:26 user nova-compute[74898]: INFO nova.compute.claims [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Claim successful on node user
Nov 17 03:23:26 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:23:26 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:23:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:23:26 user nova-compute[74898]: DEBUG nova.compute.manager [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:23:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:26 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:23:26 user nova-compute[74898]: DEBUG nova.compute.manager [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:23:26 user nova-compute[74898]: DEBUG nova.network.neutron [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:23:26 user nova-compute[74898]: DEBUG nova.compute.manager [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:23:26 user nova-compute[74898]: INFO nova.virt.block_device [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Booting with volume snapshot e3d6d9ea-b55c-4483-827e-b486a9709ed3 at /dev/vda
Nov 17 03:23:26 user nova-compute[74898]: DEBUG nova.policy [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa779a5f98394629b6b9fa9d04233e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d36087cc8e842c0bfcae89553fb9841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:23:27 user nova-compute[74898]: DEBUG nova.network.neutron [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Successfully created port: f0c366b9-5d08-44b5-96e6-43a5c39fa844 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:23:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:27 user nova-compute[74898]: DEBUG nova.network.neutron [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Successfully updated port: f0c366b9-5d08-44b5-96e6-43a5c39fa844 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:23:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "refresh_cache-d85e6107-2833-4537-8705-2c5b78fd7ab4" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:23:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquired lock "refresh_cache-d85e6107-2833-4537-8705-2c5b78fd7ab4" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:23:27 user nova-compute[74898]: DEBUG nova.network.neutron [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:23:27 user nova-compute[74898]: DEBUG nova.compute.manager [req-3471b497-46af-4028-b9b3-addfe6fff968 req-e9cf1d22-da49-4977-9a20-745396363427 service nova] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Received event network-changed-f0c366b9-5d08-44b5-96e6-43a5c39fa844 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:23:27 user nova-compute[74898]: DEBUG nova.compute.manager [req-3471b497-46af-4028-b9b3-addfe6fff968 req-e9cf1d22-da49-4977-9a20-745396363427 service nova] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Refreshing instance network info cache due to event network-changed-f0c366b9-5d08-44b5-96e6-43a5c39fa844. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:23:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3471b497-46af-4028-b9b3-addfe6fff968 req-e9cf1d22-da49-4977-9a20-745396363427 service nova] Acquiring lock "refresh_cache-d85e6107-2833-4537-8705-2c5b78fd7ab4" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:23:27 user nova-compute[74898]: DEBUG nova.network.neutron [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:23:28 user nova-compute[74898]: DEBUG nova.network.neutron [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Updating instance_info_cache with network_info: [{"id": "f0c366b9-5d08-44b5-96e6-43a5c39fa844", "address": "fa:16:3e:0b:b5:5c", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c366b9-5d", "ovs_interfaceid": "f0c366b9-5d08-44b5-96e6-43a5c39fa844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:23:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Releasing lock "refresh_cache-d85e6107-2833-4537-8705-2c5b78fd7ab4" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:23:28 user nova-compute[74898]: DEBUG nova.compute.manager [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Instance network_info: |[{"id": "f0c366b9-5d08-44b5-96e6-43a5c39fa844", "address": "fa:16:3e:0b:b5:5c", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c366b9-5d", "ovs_interfaceid": "f0c366b9-5d08-44b5-96e6-43a5c39fa844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:23:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3471b497-46af-4028-b9b3-addfe6fff968 req-e9cf1d22-da49-4977-9a20-745396363427 service nova] Acquired lock "refresh_cache-d85e6107-2833-4537-8705-2c5b78fd7ab4" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:23:28 user nova-compute[74898]: DEBUG nova.network.neutron [req-3471b497-46af-4028-b9b3-addfe6fff968 req-e9cf1d22-da49-4977-9a20-745396363427 service nova] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Refreshing network info cache for port f0c366b9-5d08-44b5-96e6-43a5c39fa844 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:23:28 user nova-compute[74898]: DEBUG nova.network.neutron [req-3471b497-46af-4028-b9b3-addfe6fff968 req-e9cf1d22-da49-4977-9a20-745396363427 service nova] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Updated VIF entry in instance network info cache for port f0c366b9-5d08-44b5-96e6-43a5c39fa844. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:23:28 user nova-compute[74898]: DEBUG nova.network.neutron [req-3471b497-46af-4028-b9b3-addfe6fff968 req-e9cf1d22-da49-4977-9a20-745396363427 service nova] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Updating instance_info_cache with network_info: [{"id": "f0c366b9-5d08-44b5-96e6-43a5c39fa844", "address": "fa:16:3e:0b:b5:5c", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c366b9-5d", "ovs_interfaceid": "f0c366b9-5d08-44b5-96e6-43a5c39fa844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:23:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3471b497-46af-4028-b9b3-addfe6fff968 req-e9cf1d22-da49-4977-9a20-745396363427 service nova] Releasing lock "refresh_cache-d85e6107-2833-4537-8705-2c5b78fd7ab4" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:23:30 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:23:30 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:23:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:32 user nova-compute[74898]: DEBUG os_brick.utils [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:23:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:23:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:23:32 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d4854a-5a51-412b-8c74-1028bfb007d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:23:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:23:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:23:32 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[75176a12-bc48-4cb7-b7e8-329d41873aff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:23:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:23:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:23:32 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d9f435-82e0-4281-abc4-190314ac9df3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:23:32 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6451da8f-2037-4ff2-beff-3690c41e05ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:23:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:23:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:23:32 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:23:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:23:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:23:32 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:23:32 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21ad584-8819-44f2-8aba-36adb1e3e8f3]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:23:32 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:23:32 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:23:32 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:23:32 user nova-compute[74898]: DEBUG os_brick.utils [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:23:32 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Updating existing volume attachment record: e5ede1b3-aae6-4561-96b3-e7b1f43d6034 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:23:32 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:23:34 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:23:34 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:23:35 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:23:35 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:23:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:36 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:23:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:23:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:23:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:23:36 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:23:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:23:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c8ddefc-bbda-4f10-bac4-7f82be3f802f/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:23:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c8ddefc-bbda-4f10-bac4-7f82be3f802f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:23:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c8ddefc-bbda-4f10-bac4-7f82be3f802f/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:23:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c8ddefc-bbda-4f10-bac4-7f82be3f802f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:23:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:23:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:23:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:23:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:23:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:23:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:23:37 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG nova.compute.manager [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:23:38 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Creating image(s)
Nov 17 03:23:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Did not create local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Ensure instance console log exists: /opt/stack/data/nova/instances/d85e6107-2833-4537-8705-2c5b78fd7ab4/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Start _get_guest_xml network_info=[{"id": "f0c366b9-5d08-44b5-96e6-43a5c39fa844", "address": "fa:16:3e:0b:b5:5c", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c366b9-5d", "ovs_interfaceid": "f0c366b9-5d08-44b5-96e6-43a5c39fa844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-17T03:23:21Z,direct_url=<?>,disk_format='qcow2',id=971ef405-cb3f-4052-9862-aeee8217da7d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1171249395',owner='5d36087cc8e842c0bfcae89553fb9841',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-17T03:23:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'voakPDxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd85e6107-2833-4537-8705-2c5b78fd7ab4', 'attached_at': '', 'detached_at': '', 'volume_id': '816793e9-8a25-499b-a521-c9f121bb0e29', 'serial': '816793e9-8a25-499b-a521-c9f121bb0e29'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'e5ede1b3-aae6-4561-96b3-e7b1f43d6034', 'volume_type': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:23:38 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:23:38 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:23:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-17T03:23:21Z,direct_url=<?>,disk_format='qcow2',id=971ef405-cb3f-4052-9862-aeee8217da7d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1171249395',owner='5d36087cc8e842c0bfcae89553fb9841',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-17T03:23:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'voakPDxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:23:38 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:23:38 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:23:38 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:23:38 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:23:38 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:23:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5967517a-0ee3-46bc-8aec-1a71874c92b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:23:38 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b10bcb5-bee3-47f7-82ad-2bc7fd1ca10e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29] added
Nov 17 03:23:38 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:23:38 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:23:38 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:23:38 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=8205MB free_disk=25.089111328125GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[07161a2d-e94f-4476-a760-8447567d5a53]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a461b60-b0f2-4d96-b628-bce8c5be3e5e]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v voakPDxs {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v voakPDxs" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[081bd7fb-ea22-42e7-8560-2a9d79ffca35]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:23:38 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'voakPDxs'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5f7dbd-fecc-4dea-8b15-050e8d4cf145]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9c6cf4-f495-44d0-bdcd-e4b05373e754]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:23:39 user nova-compute[74898]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)
Nov 17 03:23:39 user nova-compute[74898]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 (non-flash)
Nov 17 03:23:39 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:23:39 user nova-compute[74898]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)
Nov 17 03:23:39 user nova-compute[74898]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 (non-flash)
Nov 17 03:23:39 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 13449e5c-809b-4db2-af0b-53f5865eb3a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 24cd7ac4-3724-4189-82a7-ba61ba46097a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 6eee4731-60ed-41ab-905e-395aa4d5e568 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 90dd082b-900d-49b4-83be-db10c7ab9533 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 8e4684b2-7234-4a88-8571-89531c5dfa03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 151bb1e2-b109-4f9c-a85c-bfed05bec7dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 7c8ddefc-bbda-4f10-bac4-7f82be3f802f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance d85e6107-2833-4537-8705-2c5b78fd7ab4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a6134b-c60f-4eba-aa57-9edb9b126cdc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29, portal: 172.16.0.220,3260]
Nov 17 03:23:39 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29, portal: 172.16.0.220,3260] successful.
Nov 17 03:23:39 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c336195-1bd9-4f39-affe-2c2a32e396a6]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab549ad3-cd8d-4755-bd09-f30728c41d69]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:23:39 user nova-compute[74898]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)
Nov 17 03:23:39 user nova-compute[74898]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 (non-flash)
Nov 17 03:23:39 user nova-compute[74898]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 (non-flash)
Nov 17 03:23:39 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:23:39 user nova-compute[74898]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)
Nov 17 03:23:39 user nova-compute[74898]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 (non-flash)
Nov 17 03:23:39 user nova-compute[74898]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 (non-flash)
Nov 17 03:23:39 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.614s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a88ab8-35bc-4e40-abcb-306f4d11720a]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'voakPDxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:23:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.530s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:23:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.651s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:23:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] <== connect_volume: return (1654ms) {'type': 'block', 'scsi_wwn': '26165393461353133', 'path': '/dev/sdd'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:23:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165393461353133', 'path': '/dev/sdd'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:23:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1264517637',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1264517637',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1264517637',id=38,image_ref='971ef405-cb3f-4052-9862-aeee8217da7d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLUe+AD2G/cc5zpzxU9H6WTelTVsj/zObcSbjJ2HaVfnwup3vPsUr17do1HOTIcCnui7w6dMa1KatUbIQ71P7ZB9c1VnprR6RRBZDT+J25o0scXh8ukWfFQhisD727GWg==',key_name='tempest-keypair-1837606644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d36087cc8e842c0bfcae89553fb9841',ramdisk_id='',reservation_id='r-5hgrzowc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1382126375',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1382126375-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1382126375',owner_user_name='tempest-TestVolumeBootPattern-1382126375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:23:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa779a5f98394629b6b9fa9d04233e7a',uuid=d85e6107-2833-4537-8705-2c5b78fd7ab4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0c366b9-5d08-44b5-96e6-43a5c39fa844", "address": "fa:16:3e:0b:b5:5c", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c366b9-5d", "ovs_interfaceid": "f0c366b9-5d08-44b5-96e6-43a5c39fa844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:23:40 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converting VIF {"id": "f0c366b9-5d08-44b5-96e6-43a5c39fa844", "address": "fa:16:3e:0b:b5:5c", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c366b9-5d", "ovs_interfaceid": "f0c366b9-5d08-44b5-96e6-43a5c39fa844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:23:40 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b5:5c,bridge_name='br-int',has_traffic_filtering=True,id=f0c366b9-5d08-44b5-96e6-43a5c39fa844,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0c366b9-5d') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:23:40 user nova-compute[74898]: DEBUG nova.objects.instance [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lazy-loading 'pci_devices' on Instance uuid d85e6107-2833-4537-8705-2c5b78fd7ab4 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:23:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:23:40 user nova-compute[74898]:   <uuid>d85e6107-2833-4537-8705-2c5b78fd7ab4</uuid>
Nov 17 03:23:40 user nova-compute[74898]:   <name>instance-00000026</name>
Nov 17 03:23:40 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:23:40 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:23:40 user nova-compute[74898]:   <metadata>
Nov 17 03:23:40 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:23:40 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:23:40 user nova-compute[74898]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1264517637</nova:name>
Nov 17 03:23:40 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:23:38</nova:creationTime>
Nov 17 03:23:40 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:23:40 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:23:40 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:23:40 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:23:40 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:23:40 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:23:40 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:23:40 user nova-compute[74898]:       <nova:owner>
Nov 17 03:23:40 user nova-compute[74898]:         <nova:user uuid="aa779a5f98394629b6b9fa9d04233e7a">tempest-TestVolumeBootPattern-1382126375-project-member</nova:user>
Nov 17 03:23:40 user nova-compute[74898]:         <nova:project uuid="5d36087cc8e842c0bfcae89553fb9841">tempest-TestVolumeBootPattern-1382126375</nova:project>
Nov 17 03:23:40 user nova-compute[74898]:       </nova:owner>
Nov 17 03:23:40 user nova-compute[74898]:       <nova:root type="image" uuid="971ef405-cb3f-4052-9862-aeee8217da7d"/>
Nov 17 03:23:40 user nova-compute[74898]:       <nova:ports>
Nov 17 03:23:40 user nova-compute[74898]:         <nova:port uuid="f0c366b9-5d08-44b5-96e6-43a5c39fa844">
Nov 17 03:23:40 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 17 03:23:40 user nova-compute[74898]:         </nova:port>
Nov 17 03:23:40 user nova-compute[74898]:       </nova:ports>
Nov 17 03:23:40 user nova-compute[74898]:     </nova:instance>
Nov 17 03:23:40 user nova-compute[74898]:   </metadata>
Nov 17 03:23:40 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:23:40 user nova-compute[74898]:     <system>
Nov 17 03:23:40 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:23:40 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:23:40 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:23:40 user nova-compute[74898]:       <entry name="serial">d85e6107-2833-4537-8705-2c5b78fd7ab4</entry>
Nov 17 03:23:40 user nova-compute[74898]:       <entry name="uuid">d85e6107-2833-4537-8705-2c5b78fd7ab4</entry>
Nov 17 03:23:40 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:23:40 user nova-compute[74898]:     </system>
Nov 17 03:23:40 user nova-compute[74898]:   </sysinfo>
Nov 17 03:23:40 user nova-compute[74898]:   <os>
Nov 17 03:23:40 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:23:40 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:23:40 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:23:40 user nova-compute[74898]:   </os>
Nov 17 03:23:40 user nova-compute[74898]:   <features>
Nov 17 03:23:40 user nova-compute[74898]:     <acpi/>
Nov 17 03:23:40 user nova-compute[74898]:     <apic/>
Nov 17 03:23:40 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:23:40 user nova-compute[74898]:   </features>
Nov 17 03:23:40 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:23:40 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:23:40 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:23:40 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:23:40 user nova-compute[74898]:   </clock>
Nov 17 03:23:40 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:23:40 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:23:40 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:23:40 user nova-compute[74898]:   </cpu>
Nov 17 03:23:40 user nova-compute[74898]:   <devices>
Nov 17 03:23:40 user nova-compute[74898]:     <disk type="block" device="disk">
Nov 17 03:23:40 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:23:40 user nova-compute[74898]:       <source dev="/dev/sdd"/>
Nov 17 03:23:40 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:23:40 user nova-compute[74898]:       <serial>816793e9-8a25-499b-a521-c9f121bb0e29</serial>
Nov 17 03:23:40 user nova-compute[74898]:     </disk>
Nov 17 03:23:40 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:23:40 user nova-compute[74898]:       <mac address="fa:16:3e:0b:b5:5c"/>
Nov 17 03:23:40 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:23:40 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:23:40 user nova-compute[74898]:       <target dev="tapf0c366b9-5d"/>
Nov 17 03:23:40 user nova-compute[74898]:     </interface>
Nov 17 03:23:40 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:23:40 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/d85e6107-2833-4537-8705-2c5b78fd7ab4/console.log" append="off"/>
Nov 17 03:23:40 user nova-compute[74898]:     </serial>
Nov 17 03:23:40 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:23:40 user nova-compute[74898]:     <video>
Nov 17 03:23:40 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:23:40 user nova-compute[74898]:     </video>
Nov 17 03:23:40 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:23:40 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:23:40 user nova-compute[74898]:     </rng>
Nov 17 03:23:40 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:23:40 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:23:40 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:23:40 user nova-compute[74898]:     </memballoon>
Nov 17 03:23:40 user nova-compute[74898]:   </devices>
Nov 17 03:23:40 user nova-compute[74898]: </domain>
Nov 17 03:23:40 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:23:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1264517637',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1264517637',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1264517637',id=38,image_ref='971ef405-cb3f-4052-9862-aeee8217da7d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLUe+AD2G/cc5zpzxU9H6WTelTVsj/zObcSbjJ2HaVfnwup3vPsUr17do1HOTIcCnui7w6dMa1KatUbIQ71P7ZB9c1VnprR6RRBZDT+J25o0scXh8ukWfFQhisD727GWg==',key_name='tempest-keypair-1837606644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d36087cc8e842c0bfcae89553fb9841',ramdisk_id='',reservation_id='r-5hgrzowc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1382126375',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1382126375-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1382126375',owner_user_name='tempest-TestVolumeBootPattern-1382126375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:23:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa779a5f98394629b6b9fa9d04233e7a',uuid=d85e6107-2833-4537-8705-2c5b78fd7ab4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0c366b9-5d08-44b5-96e6-43a5c39fa844", "address": "fa:16:3e:0b:b5:5c", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c366b9-5d", "ovs_interfaceid": "f0c366b9-5d08-44b5-96e6-43a5c39fa844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:23:40 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converting VIF {"id": "f0c366b9-5d08-44b5-96e6-43a5c39fa844", "address": "fa:16:3e:0b:b5:5c", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c366b9-5d", "ovs_interfaceid": "f0c366b9-5d08-44b5-96e6-43a5c39fa844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:23:40 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b5:5c,bridge_name='br-int',has_traffic_filtering=True,id=f0c366b9-5d08-44b5-96e6-43a5c39fa844,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0c366b9-5d') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:23:40 user nova-compute[74898]: DEBUG os_vif [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b5:5c,bridge_name='br-int',has_traffic_filtering=True,id=f0c366b9-5d08-44b5-96e6-43a5c39fa844,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0c366b9-5d') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:23:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:23:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:23:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c3acdd4c-ac5d-591b-ac9b-203f96d45f8d', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:23:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:23:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0c366b9-5d, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:23:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0c366b9-5d, col_values=(('qos', UUID('6099f42f-d534-44af-9c88-6c62fbcbfed6')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:23:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0c366b9-5d, col_values=(('external_ids', {'iface-id': 'f0c366b9-5d08-44b5-96e6-43a5c39fa844', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:b5:5c', 'vm-uuid': 'd85e6107-2833-4537-8705-2c5b78fd7ab4'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:23:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:23:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:40 user nova-compute[74898]: INFO os_vif [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b5:5c,bridge_name='br-int',has_traffic_filtering=True,id=f0c366b9-5d08-44b5-96e6-43a5c39fa844,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0c366b9-5d')
Nov 17 03:23:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:23:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] No VIF found with MAC fa:16:3e:0b:b5:5c, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:23:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:41 user nova-compute[74898]: DEBUG nova.compute.manager [req-231d7bfa-3111-4845-adff-4d1c61b7eaa1 req-9f583b8c-7dda-4618-b4cb-f92ca9da35ac service nova] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Received event network-vif-plugged-f0c366b9-5d08-44b5-96e6-43a5c39fa844 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:23:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-231d7bfa-3111-4845-adff-4d1c61b7eaa1 req-9f583b8c-7dda-4618-b4cb-f92ca9da35ac service nova] Acquiring lock "d85e6107-2833-4537-8705-2c5b78fd7ab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:23:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-231d7bfa-3111-4845-adff-4d1c61b7eaa1 req-9f583b8c-7dda-4618-b4cb-f92ca9da35ac service nova] Lock "d85e6107-2833-4537-8705-2c5b78fd7ab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:23:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-231d7bfa-3111-4845-adff-4d1c61b7eaa1 req-9f583b8c-7dda-4618-b4cb-f92ca9da35ac service nova] Lock "d85e6107-2833-4537-8705-2c5b78fd7ab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:23:41 user nova-compute[74898]: DEBUG nova.compute.manager [req-231d7bfa-3111-4845-adff-4d1c61b7eaa1 req-9f583b8c-7dda-4618-b4cb-f92ca9da35ac service nova] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] No waiting events found dispatching network-vif-plugged-f0c366b9-5d08-44b5-96e6-43a5c39fa844 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:23:41 user nova-compute[74898]: WARNING nova.compute.manager [req-231d7bfa-3111-4845-adff-4d1c61b7eaa1 req-9f583b8c-7dda-4618-b4cb-f92ca9da35ac service nova] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Received unexpected event network-vif-plugged-f0c366b9-5d08-44b5-96e6-43a5c39fa844 for instance with vm_state building and task_state spawning.
Nov 17 03:23:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:42 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:23:42 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:23:42 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:23:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-6eee4731-60ed-41ab-905e-395aa4d5e568" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:23:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-6eee4731-60ed-41ab-905e-395aa4d5e568" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:23:42 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:23:42 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Updating instance_info_cache with network_info: [{"id": "88711a2d-c81a-4fb8-991c-9c78fa20755d", "address": "fa:16:3e:5a:2e:19", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88711a2d-c8", "ovs_interfaceid": "88711a2d-c81a-4fb8-991c-9c78fa20755d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:23:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-6eee4731-60ed-41ab-905e-395aa4d5e568" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:23:42 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:23:42 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:23:43 user nova-compute[74898]: DEBUG nova.compute.manager [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:23:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:23:43 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Instance spawned successfully.
Nov 17 03:23:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:23:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:23:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:23:43 user nova-compute[74898]: INFO nova.compute.manager [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 17 03:23:43 user nova-compute[74898]: DEBUG nova.compute.manager [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:23:43 user nova-compute[74898]: DEBUG nova.compute.manager [req-0cf41f96-9fa3-4d88-bbb6-7e475d5bd1cc req-81025d4c-5c0c-4c85-b3df-818150123d26 service nova] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Received event network-vif-plugged-f0c366b9-5d08-44b5-96e6-43a5c39fa844 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:23:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0cf41f96-9fa3-4d88-bbb6-7e475d5bd1cc req-81025d4c-5c0c-4c85-b3df-818150123d26 service nova] Acquiring lock "d85e6107-2833-4537-8705-2c5b78fd7ab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:23:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0cf41f96-9fa3-4d88-bbb6-7e475d5bd1cc req-81025d4c-5c0c-4c85-b3df-818150123d26 service nova] Lock "d85e6107-2833-4537-8705-2c5b78fd7ab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:23:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0cf41f96-9fa3-4d88-bbb6-7e475d5bd1cc req-81025d4c-5c0c-4c85-b3df-818150123d26 service nova] Lock "d85e6107-2833-4537-8705-2c5b78fd7ab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:23:43 user nova-compute[74898]: DEBUG nova.compute.manager [req-0cf41f96-9fa3-4d88-bbb6-7e475d5bd1cc req-81025d4c-5c0c-4c85-b3df-818150123d26 service nova] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] No waiting events found dispatching network-vif-plugged-f0c366b9-5d08-44b5-96e6-43a5c39fa844 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:23:43 user nova-compute[74898]: WARNING nova.compute.manager [req-0cf41f96-9fa3-4d88-bbb6-7e475d5bd1cc req-81025d4c-5c0c-4c85-b3df-818150123d26 service nova] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Received unexpected event network-vif-plugged-f0c366b9-5d08-44b5-96e6-43a5c39fa844 for instance with vm_state building and task_state spawning.
Nov 17 03:23:43 user nova-compute[74898]: INFO nova.compute.manager [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Took 17.89 seconds to build instance.
Nov 17 03:23:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-87452227-7d33-4806-9226-3b1d97d849b4 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "d85e6107-2833-4537-8705-2c5b78fd7ab4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.987s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:23:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:23:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:24:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:24:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:24:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:24:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:24:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:24:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:24:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:24:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "90dd082b-900d-49b4-83be-db10c7ab9533" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:24:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "90dd082b-900d-49b4-83be-db10c7ab9533" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:24:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:24:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:24:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:24:18 user nova-compute[74898]: INFO nova.compute.manager [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Terminating instance
Nov 17 03:24:18 user nova-compute[74898]: DEBUG nova.compute.manager [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:24:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:24:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:24:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:24:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:24:18 user nova-compute[74898]: DEBUG nova.compute.manager [req-ecb80208-cd21-4565-916a-80d2fe33bbe8 req-bb179a0e-1f26-44d9-9a9a-a0026186fe9a service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Received event network-vif-unplugged-014195e4-69ec-44a5-bdbf-17a716389fa8 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:24:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ecb80208-cd21-4565-916a-80d2fe33bbe8 req-bb179a0e-1f26-44d9-9a9a-a0026186fe9a service nova] Acquiring lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:24:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ecb80208-cd21-4565-916a-80d2fe33bbe8 req-bb179a0e-1f26-44d9-9a9a-a0026186fe9a service nova] Lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:24:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ecb80208-cd21-4565-916a-80d2fe33bbe8 req-bb179a0e-1f26-44d9-9a9a-a0026186fe9a service nova] Lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:24:18 user nova-compute[74898]: DEBUG nova.compute.manager [req-ecb80208-cd21-4565-916a-80d2fe33bbe8 req-bb179a0e-1f26-44d9-9a9a-a0026186fe9a service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] No waiting events found dispatching network-vif-unplugged-014195e4-69ec-44a5-bdbf-17a716389fa8 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:24:18 user nova-compute[74898]: DEBUG nova.compute.manager [req-ecb80208-cd21-4565-916a-80d2fe33bbe8 req-bb179a0e-1f26-44d9-9a9a-a0026186fe9a service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Received event network-vif-unplugged-014195e4-69ec-44a5-bdbf-17a716389fa8 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:24:19 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Instance destroyed successfully.
Nov 17 03:24:19 user nova-compute[74898]: DEBUG nova.objects.instance [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lazy-loading 'resources' on Instance uuid 90dd082b-900d-49b4-83be-db10c7ab9533 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:18:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-521230326',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-521230326',id=34,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:20:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0cd941de23248d8ac93b03f930f565f',ramdisk_id='',reservation_id='r-gx25h9x6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-507656828',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:22:32Z,user_data=None,user_id='05397a6b586843338aafbc8a17c6e42c',uuid=90dd082b-900d-49b4-83be-db10c7ab9533,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "014195e4-69ec-44a5-bdbf-17a716389fa8", "address": "fa:16:3e:23:b7:2d", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014195e4-69", "ovs_interfaceid": "014195e4-69ec-44a5-bdbf-17a716389fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Converting VIF {"id": "014195e4-69ec-44a5-bdbf-17a716389fa8", "address": "fa:16:3e:23:b7:2d", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014195e4-69", "ovs_interfaceid": "014195e4-69ec-44a5-bdbf-17a716389fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:b7:2d,bridge_name='br-int',has_traffic_filtering=True,id=014195e4-69ec-44a5-bdbf-17a716389fa8,network=Network(9302cb9a-12f9-4845-b6cc-905f4bf24b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014195e4-69') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG os_vif [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:b7:2d,bridge_name='br-int',has_traffic_filtering=True,id=014195e4-69ec-44a5-bdbf-17a716389fa8,network=Network(9302cb9a-12f9-4845-b6cc-905f4bf24b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014195e4-69') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap014195e4-69, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc1f95c7-0020-427f-99a1-a6b0016c8f62) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:24:19 user nova-compute[74898]: INFO os_vif [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:b7:2d,bridge_name='br-int',has_traffic_filtering=True,id=014195e4-69ec-44a5-bdbf-17a716389fa8,network=Network(9302cb9a-12f9-4845-b6cc-905f4bf24b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014195e4-69')
Nov 17 03:24:19 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uUFvOzEJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:24:19 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:24:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a77694a-5625-4f9f-b6eb-6a38034fdb06]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:24:19 user nova-compute[74898]: No targets found.
Nov 17 03:24:19 user nova-compute[74898]: iSNS:
Nov 17 03:24:19 user nova-compute[74898]: No targets found.
Nov 17 03:24:19 user nova-compute[74898]: STATIC:
Nov 17 03:24:19 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9
Nov 17 03:24:19 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:24:19 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:24:19 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4
Nov 17 03:24:19 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:24:19 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:24:19 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29
Nov 17 03:24:19 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:24:19 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:24:19 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42
Nov 17 03:24:19 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:24:19 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:24:19 user nova-compute[74898]: FIRMWARE:
Nov 17 03:24:19 user nova-compute[74898]: No targets found.
Nov 17 03:24:19 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:24:19 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:24:19 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d419df8-8b33-4fb7-8864-5bbdfe0f906d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb7591a-e3c5-478f-9f80-ee474f3011f7]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:24:19 user nova-compute[74898]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)
Nov 17 03:24:19 user nova-compute[74898]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 (non-flash)
Nov 17 03:24:19 user nova-compute[74898]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 (non-flash)
Nov 17 03:24:19 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:24:19 user nova-compute[74898]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 (non-flash)
Nov 17 03:24:19 user nova-compute[74898]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 (non-flash)
Nov 17 03:24:19 user nova-compute[74898]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 (non-flash)
Nov 17 03:24:19 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf84e2c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42'): ({'sde'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Removing single pathed devices sde {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe4bf32-343e-4514-9566-dcc2720bf170]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d270cb28-4952-4e93-afa5-db20ecd7e951]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Flushing IO for device /dev/sde {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa6b30e-9c48-4d39-9e25-94df4ca077aa]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6131254b-8bab-4833-b0ff-de6fe4131d43]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] SCSI volumes sde have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[009bad01-6dd4-4b7f-afa3-7dda82a5b7ad]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9567c762-7d35-4661-be18-f5cb32d4801a]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42, portal: 172.16.0.220,3260]
Nov 17 03:24:19 user nova-compute[74898]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42, portal: 172.16.0.220,3260] successful.
Nov 17 03:24:19 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7f265c-c094-42ca-910a-2d55a601ce42 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e8ce53-4c8c-48cd-a17d-c7f770087000]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] <== disconnect_volume: return (307ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:24:19 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Deleting instance files /opt/stack/data/nova/instances/90dd082b-900d-49b4-83be-db10c7ab9533_del
Nov 17 03:24:19 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Deletion of /opt/stack/data/nova/instances/90dd082b-900d-49b4-83be-db10c7ab9533_del complete
Nov 17 03:24:19 user nova-compute[74898]: INFO nova.compute.manager [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 17 03:24:19 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:24:19 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:24:19 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Took 0.46 seconds to deallocate network for instance.
Nov 17 03:24:19 user nova-compute[74898]: DEBUG nova.compute.manager [req-9278e0f6-12f6-4191-b400-08786e157634 req-1895bb41-f2aa-4eb9-8268-62be2b530f2e service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Received event network-vif-deleted-014195e4-69ec-44a5-bdbf-17a716389fa8 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:24:20 user nova-compute[74898]: INFO nova.compute.manager [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Took 0.72 seconds to detach 1 volumes for instance.
Nov 17 03:24:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:24:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:24:20 user nova-compute[74898]: DEBUG nova.compute.manager [req-88cc4d5d-cfde-42ab-9db4-bd55e799b188 req-7780c69f-702a-4f01-85dc-827ec6b23b39 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Received event network-vif-plugged-014195e4-69ec-44a5-bdbf-17a716389fa8 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:24:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-88cc4d5d-cfde-42ab-9db4-bd55e799b188 req-7780c69f-702a-4f01-85dc-827ec6b23b39 service nova] Acquiring lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:24:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-88cc4d5d-cfde-42ab-9db4-bd55e799b188 req-7780c69f-702a-4f01-85dc-827ec6b23b39 service nova] Lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:24:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-88cc4d5d-cfde-42ab-9db4-bd55e799b188 req-7780c69f-702a-4f01-85dc-827ec6b23b39 service nova] Lock "90dd082b-900d-49b4-83be-db10c7ab9533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:24:20 user nova-compute[74898]: DEBUG nova.compute.manager [req-88cc4d5d-cfde-42ab-9db4-bd55e799b188 req-7780c69f-702a-4f01-85dc-827ec6b23b39 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] No waiting events found dispatching network-vif-plugged-014195e4-69ec-44a5-bdbf-17a716389fa8 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:24:20 user nova-compute[74898]: WARNING nova.compute.manager [req-88cc4d5d-cfde-42ab-9db4-bd55e799b188 req-7780c69f-702a-4f01-85dc-827ec6b23b39 service nova] [instance: 90dd082b-900d-49b4-83be-db10c7ab9533] Received unexpected event network-vif-plugged-014195e4-69ec-44a5-bdbf-17a716389fa8 for instance with vm_state deleted and task_state None.
Nov 17 03:24:20 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:24:20 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:24:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:24:21 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Deleted allocations for instance 90dd082b-900d-49b4-83be-db10c7ab9533
Nov 17 03:24:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-330ea460-a5f5-4105-afe4-9f08776e186f tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "90dd082b-900d-49b4-83be-db10c7ab9533" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.802s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:24:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:24:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:24:32 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:24:32 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:24:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:24:34 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:24:34 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:24:36 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:24:36 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:24:37 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:24:38 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:24:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:24:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:24:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:24:38 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:24:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c8ddefc-bbda-4f10-bac4-7f82be3f802f/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:24:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c8ddefc-bbda-4f10-bac4-7f82be3f802f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c8ddefc-bbda-4f10-bac4-7f82be3f802f/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c8ddefc-bbda-4f10-bac4-7f82be3f802f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:24:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:24:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:24:40 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:24:40 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:24:40 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=8230MB free_disk=25.085674285888672GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:24:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:24:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:24:40 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 13449e5c-809b-4db2-af0b-53f5865eb3a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:24:40 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 24cd7ac4-3724-4189-82a7-ba61ba46097a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:24:40 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 6eee4731-60ed-41ab-905e-395aa4d5e568 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:24:40 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 8e4684b2-7234-4a88-8571-89531c5dfa03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:24:40 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 151bb1e2-b109-4f9c-a85c-bfed05bec7dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:24:40 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 7c8ddefc-bbda-4f10-bac4-7f82be3f802f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:24:40 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance d85e6107-2833-4537-8705-2c5b78fd7ab4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:24:40 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:24:40 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:24:41 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:24:41 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:24:41 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:24:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.536s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:24:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:24:44 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:24:44 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:24:44 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Didn't find any instances for network info cache update. {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 17 03:24:44 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:24:46 user nova-compute[74898]: DEBUG nova.compute.manager [req-0db09eff-aa56-4bde-ae0f-606267e4b300 req-0a47a7d0-2c6f-4daa-b817-6b915df4871e service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Received event network-changed-207dd9ce-91f5-4dcf-b77f-18501d94908c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:24:46 user nova-compute[74898]: DEBUG nova.compute.manager [req-0db09eff-aa56-4bde-ae0f-606267e4b300 req-0a47a7d0-2c6f-4daa-b817-6b915df4871e service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Refreshing instance network info cache due to event network-changed-207dd9ce-91f5-4dcf-b77f-18501d94908c. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:24:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0db09eff-aa56-4bde-ae0f-606267e4b300 req-0a47a7d0-2c6f-4daa-b817-6b915df4871e service nova] Acquiring lock "refresh_cache-151bb1e2-b109-4f9c-a85c-bfed05bec7dd" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:24:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0db09eff-aa56-4bde-ae0f-606267e4b300 req-0a47a7d0-2c6f-4daa-b817-6b915df4871e service nova] Acquired lock "refresh_cache-151bb1e2-b109-4f9c-a85c-bfed05bec7dd" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:24:46 user nova-compute[74898]: DEBUG nova.network.neutron [req-0db09eff-aa56-4bde-ae0f-606267e4b300 req-0a47a7d0-2c6f-4daa-b817-6b915df4871e service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Refreshing network info cache for port 207dd9ce-91f5-4dcf-b77f-18501d94908c {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:24:47 user nova-compute[74898]: DEBUG nova.network.neutron [req-0db09eff-aa56-4bde-ae0f-606267e4b300 req-0a47a7d0-2c6f-4daa-b817-6b915df4871e service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Updated VIF entry in instance network info cache for port 207dd9ce-91f5-4dcf-b77f-18501d94908c. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:24:47 user nova-compute[74898]: DEBUG nova.network.neutron [req-0db09eff-aa56-4bde-ae0f-606267e4b300 req-0a47a7d0-2c6f-4daa-b817-6b915df4871e service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Updating instance_info_cache with network_info: [{"id": "207dd9ce-91f5-4dcf-b77f-18501d94908c", "address": "fa:16:3e:a9:62:c3", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207dd9ce-91", "ovs_interfaceid": "207dd9ce-91f5-4dcf-b77f-18501d94908c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:24:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0db09eff-aa56-4bde-ae0f-606267e4b300 req-0a47a7d0-2c6f-4daa-b817-6b915df4871e service nova] Releasing lock "refresh_cache-151bb1e2-b109-4f9c-a85c-bfed05bec7dd" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:24:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:24:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:24:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:24:49 user nova-compute[74898]: DEBUG nova.objects.instance [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lazy-loading 'flavor' on Instance uuid 151bb1e2-b109-4f9c-a85c-bfed05bec7dd {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:24:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:24:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:24:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:24:49 user nova-compute[74898]: INFO nova.compute.manager [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Attaching volume 59ed4582-972d-48e4-8b70-2331ffb98688 to /dev/vdb
Nov 17 03:24:49 user nova-compute[74898]: DEBUG os_brick.utils [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:24:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:49 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ec11d4-6d5a-453b-909e-b106dbb38860]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:24:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:49 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce6dc70-38ae-48fc-a898-36b2a00e43b5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:24:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:49 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc34ca0-7706-45d7-b0be-8585e674ddb5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:24:49 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cbd9ca-79a9-412b-9abe-8522a83e6c15]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:24:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:24:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:24:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:24:50 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:24:50 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[db02b9fb-b509-4f95-8f5b-432a187cb581]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:24:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:24:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:24:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:24:50 user nova-compute[74898]: DEBUG os_brick.utils [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:24:50 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Updating existing volume attachment record: 57d700ad-5a70-4afa-b8d7-8d7cd9b87407 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:24:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:24:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lySmiPnN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:24:55 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:24:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:24:55 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:24:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:24:55 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceda42c9-3cb3-4de1-9c69-008b450932fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:24:55 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe829a0-f964-49b4-be3d-d4e7ed553182]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688] added
Nov 17 03:24:55 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae476f4e-26eb-4767-ba26-f159638e548a]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bf2541-551b-4793-8da8-fe9dba05d7bf]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lySmiPnN {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lySmiPnN" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[738cbb49-3524-4aeb-aeb9-b45f3ef183d3]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lySmiPnN'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b0e9bc-98ae-42f8-bc3a-d917ab492449]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0a5b98-2859-44ed-8bed-325c583b51e5]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:24:55 user nova-compute[74898]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 (non-flash)
Nov 17 03:24:55 user nova-compute[74898]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 (non-flash)
Nov 17 03:24:55 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:24:55 user nova-compute[74898]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 (non-flash)
Nov 17 03:24:55 user nova-compute[74898]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 (non-flash)
Nov 17 03:24:55 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a327746-2eb1-46d0-8873-79e993a51f9d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688, portal: 172.16.0.220,3260]
Nov 17 03:24:55 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688, portal: 172.16.0.220,3260] successful.
Nov 17 03:24:55 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d731f63-7ddf-4440-8ab6-6d2dd7a2be9d]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b605ea-1839-46a0-816c-a4a009f21657]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:24:55 user nova-compute[74898]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 (non-flash)
Nov 17 03:24:55 user nova-compute[74898]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 (non-flash)
Nov 17 03:24:55 user nova-compute[74898]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 (non-flash)
Nov 17 03:24:55 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:24:55 user nova-compute[74898]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 (non-flash)
Nov 17 03:24:55 user nova-compute[74898]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 (non-flash)
Nov 17 03:24:55 user nova-compute[74898]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 (non-flash)
Nov 17 03:24:55 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] HCTL ('36', '-', '-', 0) found on session 46 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f21c289-b5cd-40cf-9a73-10e35d157d9c]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:24:55 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: None {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:24:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:24:56 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:24:56 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lySmiPnN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:24:56 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:24:56 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26638353563393532', 'path': '/dev/sde'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:24:56 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638353563393532', 'path': '/dev/sde'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:24:56 user nova-compute[74898]: DEBUG nova.objects.instance [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lazy-loading 'flavor' on Instance uuid 151bb1e2-b109-4f9c-a85c-bfed05bec7dd {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:24:56 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 03:24:56 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:24:56 user nova-compute[74898]:   <source dev="/dev/sde"/>
Nov 17 03:24:56 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:24:56 user nova-compute[74898]:   <serial>59ed4582-972d-48e4-8b70-2331ffb98688</serial>
Nov 17 03:24:56 user nova-compute[74898]: </disk>
Nov 17 03:24:56 user nova-compute[74898]:  {{(pid=74898) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 03:24:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:24:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:24:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] No VIF found with MAC fa:16:3e:a9:62:c3, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:24:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c9b1adf1-637f-4fc9-a6e0-af6ac3b2ae86 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.459s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:24:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "d40e6f31-1df9-4af5-8a34-9317ae55baa8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:25:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "d40e6f31-1df9-4af5-8a34-9317ae55baa8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:25:01 user nova-compute[74898]: DEBUG nova.compute.manager [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:25:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:25:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:25:01 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:25:01 user nova-compute[74898]: INFO nova.compute.claims [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Claim successful on node user
Nov 17 03:25:01 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:25:01 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:25:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.417s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:25:01 user nova-compute[74898]: DEBUG nova.compute.manager [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:25:01 user nova-compute[74898]: DEBUG nova.compute.manager [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:25:01 user nova-compute[74898]: DEBUG nova.network.neutron [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:25:01 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:25:01 user nova-compute[74898]: DEBUG nova.compute.manager [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:25:02 user nova-compute[74898]: DEBUG nova.compute.manager [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:25:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:25:02 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Creating image(s)
Nov 17 03:25:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "/opt/stack/data/nova/instances/d40e6f31-1df9-4af5-8a34-9317ae55baa8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:25:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "/opt/stack/data/nova/instances/d40e6f31-1df9-4af5-8a34-9317ae55baa8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:25:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "/opt/stack/data/nova/instances/d40e6f31-1df9-4af5-8a34-9317ae55baa8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:25:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:25:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.191s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:25:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:25:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:25:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:25:02 user nova-compute[74898]: DEBUG nova.policy [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7660b84c605b4a459065b10fda42043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498d9d0f6667441791a7175256e4c557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:25:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.177s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:25:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/d40e6f31-1df9-4af5-8a34-9317ae55baa8/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:25:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/d40e6f31-1df9-4af5-8a34-9317ae55baa8/disk 1073741824" returned: 0 in 0.051s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:25:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:25:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:25:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.167s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:25:02 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d40e6f31-1df9-4af5-8a34-9317ae55baa8/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:25:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40e6f31-1df9-4af5-8a34-9317ae55baa8/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:25:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40e6f31-1df9-4af5-8a34-9317ae55baa8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:25:02 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Cannot resize image /opt/stack/data/nova/instances/d40e6f31-1df9-4af5-8a34-9317ae55baa8/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:25:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:25:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Ensure instance console log exists: /opt/stack/data/nova/instances/d40e6f31-1df9-4af5-8a34-9317ae55baa8/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:25:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:25:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:25:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:25:02 user nova-compute[74898]: DEBUG nova.network.neutron [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Successfully created port: e398a0eb-e160-4b6f-860f-515f7a39f3f2 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.network.neutron [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Successfully updated port: e398a0eb-e160-4b6f-860f-515f7a39f3f2 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "refresh_cache-d40e6f31-1df9-4af5-8a34-9317ae55baa8" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquired lock "refresh_cache-d40e6f31-1df9-4af5-8a34-9317ae55baa8" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.network.neutron [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.compute.manager [req-4adbc8da-c6fe-4016-9fae-9a2db406e7fd req-c432bdda-7b05-4113-8476-7a79d47b9cd3 service nova] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Received event network-changed-e398a0eb-e160-4b6f-860f-515f7a39f3f2 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.compute.manager [req-4adbc8da-c6fe-4016-9fae-9a2db406e7fd req-c432bdda-7b05-4113-8476-7a79d47b9cd3 service nova] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Refreshing instance network info cache due to event network-changed-e398a0eb-e160-4b6f-860f-515f7a39f3f2. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4adbc8da-c6fe-4016-9fae-9a2db406e7fd req-c432bdda-7b05-4113-8476-7a79d47b9cd3 service nova] Acquiring lock "refresh_cache-d40e6f31-1df9-4af5-8a34-9317ae55baa8" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.network.neutron [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.network.neutron [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Updating instance_info_cache with network_info: [{"id": "e398a0eb-e160-4b6f-860f-515f7a39f3f2", "address": "fa:16:3e:b7:9e:25", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape398a0eb-e1", "ovs_interfaceid": "e398a0eb-e160-4b6f-860f-515f7a39f3f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Releasing lock "refresh_cache-d40e6f31-1df9-4af5-8a34-9317ae55baa8" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.compute.manager [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Instance network_info: |[{"id": "e398a0eb-e160-4b6f-860f-515f7a39f3f2", "address": "fa:16:3e:b7:9e:25", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape398a0eb-e1", "ovs_interfaceid": "e398a0eb-e160-4b6f-860f-515f7a39f3f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4adbc8da-c6fe-4016-9fae-9a2db406e7fd req-c432bdda-7b05-4113-8476-7a79d47b9cd3 service nova] Acquired lock "refresh_cache-d40e6f31-1df9-4af5-8a34-9317ae55baa8" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.network.neutron [req-4adbc8da-c6fe-4016-9fae-9a2db406e7fd req-c432bdda-7b05-4113-8476-7a79d47b9cd3 service nova] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Refreshing network info cache for port e398a0eb-e160-4b6f-860f-515f7a39f3f2 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Start _get_guest_xml network_info=[{"id": "e398a0eb-e160-4b6f-860f-515f7a39f3f2", "address": "fa:16:3e:b7:9e:25", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape398a0eb-e1", "ovs_interfaceid": "e398a0eb-e160-4b6f-860f-515f7a39f3f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:25:03 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:25:03 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:25:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-513601840',display_name='tempest-AttachVolumeNegativeTest-server-513601840',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-513601840',id=39,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmC8td6ybCBRj+GI84tLrFKin3CzQOm9O+EvhG3Egx+pzcz/3PchtEq8yk6XW8tR9yOy6G50NAALE/p7BWqs2JGhPVMYB3rqR8rpKR5D851KpBb6RD38aeVyeTZ5YNBWQ==',key_name='tempest-keypair-1420990439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='498d9d0f6667441791a7175256e4c557',ramdisk_id='',reservation_id='r-5do6q9w3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1401299497',owner_user_name='tempest-AttachVolumeNegativeTest-1401299497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:25:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7660b84c605b4a459065b10fda42043f',uuid=d40e6f31-1df9-4af5-8a34-9317ae55baa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e398a0eb-e160-4b6f-860f-515f7a39f3f2", "address": "fa:16:3e:b7:9e:25", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape398a0eb-e1", "ovs_interfaceid": "e398a0eb-e160-4b6f-860f-515f7a39f3f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Converting VIF {"id": "e398a0eb-e160-4b6f-860f-515f7a39f3f2", "address": "fa:16:3e:b7:9e:25", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape398a0eb-e1", "ovs_interfaceid": "e398a0eb-e160-4b6f-860f-515f7a39f3f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:9e:25,bridge_name='br-int',has_traffic_filtering=True,id=e398a0eb-e160-4b6f-860f-515f7a39f3f2,network=Network(d02a6f85-70ee-4ed7-ae00-decabd94d542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape398a0eb-e1') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.objects.instance [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lazy-loading 'pci_devices' on Instance uuid d40e6f31-1df9-4af5-8a34-9317ae55baa8 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:25:03 user nova-compute[74898]:   <uuid>d40e6f31-1df9-4af5-8a34-9317ae55baa8</uuid>
Nov 17 03:25:03 user nova-compute[74898]:   <name>instance-00000027</name>
Nov 17 03:25:03 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:25:03 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:25:03 user nova-compute[74898]:   <metadata>
Nov 17 03:25:03 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:25:03 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:25:03 user nova-compute[74898]:       <nova:name>tempest-AttachVolumeNegativeTest-server-513601840</nova:name>
Nov 17 03:25:03 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:25:03</nova:creationTime>
Nov 17 03:25:03 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:25:03 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:25:03 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:25:03 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:25:03 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:25:03 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:25:03 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:25:03 user nova-compute[74898]:       <nova:owner>
Nov 17 03:25:03 user nova-compute[74898]:         <nova:user uuid="7660b84c605b4a459065b10fda42043f">tempest-AttachVolumeNegativeTest-1401299497-project-member</nova:user>
Nov 17 03:25:03 user nova-compute[74898]:         <nova:project uuid="498d9d0f6667441791a7175256e4c557">tempest-AttachVolumeNegativeTest-1401299497</nova:project>
Nov 17 03:25:03 user nova-compute[74898]:       </nova:owner>
Nov 17 03:25:03 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:25:03 user nova-compute[74898]:       <nova:ports>
Nov 17 03:25:03 user nova-compute[74898]:         <nova:port uuid="e398a0eb-e160-4b6f-860f-515f7a39f3f2">
Nov 17 03:25:03 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 17 03:25:03 user nova-compute[74898]:         </nova:port>
Nov 17 03:25:03 user nova-compute[74898]:       </nova:ports>
Nov 17 03:25:03 user nova-compute[74898]:     </nova:instance>
Nov 17 03:25:03 user nova-compute[74898]:   </metadata>
Nov 17 03:25:03 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:25:03 user nova-compute[74898]:     <system>
Nov 17 03:25:03 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:25:03 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:25:03 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:25:03 user nova-compute[74898]:       <entry name="serial">d40e6f31-1df9-4af5-8a34-9317ae55baa8</entry>
Nov 17 03:25:03 user nova-compute[74898]:       <entry name="uuid">d40e6f31-1df9-4af5-8a34-9317ae55baa8</entry>
Nov 17 03:25:03 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:25:03 user nova-compute[74898]:     </system>
Nov 17 03:25:03 user nova-compute[74898]:   </sysinfo>
Nov 17 03:25:03 user nova-compute[74898]:   <os>
Nov 17 03:25:03 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:25:03 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:25:03 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:25:03 user nova-compute[74898]:   </os>
Nov 17 03:25:03 user nova-compute[74898]:   <features>
Nov 17 03:25:03 user nova-compute[74898]:     <acpi/>
Nov 17 03:25:03 user nova-compute[74898]:     <apic/>
Nov 17 03:25:03 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:25:03 user nova-compute[74898]:   </features>
Nov 17 03:25:03 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:25:03 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:25:03 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:25:03 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:25:03 user nova-compute[74898]:   </clock>
Nov 17 03:25:03 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:25:03 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:25:03 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:25:03 user nova-compute[74898]:   </cpu>
Nov 17 03:25:03 user nova-compute[74898]:   <devices>
Nov 17 03:25:03 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:25:03 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:25:03 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/d40e6f31-1df9-4af5-8a34-9317ae55baa8/disk"/>
Nov 17 03:25:03 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:25:03 user nova-compute[74898]:     </disk>
Nov 17 03:25:03 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:25:03 user nova-compute[74898]:       <mac address="fa:16:3e:b7:9e:25"/>
Nov 17 03:25:03 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:25:03 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:25:03 user nova-compute[74898]:       <target dev="tape398a0eb-e1"/>
Nov 17 03:25:03 user nova-compute[74898]:     </interface>
Nov 17 03:25:03 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:25:03 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/d40e6f31-1df9-4af5-8a34-9317ae55baa8/console.log" append="off"/>
Nov 17 03:25:03 user nova-compute[74898]:     </serial>
Nov 17 03:25:03 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:25:03 user nova-compute[74898]:     <video>
Nov 17 03:25:03 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:25:03 user nova-compute[74898]:     </video>
Nov 17 03:25:03 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:25:03 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:25:03 user nova-compute[74898]:     </rng>
Nov 17 03:25:03 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:25:03 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:25:03 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:25:03 user nova-compute[74898]:     </memballoon>
Nov 17 03:25:03 user nova-compute[74898]:   </devices>
Nov 17 03:25:03 user nova-compute[74898]: </domain>
Nov 17 03:25:03 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:25:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-513601840',display_name='tempest-AttachVolumeNegativeTest-server-513601840',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-513601840',id=39,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmC8td6ybCBRj+GI84tLrFKin3CzQOm9O+EvhG3Egx+pzcz/3PchtEq8yk6XW8tR9yOy6G50NAALE/p7BWqs2JGhPVMYB3rqR8rpKR5D851KpBb6RD38aeVyeTZ5YNBWQ==',key_name='tempest-keypair-1420990439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='498d9d0f6667441791a7175256e4c557',ramdisk_id='',reservation_id='r-5do6q9w3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1401299497',owner_user_name='tempest-AttachVolumeNegativeTest-1401299497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:25:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7660b84c605b4a459065b10fda42043f',uuid=d40e6f31-1df9-4af5-8a34-9317ae55baa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e398a0eb-e160-4b6f-860f-515f7a39f3f2", "address": "fa:16:3e:b7:9e:25", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape398a0eb-e1", "ovs_interfaceid": "e398a0eb-e160-4b6f-860f-515f7a39f3f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Converting VIF {"id": "e398a0eb-e160-4b6f-860f-515f7a39f3f2", "address": "fa:16:3e:b7:9e:25", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape398a0eb-e1", "ovs_interfaceid": "e398a0eb-e160-4b6f-860f-515f7a39f3f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:9e:25,bridge_name='br-int',has_traffic_filtering=True,id=e398a0eb-e160-4b6f-860f-515f7a39f3f2,network=Network(d02a6f85-70ee-4ed7-ae00-decabd94d542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape398a0eb-e1') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG os_vif [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:9e:25,bridge_name='br-int',has_traffic_filtering=True,id=e398a0eb-e160-4b6f-860f-515f7a39f3f2,network=Network(d02a6f85-70ee-4ed7-ae00-decabd94d542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape398a0eb-e1') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'efeaf1d7-4100-5e5b-80ff-21864267298b', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape398a0eb-e1, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape398a0eb-e1, col_values=(('qos', UUID('c32676e9-4fbb-4c35-97ca-c51376dc6f58')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape398a0eb-e1, col_values=(('external_ids', {'iface-id': 'e398a0eb-e160-4b6f-860f-515f7a39f3f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:9e:25', 'vm-uuid': 'd40e6f31-1df9-4af5-8a34-9317ae55baa8'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:25:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:03 user nova-compute[74898]: INFO os_vif [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:9e:25,bridge_name='br-int',has_traffic_filtering=True,id=e398a0eb-e160-4b6f-860f-515f7a39f3f2,network=Network(d02a6f85-70ee-4ed7-ae00-decabd94d542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape398a0eb-e1')
Nov 17 03:25:04 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:25:04 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] No VIF found with MAC fa:16:3e:b7:9e:25, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:25:04 user nova-compute[74898]: DEBUG nova.network.neutron [req-4adbc8da-c6fe-4016-9fae-9a2db406e7fd req-c432bdda-7b05-4113-8476-7a79d47b9cd3 service nova] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Updated VIF entry in instance network info cache for port e398a0eb-e160-4b6f-860f-515f7a39f3f2. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:25:04 user nova-compute[74898]: DEBUG nova.network.neutron [req-4adbc8da-c6fe-4016-9fae-9a2db406e7fd req-c432bdda-7b05-4113-8476-7a79d47b9cd3 service nova] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Updating instance_info_cache with network_info: [{"id": "e398a0eb-e160-4b6f-860f-515f7a39f3f2", "address": "fa:16:3e:b7:9e:25", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape398a0eb-e1", "ovs_interfaceid": "e398a0eb-e160-4b6f-860f-515f7a39f3f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:25:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4adbc8da-c6fe-4016-9fae-9a2db406e7fd req-c432bdda-7b05-4113-8476-7a79d47b9cd3 service nova] Releasing lock "refresh_cache-d40e6f31-1df9-4af5-8a34-9317ae55baa8" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:25:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:05 user nova-compute[74898]: DEBUG nova.compute.manager [req-b8aab441-e6ed-4b96-9210-e374bf7d8f4b req-f042e34c-33eb-4a44-8acf-462d0e89bfd2 service nova] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Received event network-vif-plugged-e398a0eb-e160-4b6f-860f-515f7a39f3f2 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:25:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b8aab441-e6ed-4b96-9210-e374bf7d8f4b req-f042e34c-33eb-4a44-8acf-462d0e89bfd2 service nova] Acquiring lock "d40e6f31-1df9-4af5-8a34-9317ae55baa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:25:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b8aab441-e6ed-4b96-9210-e374bf7d8f4b req-f042e34c-33eb-4a44-8acf-462d0e89bfd2 service nova] Lock "d40e6f31-1df9-4af5-8a34-9317ae55baa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:25:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b8aab441-e6ed-4b96-9210-e374bf7d8f4b req-f042e34c-33eb-4a44-8acf-462d0e89bfd2 service nova] Lock "d40e6f31-1df9-4af5-8a34-9317ae55baa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:25:05 user nova-compute[74898]: DEBUG nova.compute.manager [req-b8aab441-e6ed-4b96-9210-e374bf7d8f4b req-f042e34c-33eb-4a44-8acf-462d0e89bfd2 service nova] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] No waiting events found dispatching network-vif-plugged-e398a0eb-e160-4b6f-860f-515f7a39f3f2 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:25:05 user nova-compute[74898]: WARNING nova.compute.manager [req-b8aab441-e6ed-4b96-9210-e374bf7d8f4b req-f042e34c-33eb-4a44-8acf-462d0e89bfd2 service nova] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Received unexpected event network-vif-plugged-e398a0eb-e160-4b6f-860f-515f7a39f3f2 for instance with vm_state building and task_state spawning.
Nov 17 03:25:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:07 user nova-compute[74898]: DEBUG nova.compute.manager [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:25:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:25:07 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Instance spawned successfully.
Nov 17 03:25:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:25:07 user nova-compute[74898]: DEBUG nova.compute.manager [req-ed440c8e-7fb4-4285-9430-b6230b729692 req-2f910f2d-b9f3-4dea-9634-467db254ad03 service nova] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Received event network-vif-plugged-e398a0eb-e160-4b6f-860f-515f7a39f3f2 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:25:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ed440c8e-7fb4-4285-9430-b6230b729692 req-2f910f2d-b9f3-4dea-9634-467db254ad03 service nova] Acquiring lock "d40e6f31-1df9-4af5-8a34-9317ae55baa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:25:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ed440c8e-7fb4-4285-9430-b6230b729692 req-2f910f2d-b9f3-4dea-9634-467db254ad03 service nova] Lock "d40e6f31-1df9-4af5-8a34-9317ae55baa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:25:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ed440c8e-7fb4-4285-9430-b6230b729692 req-2f910f2d-b9f3-4dea-9634-467db254ad03 service nova] Lock "d40e6f31-1df9-4af5-8a34-9317ae55baa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:25:07 user nova-compute[74898]: DEBUG nova.compute.manager [req-ed440c8e-7fb4-4285-9430-b6230b729692 req-2f910f2d-b9f3-4dea-9634-467db254ad03 service nova] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] No waiting events found dispatching network-vif-plugged-e398a0eb-e160-4b6f-860f-515f7a39f3f2 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:25:07 user nova-compute[74898]: WARNING nova.compute.manager [req-ed440c8e-7fb4-4285-9430-b6230b729692 req-2f910f2d-b9f3-4dea-9634-467db254ad03 service nova] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Received unexpected event network-vif-plugged-e398a0eb-e160-4b6f-860f-515f7a39f3f2 for instance with vm_state building and task_state spawning.
Nov 17 03:25:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:25:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:25:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:25:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:25:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:25:07 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:25:07 user nova-compute[74898]: INFO nova.compute.manager [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Took 5.56 seconds to spawn the instance on the hypervisor.
Nov 17 03:25:07 user nova-compute[74898]: DEBUG nova.compute.manager [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:25:07 user nova-compute[74898]: INFO nova.compute.manager [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Took 6.35 seconds to build instance.
Nov 17 03:25:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-40fad0a0-5f3a-47a4-bc9e-e226ecc58ef9 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "d40e6f31-1df9-4af5-8a34-9317ae55baa8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.457s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:25:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b95e1330-07dc-467d-b9af-91159e0338a3 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "6eee4731-60ed-41ab-905e-395aa4d5e568" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:25:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b95e1330-07dc-467d-b9af-91159e0338a3 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "6eee4731-60ed-41ab-905e-395aa4d5e568" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:25:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b95e1330-07dc-467d-b9af-91159e0338a3 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "6eee4731-60ed-41ab-905e-395aa4d5e568-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:25:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b95e1330-07dc-467d-b9af-91159e0338a3 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "6eee4731-60ed-41ab-905e-395aa4d5e568-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:25:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b95e1330-07dc-467d-b9af-91159e0338a3 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "6eee4731-60ed-41ab-905e-395aa4d5e568-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:25:09 user nova-compute[74898]: INFO nova.compute.manager [None req-b95e1330-07dc-467d-b9af-91159e0338a3 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Terminating instance
Nov 17 03:25:09 user nova-compute[74898]: DEBUG nova.compute.manager [None req-b95e1330-07dc-467d-b9af-91159e0338a3 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:25:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:09 user nova-compute[74898]: DEBUG nova.compute.manager [req-4adbee13-c926-4277-8639-686f75c76f33 req-ecc6a086-b128-4a6a-85cf-60c9e6210aa6 service nova] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Received event network-vif-unplugged-88711a2d-c81a-4fb8-991c-9c78fa20755d {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:25:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4adbee13-c926-4277-8639-686f75c76f33 req-ecc6a086-b128-4a6a-85cf-60c9e6210aa6 service nova] Acquiring lock "6eee4731-60ed-41ab-905e-395aa4d5e568-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:25:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4adbee13-c926-4277-8639-686f75c76f33 req-ecc6a086-b128-4a6a-85cf-60c9e6210aa6 service nova] Lock "6eee4731-60ed-41ab-905e-395aa4d5e568-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:25:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4adbee13-c926-4277-8639-686f75c76f33 req-ecc6a086-b128-4a6a-85cf-60c9e6210aa6 service nova] Lock "6eee4731-60ed-41ab-905e-395aa4d5e568-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:25:09 user nova-compute[74898]: DEBUG nova.compute.manager [req-4adbee13-c926-4277-8639-686f75c76f33 req-ecc6a086-b128-4a6a-85cf-60c9e6210aa6 service nova] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] No waiting events found dispatching network-vif-unplugged-88711a2d-c81a-4fb8-991c-9c78fa20755d {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:25:09 user nova-compute[74898]: DEBUG nova.compute.manager [req-4adbee13-c926-4277-8639-686f75c76f33 req-ecc6a086-b128-4a6a-85cf-60c9e6210aa6 service nova] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Received event network-vif-unplugged-88711a2d-c81a-4fb8-991c-9c78fa20755d for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:25:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:09 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Instance destroyed successfully.
Nov 17 03:25:09 user nova-compute[74898]: DEBUG nova.objects.instance [None req-b95e1330-07dc-467d-b9af-91159e0338a3 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lazy-loading 'resources' on Instance uuid 6eee4731-60ed-41ab-905e-395aa4d5e568 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:25:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-b95e1330-07dc-467d-b9af-91159e0338a3 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:15:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1559944',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1559944',id=31,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:15:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0cd941de23248d8ac93b03f930f565f',ramdisk_id='',reservation_id='r-8o5y8dhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-507656828',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:17:43Z,user_data=None,user_id='05397a6b586843338aafbc8a17c6e42c',uuid=6eee4731-60ed-41ab-905e-395aa4d5e568,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88711a2d-c81a-4fb8-991c-9c78fa20755d", "address": "fa:16:3e:5a:2e:19", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88711a2d-c8", "ovs_interfaceid": "88711a2d-c81a-4fb8-991c-9c78fa20755d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:25:09 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-b95e1330-07dc-467d-b9af-91159e0338a3 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Converting VIF {"id": "88711a2d-c81a-4fb8-991c-9c78fa20755d", "address": "fa:16:3e:5a:2e:19", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88711a2d-c8", "ovs_interfaceid": "88711a2d-c81a-4fb8-991c-9c78fa20755d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:25:09 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-b95e1330-07dc-467d-b9af-91159e0338a3 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:2e:19,bridge_name='br-int',has_traffic_filtering=True,id=88711a2d-c81a-4fb8-991c-9c78fa20755d,network=Network(9302cb9a-12f9-4845-b6cc-905f4bf24b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88711a2d-c8') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:25:09 user nova-compute[74898]: DEBUG os_vif [None req-b95e1330-07dc-467d-b9af-91159e0338a3 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:2e:19,bridge_name='br-int',has_traffic_filtering=True,id=88711a2d-c81a-4fb8-991c-9c78fa20755d,network=Network(9302cb9a-12f9-4845-b6cc-905f4bf24b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88711a2d-c8') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:25:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88711a2d-c8, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:25:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:25:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e34ea71-f6b8-4722-84c4-14b2cfcb416d) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:25:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:10 user nova-compute[74898]: INFO os_vif [None req-b95e1330-07dc-467d-b9af-91159e0338a3 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:2e:19,bridge_name='br-int',has_traffic_filtering=True,id=88711a2d-c81a-4fb8-991c-9c78fa20755d,network=Network(9302cb9a-12f9-4845-b6cc-905f4bf24b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88711a2d-c8')
Nov 17 03:25:10 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-b95e1330-07dc-467d-b9af-91159e0338a3 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Deleting instance files /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568_del
Nov 17 03:25:10 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-b95e1330-07dc-467d-b9af-91159e0338a3 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Deletion of /opt/stack/data/nova/instances/6eee4731-60ed-41ab-905e-395aa4d5e568_del complete
Nov 17 03:25:10 user nova-compute[74898]: INFO nova.compute.manager [None req-b95e1330-07dc-467d-b9af-91159e0338a3 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 17 03:25:10 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-b95e1330-07dc-467d-b9af-91159e0338a3 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:25:10 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:25:10 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:25:10 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:25:10 user nova-compute[74898]: DEBUG nova.compute.manager [req-07fb18d0-d66a-416b-bfb6-aee912c2492b req-b9cc4153-4c3f-4ba0-987c-7434dd22ecf0 service nova] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Received event network-vif-deleted-88711a2d-c81a-4fb8-991c-9c78fa20755d {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:25:10 user nova-compute[74898]: INFO nova.compute.manager [req-07fb18d0-d66a-416b-bfb6-aee912c2492b req-b9cc4153-4c3f-4ba0-987c-7434dd22ecf0 service nova] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Neutron deleted interface 88711a2d-c81a-4fb8-991c-9c78fa20755d; detaching it from the instance and deleting it from the info cache
Nov 17 03:25:10 user nova-compute[74898]: DEBUG nova.network.neutron [req-07fb18d0-d66a-416b-bfb6-aee912c2492b req-b9cc4153-4c3f-4ba0-987c-7434dd22ecf0 service nova] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:25:10 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Took 0.49 seconds to deallocate network for instance.
Nov 17 03:25:10 user nova-compute[74898]: DEBUG nova.compute.manager [req-07fb18d0-d66a-416b-bfb6-aee912c2492b req-b9cc4153-4c3f-4ba0-987c-7434dd22ecf0 service nova] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Detach interface failed, port_id=88711a2d-c81a-4fb8-991c-9c78fa20755d, reason: Instance 6eee4731-60ed-41ab-905e-395aa4d5e568 could not be found. {{(pid=74898) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 03:25:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b95e1330-07dc-467d-b9af-91159e0338a3 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:25:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b95e1330-07dc-467d-b9af-91159e0338a3 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:25:10 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-b95e1330-07dc-467d-b9af-91159e0338a3 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:25:10 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-b95e1330-07dc-467d-b9af-91159e0338a3 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:25:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b95e1330-07dc-467d-b9af-91159e0338a3 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.274s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:25:10 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-b95e1330-07dc-467d-b9af-91159e0338a3 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Deleted allocations for instance 6eee4731-60ed-41ab-905e-395aa4d5e568
Nov 17 03:25:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b95e1330-07dc-467d-b9af-91159e0338a3 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "6eee4731-60ed-41ab-905e-395aa4d5e568" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.680s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:25:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-70358e58-b8c0-427c-9c3a-3cc174781552 req-7e9c989f-cfbf-4310-b077-5c01556898f1 service nova] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Received event network-vif-plugged-88711a2d-c81a-4fb8-991c-9c78fa20755d {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:25:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-70358e58-b8c0-427c-9c3a-3cc174781552 req-7e9c989f-cfbf-4310-b077-5c01556898f1 service nova] Acquiring lock "6eee4731-60ed-41ab-905e-395aa4d5e568-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:25:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-70358e58-b8c0-427c-9c3a-3cc174781552 req-7e9c989f-cfbf-4310-b077-5c01556898f1 service nova] Lock "6eee4731-60ed-41ab-905e-395aa4d5e568-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:25:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-70358e58-b8c0-427c-9c3a-3cc174781552 req-7e9c989f-cfbf-4310-b077-5c01556898f1 service nova] Lock "6eee4731-60ed-41ab-905e-395aa4d5e568-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:25:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-70358e58-b8c0-427c-9c3a-3cc174781552 req-7e9c989f-cfbf-4310-b077-5c01556898f1 service nova] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] No waiting events found dispatching network-vif-plugged-88711a2d-c81a-4fb8-991c-9c78fa20755d {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:25:11 user nova-compute[74898]: WARNING nova.compute.manager [req-70358e58-b8c0-427c-9c3a-3cc174781552 req-7e9c989f-cfbf-4310-b077-5c01556898f1 service nova] [instance: 6eee4731-60ed-41ab-905e-395aa4d5e568] Received unexpected event network-vif-plugged-88711a2d-c81a-4fb8-991c-9c78fa20755d for instance with vm_state deleted and task_state None.
Nov 17 03:25:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-996584bc-5b77-4049-8111-a505a8132059 tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Acquiring lock "7c8ddefc-bbda-4f10-bac4-7f82be3f802f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-996584bc-5b77-4049-8111-a505a8132059 tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Lock "7c8ddefc-bbda-4f10-bac4-7f82be3f802f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-996584bc-5b77-4049-8111-a505a8132059 tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Acquiring lock "7c8ddefc-bbda-4f10-bac4-7f82be3f802f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-996584bc-5b77-4049-8111-a505a8132059 tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Lock "7c8ddefc-bbda-4f10-bac4-7f82be3f802f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-996584bc-5b77-4049-8111-a505a8132059 tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Lock "7c8ddefc-bbda-4f10-bac4-7f82be3f802f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:25:12 user nova-compute[74898]: INFO nova.compute.manager [None req-996584bc-5b77-4049-8111-a505a8132059 tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Terminating instance
Nov 17 03:25:12 user nova-compute[74898]: DEBUG nova.compute.manager [None req-996584bc-5b77-4049-8111-a505a8132059 tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG nova.compute.manager [req-5aba31fb-0b6a-4fbc-8bfe-e8bf75d878d2 req-82e00b4a-bcbc-42e8-ba11-864470c9b0bb service nova] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Received event network-vif-unplugged-118abb8a-a6b9-489b-af83-d659253c60d2 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5aba31fb-0b6a-4fbc-8bfe-e8bf75d878d2 req-82e00b4a-bcbc-42e8-ba11-864470c9b0bb service nova] Acquiring lock "7c8ddefc-bbda-4f10-bac4-7f82be3f802f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5aba31fb-0b6a-4fbc-8bfe-e8bf75d878d2 req-82e00b4a-bcbc-42e8-ba11-864470c9b0bb service nova] Lock "7c8ddefc-bbda-4f10-bac4-7f82be3f802f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5aba31fb-0b6a-4fbc-8bfe-e8bf75d878d2 req-82e00b4a-bcbc-42e8-ba11-864470c9b0bb service nova] Lock "7c8ddefc-bbda-4f10-bac4-7f82be3f802f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG nova.compute.manager [req-5aba31fb-0b6a-4fbc-8bfe-e8bf75d878d2 req-82e00b4a-bcbc-42e8-ba11-864470c9b0bb service nova] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] No waiting events found dispatching network-vif-unplugged-118abb8a-a6b9-489b-af83-d659253c60d2 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG nova.compute.manager [req-5aba31fb-0b6a-4fbc-8bfe-e8bf75d878d2 req-82e00b4a-bcbc-42e8-ba11-864470c9b0bb service nova] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Received event network-vif-unplugged-118abb8a-a6b9-489b-af83-d659253c60d2 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG nova.compute.manager [req-5aba31fb-0b6a-4fbc-8bfe-e8bf75d878d2 req-82e00b4a-bcbc-42e8-ba11-864470c9b0bb service nova] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Received event network-vif-plugged-118abb8a-a6b9-489b-af83-d659253c60d2 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5aba31fb-0b6a-4fbc-8bfe-e8bf75d878d2 req-82e00b4a-bcbc-42e8-ba11-864470c9b0bb service nova] Acquiring lock "7c8ddefc-bbda-4f10-bac4-7f82be3f802f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5aba31fb-0b6a-4fbc-8bfe-e8bf75d878d2 req-82e00b4a-bcbc-42e8-ba11-864470c9b0bb service nova] Lock "7c8ddefc-bbda-4f10-bac4-7f82be3f802f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5aba31fb-0b6a-4fbc-8bfe-e8bf75d878d2 req-82e00b4a-bcbc-42e8-ba11-864470c9b0bb service nova] Lock "7c8ddefc-bbda-4f10-bac4-7f82be3f802f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG nova.compute.manager [req-5aba31fb-0b6a-4fbc-8bfe-e8bf75d878d2 req-82e00b4a-bcbc-42e8-ba11-864470c9b0bb service nova] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] No waiting events found dispatching network-vif-plugged-118abb8a-a6b9-489b-af83-d659253c60d2 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:25:12 user nova-compute[74898]: WARNING nova.compute.manager [req-5aba31fb-0b6a-4fbc-8bfe-e8bf75d878d2 req-82e00b4a-bcbc-42e8-ba11-864470c9b0bb service nova] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Received unexpected event network-vif-plugged-118abb8a-a6b9-489b-af83-d659253c60d2 for instance with vm_state active and task_state deleting.
Nov 17 03:25:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:12 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Instance destroyed successfully.
Nov 17 03:25:12 user nova-compute[74898]: DEBUG nova.objects.instance [None req-996584bc-5b77-4049-8111-a505a8132059 tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Lazy-loading 'resources' on Instance uuid 7c8ddefc-bbda-4f10-bac4-7f82be3f802f {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-996584bc-5b77-4049-8111-a505a8132059 tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:23:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1794727982',display_name='tempest-VolumesActionsTest-instance-1794727982',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1794727982',id=37,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:23:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9795de0c02b4436da1fac5b8cc847818',ramdisk_id='',reservation_id='r-57yu0ywq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1147633224',owner_user_name='tempest-VolumesActionsTest-1147633224-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:23:21Z,user_data=None,user_id='13208fa3ffc242e8a34887824391a6bf',uuid=7c8ddefc-bbda-4f10-bac4-7f82be3f802f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "118abb8a-a6b9-489b-af83-d659253c60d2", "address": "fa:16:3e:49:be:2d", "network": {"id": "de39b2ff-813f-41bd-9387-acd359bb8e9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-34116215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9795de0c02b4436da1fac5b8cc847818", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap118abb8a-a6", "ovs_interfaceid": "118abb8a-a6b9-489b-af83-d659253c60d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-996584bc-5b77-4049-8111-a505a8132059 tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Converting VIF {"id": "118abb8a-a6b9-489b-af83-d659253c60d2", "address": "fa:16:3e:49:be:2d", "network": {"id": "de39b2ff-813f-41bd-9387-acd359bb8e9b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-34116215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9795de0c02b4436da1fac5b8cc847818", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap118abb8a-a6", "ovs_interfaceid": "118abb8a-a6b9-489b-af83-d659253c60d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-996584bc-5b77-4049-8111-a505a8132059 tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:be:2d,bridge_name='br-int',has_traffic_filtering=True,id=118abb8a-a6b9-489b-af83-d659253c60d2,network=Network(de39b2ff-813f-41bd-9387-acd359bb8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap118abb8a-a6') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG os_vif [None req-996584bc-5b77-4049-8111-a505a8132059 tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:be:2d,bridge_name='br-int',has_traffic_filtering=True,id=118abb8a-a6b9-489b-af83-d659253c60d2,network=Network(de39b2ff-813f-41bd-9387-acd359bb8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap118abb8a-a6') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap118abb8a-a6, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b09aa20-a164-4d5a-ae4e-d72cf2e23e7e) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:12 user nova-compute[74898]: INFO os_vif [None req-996584bc-5b77-4049-8111-a505a8132059 tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:be:2d,bridge_name='br-int',has_traffic_filtering=True,id=118abb8a-a6b9-489b-af83-d659253c60d2,network=Network(de39b2ff-813f-41bd-9387-acd359bb8e9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap118abb8a-a6')
Nov 17 03:25:12 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-996584bc-5b77-4049-8111-a505a8132059 tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Deleting instance files /opt/stack/data/nova/instances/7c8ddefc-bbda-4f10-bac4-7f82be3f802f_del
Nov 17 03:25:12 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-996584bc-5b77-4049-8111-a505a8132059 tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Deletion of /opt/stack/data/nova/instances/7c8ddefc-bbda-4f10-bac4-7f82be3f802f_del complete
Nov 17 03:25:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:12 user nova-compute[74898]: INFO nova.compute.manager [None req-996584bc-5b77-4049-8111-a505a8132059 tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 17 03:25:12 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-996584bc-5b77-4049-8111-a505a8132059 tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:25:12 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:25:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:13 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:25:13 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Took 0.59 seconds to deallocate network for instance.
Nov 17 03:25:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-996584bc-5b77-4049-8111-a505a8132059 tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:25:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-996584bc-5b77-4049-8111-a505a8132059 tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:25:13 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-996584bc-5b77-4049-8111-a505a8132059 tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:25:13 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-996584bc-5b77-4049-8111-a505a8132059 tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:25:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-996584bc-5b77-4049-8111-a505a8132059 tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:25:13 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-996584bc-5b77-4049-8111-a505a8132059 tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Deleted allocations for instance 7c8ddefc-bbda-4f10-bac4-7f82be3f802f
Nov 17 03:25:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-996584bc-5b77-4049-8111-a505a8132059 tempest-VolumesActionsTest-1147633224 tempest-VolumesActionsTest-1147633224-project-member] Lock "7c8ddefc-bbda-4f10-bac4-7f82be3f802f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.922s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:25:14 user nova-compute[74898]: DEBUG nova.compute.manager [req-d079ca4b-7608-4a49-b39e-3df3a6d71011 req-962a8bb2-df6b-4465-b808-b1386282ca57 service nova] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Received event network-vif-plugged-118abb8a-a6b9-489b-af83-d659253c60d2 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:25:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d079ca4b-7608-4a49-b39e-3df3a6d71011 req-962a8bb2-df6b-4465-b808-b1386282ca57 service nova] Acquiring lock "7c8ddefc-bbda-4f10-bac4-7f82be3f802f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:25:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d079ca4b-7608-4a49-b39e-3df3a6d71011 req-962a8bb2-df6b-4465-b808-b1386282ca57 service nova] Lock "7c8ddefc-bbda-4f10-bac4-7f82be3f802f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:25:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d079ca4b-7608-4a49-b39e-3df3a6d71011 req-962a8bb2-df6b-4465-b808-b1386282ca57 service nova] Lock "7c8ddefc-bbda-4f10-bac4-7f82be3f802f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:25:14 user nova-compute[74898]: DEBUG nova.compute.manager [req-d079ca4b-7608-4a49-b39e-3df3a6d71011 req-962a8bb2-df6b-4465-b808-b1386282ca57 service nova] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] No waiting events found dispatching network-vif-plugged-118abb8a-a6b9-489b-af83-d659253c60d2 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:25:14 user nova-compute[74898]: WARNING nova.compute.manager [req-d079ca4b-7608-4a49-b39e-3df3a6d71011 req-962a8bb2-df6b-4465-b808-b1386282ca57 service nova] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Received unexpected event network-vif-plugged-118abb8a-a6b9-489b-af83-d659253c60d2 for instance with vm_state deleted and task_state None.
Nov 17 03:25:14 user nova-compute[74898]: DEBUG nova.compute.manager [req-d079ca4b-7608-4a49-b39e-3df3a6d71011 req-962a8bb2-df6b-4465-b808-b1386282ca57 service nova] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Received event network-vif-plugged-118abb8a-a6b9-489b-af83-d659253c60d2 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:25:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d079ca4b-7608-4a49-b39e-3df3a6d71011 req-962a8bb2-df6b-4465-b808-b1386282ca57 service nova] Acquiring lock "7c8ddefc-bbda-4f10-bac4-7f82be3f802f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:25:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d079ca4b-7608-4a49-b39e-3df3a6d71011 req-962a8bb2-df6b-4465-b808-b1386282ca57 service nova] Lock "7c8ddefc-bbda-4f10-bac4-7f82be3f802f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:25:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d079ca4b-7608-4a49-b39e-3df3a6d71011 req-962a8bb2-df6b-4465-b808-b1386282ca57 service nova] Lock "7c8ddefc-bbda-4f10-bac4-7f82be3f802f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:25:14 user nova-compute[74898]: DEBUG nova.compute.manager [req-d079ca4b-7608-4a49-b39e-3df3a6d71011 req-962a8bb2-df6b-4465-b808-b1386282ca57 service nova] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] No waiting events found dispatching network-vif-plugged-118abb8a-a6b9-489b-af83-d659253c60d2 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:25:14 user nova-compute[74898]: WARNING nova.compute.manager [req-d079ca4b-7608-4a49-b39e-3df3a6d71011 req-962a8bb2-df6b-4465-b808-b1386282ca57 service nova] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Received unexpected event network-vif-plugged-118abb8a-a6b9-489b-af83-d659253c60d2 for instance with vm_state deleted and task_state None.
Nov 17 03:25:14 user nova-compute[74898]: DEBUG nova.compute.manager [req-d079ca4b-7608-4a49-b39e-3df3a6d71011 req-962a8bb2-df6b-4465-b808-b1386282ca57 service nova] [instance: 7c8ddefc-bbda-4f10-bac4-7f82be3f802f] Received event network-vif-deleted-118abb8a-a6b9-489b-af83-d659253c60d2 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:25:16 user nova-compute[74898]: DEBUG nova.compute.manager [req-546fabae-ce7e-49c7-ba07-3a411065be87 req-0ec598ab-2e07-4577-8b65-f23dc516e8f3 service nova] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Received event network-changed-f0c366b9-5d08-44b5-96e6-43a5c39fa844 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:25:16 user nova-compute[74898]: DEBUG nova.compute.manager [req-546fabae-ce7e-49c7-ba07-3a411065be87 req-0ec598ab-2e07-4577-8b65-f23dc516e8f3 service nova] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Refreshing instance network info cache due to event network-changed-f0c366b9-5d08-44b5-96e6-43a5c39fa844. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:25:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-546fabae-ce7e-49c7-ba07-3a411065be87 req-0ec598ab-2e07-4577-8b65-f23dc516e8f3 service nova] Acquiring lock "refresh_cache-d85e6107-2833-4537-8705-2c5b78fd7ab4" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:25:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-546fabae-ce7e-49c7-ba07-3a411065be87 req-0ec598ab-2e07-4577-8b65-f23dc516e8f3 service nova] Acquired lock "refresh_cache-d85e6107-2833-4537-8705-2c5b78fd7ab4" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:25:16 user nova-compute[74898]: DEBUG nova.network.neutron [req-546fabae-ce7e-49c7-ba07-3a411065be87 req-0ec598ab-2e07-4577-8b65-f23dc516e8f3 service nova] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Refreshing network info cache for port f0c366b9-5d08-44b5-96e6-43a5c39fa844 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:25:17 user nova-compute[74898]: DEBUG nova.network.neutron [req-546fabae-ce7e-49c7-ba07-3a411065be87 req-0ec598ab-2e07-4577-8b65-f23dc516e8f3 service nova] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Updated VIF entry in instance network info cache for port f0c366b9-5d08-44b5-96e6-43a5c39fa844. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:25:17 user nova-compute[74898]: DEBUG nova.network.neutron [req-546fabae-ce7e-49c7-ba07-3a411065be87 req-0ec598ab-2e07-4577-8b65-f23dc516e8f3 service nova] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Updating instance_info_cache with network_info: [{"id": "f0c366b9-5d08-44b5-96e6-43a5c39fa844", "address": "fa:16:3e:0b:b5:5c", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c366b9-5d", "ovs_interfaceid": "f0c366b9-5d08-44b5-96e6-43a5c39fa844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:25:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-546fabae-ce7e-49c7-ba07-3a411065be87 req-0ec598ab-2e07-4577-8b65-f23dc516e8f3 service nova] Releasing lock "refresh_cache-d85e6107-2833-4537-8705-2c5b78fd7ab4" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:25:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "d85e6107-2833-4537-8705-2c5b78fd7ab4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:25:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "d85e6107-2833-4537-8705-2c5b78fd7ab4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:25:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "d85e6107-2833-4537-8705-2c5b78fd7ab4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:25:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "d85e6107-2833-4537-8705-2c5b78fd7ab4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:25:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "d85e6107-2833-4537-8705-2c5b78fd7ab4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:25:17 user nova-compute[74898]: INFO nova.compute.manager [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Terminating instance
Nov 17 03:25:17 user nova-compute[74898]: DEBUG nova.compute.manager [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:25:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:18 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Instance destroyed successfully.
Nov 17 03:25:18 user nova-compute[74898]: DEBUG nova.objects.instance [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lazy-loading 'resources' on Instance uuid d85e6107-2833-4537-8705-2c5b78fd7ab4 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1264517637',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1264517637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1264517637',id=38,image_ref='971ef405-cb3f-4052-9862-aeee8217da7d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLUe+AD2G/cc5zpzxU9H6WTelTVsj/zObcSbjJ2HaVfnwup3vPsUr17do1HOTIcCnui7w6dMa1KatUbIQ71P7ZB9c1VnprR6RRBZDT+J25o0scXh8ukWfFQhisD727GWg==',key_name='tempest-keypair-1837606644',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:23:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d36087cc8e842c0bfcae89553fb9841',ramdisk_id='',reservation_id='r-5hgrzowc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1382126375',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1382126375-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1382126375',owner_user_name='tempest-TestVolumeBootPattern-1382126375-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:23:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa779a5f98394629b6b9fa9d04233e7a',uuid=d85e6107-2833-4537-8705-2c5b78fd7ab4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0c366b9-5d08-44b5-96e6-43a5c39fa844", "address": "fa:16:3e:0b:b5:5c", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c366b9-5d", "ovs_interfaceid": "f0c366b9-5d08-44b5-96e6-43a5c39fa844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converting VIF {"id": "f0c366b9-5d08-44b5-96e6-43a5c39fa844", "address": "fa:16:3e:0b:b5:5c", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c366b9-5d", "ovs_interfaceid": "f0c366b9-5d08-44b5-96e6-43a5c39fa844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:b5:5c,bridge_name='br-int',has_traffic_filtering=True,id=f0c366b9-5d08-44b5-96e6-43a5c39fa844,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0c366b9-5d') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG os_vif [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:b5:5c,bridge_name='br-int',has_traffic_filtering=True,id=f0c366b9-5d08-44b5-96e6-43a5c39fa844,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0c366b9-5d') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0c366b9-5d, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6099f42f-d534-44af-9c88-6c62fbcbfed6) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:25:18 user nova-compute[74898]: INFO os_vif [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:b5:5c,bridge_name='br-int',has_traffic_filtering=True,id=f0c366b9-5d08-44b5-96e6-43a5c39fa844,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0c366b9-5d')
Nov 17 03:25:18 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'voakPDxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:25:18 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:25:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[353a8149-b845-4476-8964-2faabaaecc7c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:25:18 user nova-compute[74898]: No targets found.
Nov 17 03:25:18 user nova-compute[74898]: iSNS:
Nov 17 03:25:18 user nova-compute[74898]: No targets found.
Nov 17 03:25:18 user nova-compute[74898]: STATIC:
Nov 17 03:25:18 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9
Nov 17 03:25:18 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:25:18 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:25:18 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4
Nov 17 03:25:18 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:25:18 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:25:18 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29
Nov 17 03:25:18 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:25:18 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:25:18 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688
Nov 17 03:25:18 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:25:18 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:25:18 user nova-compute[74898]: FIRMWARE:
Nov 17 03:25:18 user nova-compute[74898]: No targets found.
Nov 17 03:25:18 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:25:18 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:25:18 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9dc04e5-b2f4-42a2-bee5-4b3cafdc254b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51dde88-2aae-4d13-a1fb-0a199287ff78]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:25:18 user nova-compute[74898]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 (non-flash)
Nov 17 03:25:18 user nova-compute[74898]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 (non-flash)
Nov 17 03:25:18 user nova-compute[74898]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 (non-flash)
Nov 17 03:25:18 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:25:18 user nova-compute[74898]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 (non-flash)
Nov 17 03:25:18 user nova-compute[74898]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 (non-flash)
Nov 17 03:25:18 user nova-compute[74898]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 (non-flash)
Nov 17 03:25:18 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf859e830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29'): ({'sdd'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Removing single pathed devices sdd {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64fa5a2-363e-465d-a9d6-7f7f954e5bea]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[954bc33f-a438-45da-ba87-40b4b012cdc3]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Flushing IO for device /dev/sdd {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4e36e7-84c2-4ed7-bfe9-10c55aeccb37]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.061s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4950337-e8cc-4665-85a2-73cfad94ca25]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] SCSI volumes sdd have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.041s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3468f5-aa84-4235-aa63-7f2d7986ebf0]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[909ba077-231b-4ccf-a9a4-d6fafcde08c6]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29, portal: 172.16.0.220,3260]
Nov 17 03:25:18 user nova-compute[74898]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29, portal: 172.16.0.220,3260] successful.
Nov 17 03:25:18 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:816793e9-8a25-499b-a521-c9f121bb0e29 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa877b4-a63b-46e2-8478-75eaaf8e922d]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] <== disconnect_volume: return (339ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:25:18 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Deleting instance files /opt/stack/data/nova/instances/d85e6107-2833-4537-8705-2c5b78fd7ab4_del
Nov 17 03:25:18 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Deletion of /opt/stack/data/nova/instances/d85e6107-2833-4537-8705-2c5b78fd7ab4_del complete
Nov 17 03:25:18 user nova-compute[74898]: INFO nova.compute.manager [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG nova.compute.manager [req-90199f4e-4e37-4459-8b9f-89734b93e0b2 req-c54037e5-ca7e-472f-8282-b29bd04093b7 service nova] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Received event network-vif-unplugged-f0c366b9-5d08-44b5-96e6-43a5c39fa844 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90199f4e-4e37-4459-8b9f-89734b93e0b2 req-c54037e5-ca7e-472f-8282-b29bd04093b7 service nova] Acquiring lock "d85e6107-2833-4537-8705-2c5b78fd7ab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90199f4e-4e37-4459-8b9f-89734b93e0b2 req-c54037e5-ca7e-472f-8282-b29bd04093b7 service nova] Lock "d85e6107-2833-4537-8705-2c5b78fd7ab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90199f4e-4e37-4459-8b9f-89734b93e0b2 req-c54037e5-ca7e-472f-8282-b29bd04093b7 service nova] Lock "d85e6107-2833-4537-8705-2c5b78fd7ab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG nova.compute.manager [req-90199f4e-4e37-4459-8b9f-89734b93e0b2 req-c54037e5-ca7e-472f-8282-b29bd04093b7 service nova] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] No waiting events found dispatching network-vif-unplugged-f0c366b9-5d08-44b5-96e6-43a5c39fa844 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG nova.compute.manager [req-90199f4e-4e37-4459-8b9f-89734b93e0b2 req-c54037e5-ca7e-472f-8282-b29bd04093b7 service nova] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Received event network-vif-unplugged-f0c366b9-5d08-44b5-96e6-43a5c39fa844 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG nova.compute.manager [req-90199f4e-4e37-4459-8b9f-89734b93e0b2 req-c54037e5-ca7e-472f-8282-b29bd04093b7 service nova] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Received event network-vif-plugged-f0c366b9-5d08-44b5-96e6-43a5c39fa844 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90199f4e-4e37-4459-8b9f-89734b93e0b2 req-c54037e5-ca7e-472f-8282-b29bd04093b7 service nova] Acquiring lock "d85e6107-2833-4537-8705-2c5b78fd7ab4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90199f4e-4e37-4459-8b9f-89734b93e0b2 req-c54037e5-ca7e-472f-8282-b29bd04093b7 service nova] Lock "d85e6107-2833-4537-8705-2c5b78fd7ab4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-90199f4e-4e37-4459-8b9f-89734b93e0b2 req-c54037e5-ca7e-472f-8282-b29bd04093b7 service nova] Lock "d85e6107-2833-4537-8705-2c5b78fd7ab4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:25:18 user nova-compute[74898]: DEBUG nova.compute.manager [req-90199f4e-4e37-4459-8b9f-89734b93e0b2 req-c54037e5-ca7e-472f-8282-b29bd04093b7 service nova] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] No waiting events found dispatching network-vif-plugged-f0c366b9-5d08-44b5-96e6-43a5c39fa844 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:25:18 user nova-compute[74898]: WARNING nova.compute.manager [req-90199f4e-4e37-4459-8b9f-89734b93e0b2 req-c54037e5-ca7e-472f-8282-b29bd04093b7 service nova] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Received unexpected event network-vif-plugged-f0c366b9-5d08-44b5-96e6-43a5c39fa844 for instance with vm_state active and task_state deleting.
Nov 17 03:25:19 user nova-compute[74898]: DEBUG nova.compute.manager [req-49d042fc-18a5-44b4-a61d-5d60f3e797ac req-95bcd1b2-119d-4bb1-b3f4-cdddd7bfaa39 service nova] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Received event network-vif-deleted-f0c366b9-5d08-44b5-96e6-43a5c39fa844 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:25:19 user nova-compute[74898]: INFO nova.compute.manager [req-49d042fc-18a5-44b4-a61d-5d60f3e797ac req-95bcd1b2-119d-4bb1-b3f4-cdddd7bfaa39 service nova] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Neutron deleted interface f0c366b9-5d08-44b5-96e6-43a5c39fa844; detaching it from the instance and deleting it from the info cache
Nov 17 03:25:19 user nova-compute[74898]: DEBUG nova.network.neutron [req-49d042fc-18a5-44b4-a61d-5d60f3e797ac req-95bcd1b2-119d-4bb1-b3f4-cdddd7bfaa39 service nova] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:25:19 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:25:19 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Took 0.70 seconds to deallocate network for instance.
Nov 17 03:25:19 user nova-compute[74898]: DEBUG nova.compute.manager [req-49d042fc-18a5-44b4-a61d-5d60f3e797ac req-95bcd1b2-119d-4bb1-b3f4-cdddd7bfaa39 service nova] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Detach interface failed, port_id=f0c366b9-5d08-44b5-96e6-43a5c39fa844, reason: Instance d85e6107-2833-4537-8705-2c5b78fd7ab4 could not be found. {{(pid=74898) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 03:25:20 user nova-compute[74898]: INFO nova.compute.manager [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Took 0.79 seconds to detach 1 volumes for instance.
Nov 17 03:25:20 user nova-compute[74898]: DEBUG nova.compute.manager [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: d85e6107-2833-4537-8705-2c5b78fd7ab4] Deleting volume: 816793e9-8a25-499b-a521-c9f121bb0e29 {{(pid=74898) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 17 03:25:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:25:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:25:20 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:25:20 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:25:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:25:20 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Deleted allocations for instance d85e6107-2833-4537-8705-2c5b78fd7ab4
Nov 17 03:25:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-8257d88c-0bb3-4681-aa8e-5f5edd72fe60 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "d85e6107-2833-4537-8705-2c5b78fd7ab4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.193s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:25:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:32 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:25:32 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:25:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:34 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:25:35 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:25:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:38 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:25:38 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:25:38 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:25:38 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:25:38 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Cleaning up deleted instances {{(pid=74898) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 17 03:25:38 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] There are 0 instances to clean {{(pid=74898) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 17 03:25:39 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:25:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:25:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:25:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:25:39 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:25:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40e6f31-1df9-4af5-8a34-9317ae55baa8/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:25:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40e6f31-1df9-4af5-8a34-9317ae55baa8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:25:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40e6f31-1df9-4af5-8a34-9317ae55baa8/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:25:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40e6f31-1df9-4af5-8a34-9317ae55baa8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:25:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:25:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:25:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:25:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:25:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:25:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:25:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:25:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:25:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:25:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:25:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:25:41 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:25:41 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:25:41 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=8493MB free_disk=25.20806121826172GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:25:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:25:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:25:41 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 13449e5c-809b-4db2-af0b-53f5865eb3a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:25:41 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 24cd7ac4-3724-4189-82a7-ba61ba46097a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:25:41 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 8e4684b2-7234-4a88-8571-89531c5dfa03 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:25:41 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 151bb1e2-b109-4f9c-a85c-bfed05bec7dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:25:41 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance d40e6f31-1df9-4af5-8a34-9317ae55baa8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:25:41 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:25:41 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:25:41 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Refreshing inventories for resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 17 03:25:41 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Updating ProviderTree inventory for provider b743bdc9-a8bb-467c-98c8-06f1954f87df from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 17 03:25:41 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Updating inventory in ProviderTree for provider b743bdc9-a8bb-467c-98c8-06f1954f87df with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 17 03:25:41 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Refreshing aggregate associations for resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df, aggregates: None {{(pid=74898) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 17 03:25:41 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Refreshing trait associations for resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=74898) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 17 03:25:41 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:25:41 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:25:42 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:25:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.583s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:25:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:25:44 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:25:44 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:25:44 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Rebuilding the list of instances to heal {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 03:25:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-13449e5c-809b-4db2-af0b-53f5865eb3a4" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:25:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-13449e5c-809b-4db2-af0b-53f5865eb3a4" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:25:44 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:25:44 user nova-compute[74898]: DEBUG nova.objects.instance [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lazy-loading 'info_cache' on Instance uuid 13449e5c-809b-4db2-af0b-53f5865eb3a4 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:25:44 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Updating instance_info_cache with network_info: [{"id": "2bdfdbe2-b457-4078-b4be-979a51ba442a", "address": "fa:16:3e:a1:96:f0", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdfdbe2-b4", "ovs_interfaceid": "2bdfdbe2-b457-4078-b4be-979a51ba442a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:25:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-13449e5c-809b-4db2-af0b-53f5865eb3a4" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:25:44 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:25:44 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:25:45 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:25:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:48 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:25:48 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Cleaning up deleted instances with incomplete migration  {{(pid=74898) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 17 03:25:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:25:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:25:58 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:25:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "24cd7ac4-3724-4189-82a7-ba61ba46097a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:25:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:25:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:25:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:25:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:25:59 user nova-compute[74898]: INFO nova.compute.manager [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Terminating instance
Nov 17 03:25:59 user nova-compute[74898]: DEBUG nova.compute.manager [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:25:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:25:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG nova.compute.manager [req-f5d57eb4-d416-439f-9ed4-f2a54554ada0 req-c4cab560-41b5-40d0-980f-9aeee4325412 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Received event network-vif-unplugged-b7880813-a5fe-4eb7-b6aa-f91832114171 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f5d57eb4-d416-439f-9ed4-f2a54554ada0 req-c4cab560-41b5-40d0-980f-9aeee4325412 service nova] Acquiring lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f5d57eb4-d416-439f-9ed4-f2a54554ada0 req-c4cab560-41b5-40d0-980f-9aeee4325412 service nova] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f5d57eb4-d416-439f-9ed4-f2a54554ada0 req-c4cab560-41b5-40d0-980f-9aeee4325412 service nova] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG nova.compute.manager [req-f5d57eb4-d416-439f-9ed4-f2a54554ada0 req-c4cab560-41b5-40d0-980f-9aeee4325412 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] No waiting events found dispatching network-vif-unplugged-b7880813-a5fe-4eb7-b6aa-f91832114171 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG nova.compute.manager [req-f5d57eb4-d416-439f-9ed4-f2a54554ada0 req-c4cab560-41b5-40d0-980f-9aeee4325412 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Received event network-vif-unplugged-b7880813-a5fe-4eb7-b6aa-f91832114171 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:00 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Instance destroyed successfully.
Nov 17 03:26:00 user nova-compute[74898]: DEBUG nova.objects.instance [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lazy-loading 'resources' on Instance uuid 24cd7ac4-3724-4189-82a7-ba61ba46097a {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-845758421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-845758421',id=26,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:12:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0cd941de23248d8ac93b03f930f565f',ramdisk_id='',reservation_id='r-nwjpn9ta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-507656828',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:13:59Z,user_data=None,user_id='05397a6b586843338aafbc8a17c6e42c',uuid=24cd7ac4-3724-4189-82a7-ba61ba46097a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7880813-a5fe-4eb7-b6aa-f91832114171", "address": "fa:16:3e:da:6b:da", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7880813-a5", "ovs_interfaceid": "b7880813-a5fe-4eb7-b6aa-f91832114171", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Converting VIF {"id": "b7880813-a5fe-4eb7-b6aa-f91832114171", "address": "fa:16:3e:da:6b:da", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7880813-a5", "ovs_interfaceid": "b7880813-a5fe-4eb7-b6aa-f91832114171", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:6b:da,bridge_name='br-int',has_traffic_filtering=True,id=b7880813-a5fe-4eb7-b6aa-f91832114171,network=Network(9302cb9a-12f9-4845-b6cc-905f4bf24b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7880813-a5') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG os_vif [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:6b:da,bridge_name='br-int',has_traffic_filtering=True,id=b7880813-a5fe-4eb7-b6aa-f91832114171,network=Network(9302cb9a-12f9-4845-b6cc-905f4bf24b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7880813-a5') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7880813-a5, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95577dfa-cb49-42a7-b6bd-a686aca048d7) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:26:00 user nova-compute[74898]: INFO os_vif [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:6b:da,bridge_name='br-int',has_traffic_filtering=True,id=b7880813-a5fe-4eb7-b6aa-f91832114171,network=Network(9302cb9a-12f9-4845-b6cc-905f4bf24b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7880813-a5')
Nov 17 03:26:00 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBNRsapG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:26:00 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:26:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb319ec-97f9-451c-a41c-e66a45d3a36c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:26:00 user nova-compute[74898]: No targets found.
Nov 17 03:26:00 user nova-compute[74898]: iSNS:
Nov 17 03:26:00 user nova-compute[74898]: No targets found.
Nov 17 03:26:00 user nova-compute[74898]: STATIC:
Nov 17 03:26:00 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9
Nov 17 03:26:00 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:26:00 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:26:00 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4
Nov 17 03:26:00 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:26:00 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:26:00 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688
Nov 17 03:26:00 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:26:00 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:26:00 user nova-compute[74898]: FIRMWARE:
Nov 17 03:26:00 user nova-compute[74898]: No targets found.
Nov 17 03:26:00 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:26:00 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:26:00 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[18777022-05c3-450f-82e9-8645524131c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbf4b94-d1f3-4377-93ad-f7e846b0b9b7]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:26:00 user nova-compute[74898]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 (non-flash)
Nov 17 03:26:00 user nova-compute[74898]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 (non-flash)
Nov 17 03:26:00 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 (non-flash)
Nov 17 03:26:00 user nova-compute[74898]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 (non-flash)
Nov 17 03:26:00 user nova-compute[74898]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 (non-flash)
Nov 17 03:26:00 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf86c8ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4'): ({'sdc'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Removing single pathed devices sdc {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85dbbb2-17a5-469f-8a28-8aff696a423c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f2e598-abb0-4636-a3df-c5e084a8c3a6]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Flushing IO for device /dev/sdc {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b9a43c-076c-43aa-9737-22f9dda1c837]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c73f99-c2e0-4ac4-afc5-20fc3247b8c6]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] SCSI volumes sdc have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5f94f6-f3d5-4d48-ba2a-a7b6ddad725c]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9aae162-b06a-4c29-bc97-2ca6944edacd]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4, portal: 172.16.0.220,3260]
Nov 17 03:26:00 user nova-compute[74898]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4, portal: 172.16.0.220,3260] successful.
Nov 17 03:26:00 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fb5ccfe-dee8-432b-a09a-7a6cc1b740f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e48e23-8d7a-497b-910b-2175bec42da5]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] <== disconnect_volume: return (308ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:26:00 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Deleting instance files /opt/stack/data/nova/instances/24cd7ac4-3724-4189-82a7-ba61ba46097a_del
Nov 17 03:26:00 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Deletion of /opt/stack/data/nova/instances/24cd7ac4-3724-4189-82a7-ba61ba46097a_del complete
Nov 17 03:26:00 user nova-compute[74898]: INFO nova.compute.manager [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 17 03:26:00 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:26:00 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:26:01 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:26:01 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Took 0.45 seconds to deallocate network for instance.
Nov 17 03:26:02 user nova-compute[74898]: INFO nova.compute.manager [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Took 0.75 seconds to detach 1 volumes for instance.
Nov 17 03:26:02 user nova-compute[74898]: DEBUG nova.compute.manager [req-47a741f2-ba3b-42db-b3e0-672885454751 req-d83661a9-64ba-46c1-97fb-81001c0d10c4 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Received event network-vif-plugged-b7880813-a5fe-4eb7-b6aa-f91832114171 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:26:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-47a741f2-ba3b-42db-b3e0-672885454751 req-d83661a9-64ba-46c1-97fb-81001c0d10c4 service nova] Acquiring lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:26:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-47a741f2-ba3b-42db-b3e0-672885454751 req-d83661a9-64ba-46c1-97fb-81001c0d10c4 service nova] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:26:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-47a741f2-ba3b-42db-b3e0-672885454751 req-d83661a9-64ba-46c1-97fb-81001c0d10c4 service nova] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:26:02 user nova-compute[74898]: DEBUG nova.compute.manager [req-47a741f2-ba3b-42db-b3e0-672885454751 req-d83661a9-64ba-46c1-97fb-81001c0d10c4 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] No waiting events found dispatching network-vif-plugged-b7880813-a5fe-4eb7-b6aa-f91832114171 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:26:02 user nova-compute[74898]: WARNING nova.compute.manager [req-47a741f2-ba3b-42db-b3e0-672885454751 req-d83661a9-64ba-46c1-97fb-81001c0d10c4 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Received unexpected event network-vif-plugged-b7880813-a5fe-4eb7-b6aa-f91832114171 for instance with vm_state active and task_state deleting.
Nov 17 03:26:02 user nova-compute[74898]: DEBUG nova.compute.manager [req-47a741f2-ba3b-42db-b3e0-672885454751 req-d83661a9-64ba-46c1-97fb-81001c0d10c4 service nova] [instance: 24cd7ac4-3724-4189-82a7-ba61ba46097a] Received event network-vif-deleted-b7880813-a5fe-4eb7-b6aa-f91832114171 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:26:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:26:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:26:02 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:26:02 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:26:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:26:02 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Deleted allocations for instance 24cd7ac4-3724-4189-82a7-ba61ba46097a
Nov 17 03:26:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-fa766aac-6cb4-4a76-ae6b-4935c7285352 tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "24cd7ac4-3724-4189-82a7-ba61ba46097a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.882s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:26:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:26:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "8e4684b2-7234-4a88-8571-89531c5dfa03" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:26:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "8e4684b2-7234-4a88-8571-89531c5dfa03" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:26:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "8e4684b2-7234-4a88-8571-89531c5dfa03-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:26:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "8e4684b2-7234-4a88-8571-89531c5dfa03-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:26:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "8e4684b2-7234-4a88-8571-89531c5dfa03-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:26:11 user nova-compute[74898]: INFO nova.compute.manager [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Terminating instance
Nov 17 03:26:11 user nova-compute[74898]: DEBUG nova.compute.manager [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:26:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-88fd3769-722c-4543-bfec-ca545f7c398b req-0d0425c9-c148-4d9b-9960-0bd2ee8b1c89 service nova] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Received event network-vif-unplugged-c22de465-9b25-416b-bd4a-ff729ce99a18 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:26:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-88fd3769-722c-4543-bfec-ca545f7c398b req-0d0425c9-c148-4d9b-9960-0bd2ee8b1c89 service nova] Acquiring lock "8e4684b2-7234-4a88-8571-89531c5dfa03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:26:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-88fd3769-722c-4543-bfec-ca545f7c398b req-0d0425c9-c148-4d9b-9960-0bd2ee8b1c89 service nova] Lock "8e4684b2-7234-4a88-8571-89531c5dfa03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:26:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-88fd3769-722c-4543-bfec-ca545f7c398b req-0d0425c9-c148-4d9b-9960-0bd2ee8b1c89 service nova] Lock "8e4684b2-7234-4a88-8571-89531c5dfa03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:26:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-88fd3769-722c-4543-bfec-ca545f7c398b req-0d0425c9-c148-4d9b-9960-0bd2ee8b1c89 service nova] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] No waiting events found dispatching network-vif-unplugged-c22de465-9b25-416b-bd4a-ff729ce99a18 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:26:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-88fd3769-722c-4543-bfec-ca545f7c398b req-0d0425c9-c148-4d9b-9960-0bd2ee8b1c89 service nova] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Received event network-vif-unplugged-c22de465-9b25-416b-bd4a-ff729ce99a18 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:26:11 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Instance destroyed successfully.
Nov 17 03:26:11 user nova-compute[74898]: DEBUG nova.objects.instance [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lazy-loading 'resources' on Instance uuid 8e4684b2-7234-4a88-8571-89531c5dfa03 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:26:11 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:21:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1829241204',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1829241204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1829241204',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAl233q3wHnChV0W9PwAfb8a+wLbKkGcMRHcHBfnbAXkdTBDb5aUR1KJFzi+8lgjjf8XFm7uP7VVfgifmAIIeTbf1o/HZAR0MKbTm5hgGGpiwPw0pAMtX5yZin46WyqtZg==',key_name='tempest-keypair-695375565',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:21:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d36087cc8e842c0bfcae89553fb9841',ramdisk_id='',reservation_id='r-8k7r8kfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1382126375',owner_user_name='tempest-TestVolumeBootPattern-1382126375-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:21:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa779a5f98394629b6b9fa9d04233e7a',uuid=8e4684b2-7234-4a88-8571-89531c5dfa03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c22de465-9b25-416b-bd4a-ff729ce99a18", "address": "fa:16:3e:f0:01:60", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22de465-9b", "ovs_interfaceid": "c22de465-9b25-416b-bd4a-ff729ce99a18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:26:11 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converting VIF {"id": "c22de465-9b25-416b-bd4a-ff729ce99a18", "address": "fa:16:3e:f0:01:60", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22de465-9b", "ovs_interfaceid": "c22de465-9b25-416b-bd4a-ff729ce99a18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:26:11 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:01:60,bridge_name='br-int',has_traffic_filtering=True,id=c22de465-9b25-416b-bd4a-ff729ce99a18,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc22de465-9b') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:26:11 user nova-compute[74898]: DEBUG os_vif [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:01:60,bridge_name='br-int',has_traffic_filtering=True,id=c22de465-9b25-416b-bd4a-ff729ce99a18,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc22de465-9b') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:26:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc22de465-9b, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:26:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:26:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d840383e-65f1-4066-823d-0185f0f51319) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:26:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:26:11 user nova-compute[74898]: INFO os_vif [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:01:60,bridge_name='br-int',has_traffic_filtering=True,id=c22de465-9b25-416b-bd4a-ff729ce99a18,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc22de465-9b')
Nov 17 03:26:12 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QZsoXivM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:26:12 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:26:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f4b92e-774a-4db5-9660-f6601f85bac2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:26:12 user nova-compute[74898]: No targets found.
Nov 17 03:26:12 user nova-compute[74898]: iSNS:
Nov 17 03:26:12 user nova-compute[74898]: No targets found.
Nov 17 03:26:12 user nova-compute[74898]: STATIC:
Nov 17 03:26:12 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9
Nov 17 03:26:12 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:26:12 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:26:12 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688
Nov 17 03:26:12 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:26:12 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:26:12 user nova-compute[74898]: FIRMWARE:
Nov 17 03:26:12 user nova-compute[74898]: No targets found.
Nov 17 03:26:12 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:26:12 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:26:12 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62b0845-7e4c-4d46-bec2-8048e717f87c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26dfbef-647d-4e25-a407-70b4f445639b]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 (non-flash)
Nov 17 03:26:12 user nova-compute[74898]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 (non-flash)
Nov 17 03:26:12 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 (non-flash)
Nov 17 03:26:12 user nova-compute[74898]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 (non-flash)
Nov 17 03:26:12 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9c1854c8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9'): ({'sdb'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Removing single pathed devices sdb {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0aaea4-bb1d-4c50-afb3-9076c8d28a39]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84a0f0c-de90-46a8-9242-9f8b6e573dac]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Flushing IO for device /dev/sdb {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec5ebe6-f96a-4f7e-bb50-79a6d61030bb]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8755b0e6-469b-4601-9c6e-3e8c44c062b9]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOab0f9e34-ca1d350012e6f2f7', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ab0f9e34', '/dev/disk/by-id/scsi-26361316433353030') {{(pid=86021) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8c4a35-3e66-48ae-9a43-d8a2aabd0928]: (4, None) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76f3884-d58b-4c28-9505-b72eebd2bc35]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e904b1f2-f642-4f63-bbab-29ab54dd6519]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9, portal: 172.16.0.220,3260]
Nov 17 03:26:12 user nova-compute[74898]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9, portal: 172.16.0.220,3260] successful.
Nov 17 03:26:12 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8615ac1c-89ad-480d-b5c6-1b1eec7765c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[19497c8c-5898-4c45-9a49-7dc4c7d16851]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] <== disconnect_volume: return (293ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:26:12 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Deleting instance files /opt/stack/data/nova/instances/8e4684b2-7234-4a88-8571-89531c5dfa03_del
Nov 17 03:26:12 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Deletion of /opt/stack/data/nova/instances/8e4684b2-7234-4a88-8571-89531c5dfa03_del complete
Nov 17 03:26:12 user nova-compute[74898]: INFO nova.compute.manager [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 17 03:26:12 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:26:12 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:26:13 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:26:13 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Took 1.01 seconds to deallocate network for instance.
Nov 17 03:26:13 user nova-compute[74898]: DEBUG nova.compute.manager [req-7b6f3346-fcf5-4e7c-aabc-3114f7c1eca3 req-f2e18ada-57ef-4ff3-9ccc-fbada0deb0c4 service nova] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Received event network-vif-plugged-c22de465-9b25-416b-bd4a-ff729ce99a18 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:26:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7b6f3346-fcf5-4e7c-aabc-3114f7c1eca3 req-f2e18ada-57ef-4ff3-9ccc-fbada0deb0c4 service nova] Acquiring lock "8e4684b2-7234-4a88-8571-89531c5dfa03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:26:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7b6f3346-fcf5-4e7c-aabc-3114f7c1eca3 req-f2e18ada-57ef-4ff3-9ccc-fbada0deb0c4 service nova] Lock "8e4684b2-7234-4a88-8571-89531c5dfa03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:26:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7b6f3346-fcf5-4e7c-aabc-3114f7c1eca3 req-f2e18ada-57ef-4ff3-9ccc-fbada0deb0c4 service nova] Lock "8e4684b2-7234-4a88-8571-89531c5dfa03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:26:13 user nova-compute[74898]: DEBUG nova.compute.manager [req-7b6f3346-fcf5-4e7c-aabc-3114f7c1eca3 req-f2e18ada-57ef-4ff3-9ccc-fbada0deb0c4 service nova] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] No waiting events found dispatching network-vif-plugged-c22de465-9b25-416b-bd4a-ff729ce99a18 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:26:13 user nova-compute[74898]: WARNING nova.compute.manager [req-7b6f3346-fcf5-4e7c-aabc-3114f7c1eca3 req-f2e18ada-57ef-4ff3-9ccc-fbada0deb0c4 service nova] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Received unexpected event network-vif-plugged-c22de465-9b25-416b-bd4a-ff729ce99a18 for instance with vm_state active and task_state deleting.
Nov 17 03:26:13 user nova-compute[74898]: DEBUG nova.compute.manager [req-46fb1522-7b61-430c-a50f-4b50ba43fad3 req-11aa926c-cd89-4fcf-aa8e-92185a36df91 service nova] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Received event network-vif-deleted-c22de465-9b25-416b-bd4a-ff729ce99a18 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:26:14 user nova-compute[74898]: INFO nova.compute.manager [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Took 0.72 seconds to detach 1 volumes for instance.
Nov 17 03:26:14 user nova-compute[74898]: DEBUG nova.compute.manager [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 8e4684b2-7234-4a88-8571-89531c5dfa03] Deleting volume: 8615ac1c-89ad-480d-b5c6-1b1eec7765c9 {{(pid=74898) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 17 03:26:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:26:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:26:14 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:26:14 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:26:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:26:14 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Deleted allocations for instance 8e4684b2-7234-4a88-8571-89531c5dfa03
Nov 17 03:26:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2839df42-e530-42eb-972d-c2f257684799 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "8e4684b2-7234-4a88-8571-89531c5dfa03" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.487s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:26:16 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:26:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:32 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:26:32 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:26:33 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._sync_power_states {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:26:33 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Triggering sync for uuid 13449e5c-809b-4db2-af0b-53f5865eb3a4 {{(pid=74898) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 03:26:33 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Triggering sync for uuid 151bb1e2-b109-4f9c-a85c-bfed05bec7dd {{(pid=74898) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 03:26:33 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Triggering sync for uuid d40e6f31-1df9-4af5-8a34-9317ae55baa8 {{(pid=74898) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 03:26:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "13449e5c-809b-4db2-af0b-53f5865eb3a4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:26:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "13449e5c-809b-4db2-af0b-53f5865eb3a4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:26:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:26:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:26:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "d40e6f31-1df9-4af5-8a34-9317ae55baa8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:26:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "d40e6f31-1df9-4af5-8a34-9317ae55baa8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:26:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "13449e5c-809b-4db2-af0b-53f5865eb3a4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:26:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:26:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "d40e6f31-1df9-4af5-8a34-9317ae55baa8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:26:36 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:26:36 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:26:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:38 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:26:38 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:26:40 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:26:40 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:26:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:26:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:26:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:26:40 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:26:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:26:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:26:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:26:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:26:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40e6f31-1df9-4af5-8a34-9317ae55baa8/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:26:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40e6f31-1df9-4af5-8a34-9317ae55baa8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:26:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40e6f31-1df9-4af5-8a34-9317ae55baa8/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:26:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d40e6f31-1df9-4af5-8a34-9317ae55baa8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:26:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:26:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:26:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:26:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:26:42 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:26:42 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:26:42 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:26:42 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=8693MB free_disk=25.197582244873047GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:26:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:26:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:26:42 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 13449e5c-809b-4db2-af0b-53f5865eb3a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:26:42 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 151bb1e2-b109-4f9c-a85c-bfed05bec7dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:26:42 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance d40e6f31-1df9-4af5-8a34-9317ae55baa8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:26:42 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:26:42 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:26:42 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:26:42 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:26:42 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:26:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:26:44 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:26:44 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:26:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-151bb1e2-b109-4f9c-a85c-bfed05bec7dd" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:26:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-151bb1e2-b109-4f9c-a85c-bfed05bec7dd" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:26:44 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:26:45 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Updating instance_info_cache with network_info: [{"id": "207dd9ce-91f5-4dcf-b77f-18501d94908c", "address": "fa:16:3e:a9:62:c3", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207dd9ce-91", "ovs_interfaceid": "207dd9ce-91f5-4dcf-b77f-18501d94908c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:26:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-151bb1e2-b109-4f9c-a85c-bfed05bec7dd" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:26:45 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:26:45 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:26:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:26:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c9325ac6-3f31-4c04-8a95-ae45bb2b4c1a tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "13449e5c-809b-4db2-af0b-53f5865eb3a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:26:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c9325ac6-3f31-4c04-8a95-ae45bb2b4c1a tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "13449e5c-809b-4db2-af0b-53f5865eb3a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:26:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c9325ac6-3f31-4c04-8a95-ae45bb2b4c1a tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "13449e5c-809b-4db2-af0b-53f5865eb3a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:26:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c9325ac6-3f31-4c04-8a95-ae45bb2b4c1a tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "13449e5c-809b-4db2-af0b-53f5865eb3a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:26:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c9325ac6-3f31-4c04-8a95-ae45bb2b4c1a tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "13449e5c-809b-4db2-af0b-53f5865eb3a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:26:50 user nova-compute[74898]: INFO nova.compute.manager [None req-c9325ac6-3f31-4c04-8a95-ae45bb2b4c1a tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Terminating instance
Nov 17 03:26:50 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c9325ac6-3f31-4c04-8a95-ae45bb2b4c1a tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:26:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:50 user nova-compute[74898]: DEBUG nova.compute.manager [req-c2066cef-5852-4036-acf9-a6b9bc6f1d41 req-46e359e3-bf71-4542-9552-1d908131adb0 service nova] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Received event network-vif-unplugged-2bdfdbe2-b457-4078-b4be-979a51ba442a {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:26:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c2066cef-5852-4036-acf9-a6b9bc6f1d41 req-46e359e3-bf71-4542-9552-1d908131adb0 service nova] Acquiring lock "13449e5c-809b-4db2-af0b-53f5865eb3a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:26:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c2066cef-5852-4036-acf9-a6b9bc6f1d41 req-46e359e3-bf71-4542-9552-1d908131adb0 service nova] Lock "13449e5c-809b-4db2-af0b-53f5865eb3a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:26:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c2066cef-5852-4036-acf9-a6b9bc6f1d41 req-46e359e3-bf71-4542-9552-1d908131adb0 service nova] Lock "13449e5c-809b-4db2-af0b-53f5865eb3a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:26:50 user nova-compute[74898]: DEBUG nova.compute.manager [req-c2066cef-5852-4036-acf9-a6b9bc6f1d41 req-46e359e3-bf71-4542-9552-1d908131adb0 service nova] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] No waiting events found dispatching network-vif-unplugged-2bdfdbe2-b457-4078-b4be-979a51ba442a {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:26:50 user nova-compute[74898]: DEBUG nova.compute.manager [req-c2066cef-5852-4036-acf9-a6b9bc6f1d41 req-46e359e3-bf71-4542-9552-1d908131adb0 service nova] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Received event network-vif-unplugged-2bdfdbe2-b457-4078-b4be-979a51ba442a for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:26:51 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Instance destroyed successfully.
Nov 17 03:26:51 user nova-compute[74898]: DEBUG nova.objects.instance [None req-c9325ac6-3f31-4c04-8a95-ae45bb2b4c1a tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lazy-loading 'resources' on Instance uuid 13449e5c-809b-4db2-af0b-53f5865eb3a4 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:26:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-c9325ac6-3f31-4c04-8a95-ae45bb2b4c1a tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:07:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-705097225',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-705097225',id=21,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:07:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0cd941de23248d8ac93b03f930f565f',ramdisk_id='',reservation_id='r-yer2px48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-507656828',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:09:10Z,user_data=None,user_id='05397a6b586843338aafbc8a17c6e42c',uuid=13449e5c-809b-4db2-af0b-53f5865eb3a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2bdfdbe2-b457-4078-b4be-979a51ba442a", "address": "fa:16:3e:a1:96:f0", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdfdbe2-b4", "ovs_interfaceid": "2bdfdbe2-b457-4078-b4be-979a51ba442a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:26:51 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-c9325ac6-3f31-4c04-8a95-ae45bb2b4c1a tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Converting VIF {"id": "2bdfdbe2-b457-4078-b4be-979a51ba442a", "address": "fa:16:3e:a1:96:f0", "network": {"id": "9302cb9a-12f9-4845-b6cc-905f4bf24b4a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-981814019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0cd941de23248d8ac93b03f930f565f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bdfdbe2-b4", "ovs_interfaceid": "2bdfdbe2-b457-4078-b4be-979a51ba442a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:26:51 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-c9325ac6-3f31-4c04-8a95-ae45bb2b4c1a tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:96:f0,bridge_name='br-int',has_traffic_filtering=True,id=2bdfdbe2-b457-4078-b4be-979a51ba442a,network=Network(9302cb9a-12f9-4845-b6cc-905f4bf24b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdfdbe2-b4') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:26:51 user nova-compute[74898]: DEBUG os_vif [None req-c9325ac6-3f31-4c04-8a95-ae45bb2b4c1a tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:96:f0,bridge_name='br-int',has_traffic_filtering=True,id=2bdfdbe2-b457-4078-b4be-979a51ba442a,network=Network(9302cb9a-12f9-4845-b6cc-905f4bf24b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdfdbe2-b4') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:26:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2bdfdbe2-b4, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:26:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:26:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db5f09f2-fc18-4522-a52f-49ccd9fb3c95) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:26:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:26:51 user nova-compute[74898]: INFO os_vif [None req-c9325ac6-3f31-4c04-8a95-ae45bb2b4c1a tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:96:f0,bridge_name='br-int',has_traffic_filtering=True,id=2bdfdbe2-b457-4078-b4be-979a51ba442a,network=Network(9302cb9a-12f9-4845-b6cc-905f4bf24b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bdfdbe2-b4')
Nov 17 03:26:51 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-c9325ac6-3f31-4c04-8a95-ae45bb2b4c1a tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Deleting instance files /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4_del
Nov 17 03:26:51 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-c9325ac6-3f31-4c04-8a95-ae45bb2b4c1a tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Deletion of /opt/stack/data/nova/instances/13449e5c-809b-4db2-af0b-53f5865eb3a4_del complete
Nov 17 03:26:51 user nova-compute[74898]: INFO nova.compute.manager [None req-c9325ac6-3f31-4c04-8a95-ae45bb2b4c1a tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 17 03:26:51 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-c9325ac6-3f31-4c04-8a95-ae45bb2b4c1a tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:26:51 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:26:51 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:26:51 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:26:51 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Took 0.63 seconds to deallocate network for instance.
Nov 17 03:26:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c9325ac6-3f31-4c04-8a95-ae45bb2b4c1a tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:26:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c9325ac6-3f31-4c04-8a95-ae45bb2b4c1a tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:26:52 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-c9325ac6-3f31-4c04-8a95-ae45bb2b4c1a tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:26:52 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-c9325ac6-3f31-4c04-8a95-ae45bb2b4c1a tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:26:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c9325ac6-3f31-4c04-8a95-ae45bb2b4c1a tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.289s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:26:52 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-c9325ac6-3f31-4c04-8a95-ae45bb2b4c1a tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Deleted allocations for instance 13449e5c-809b-4db2-af0b-53f5865eb3a4
Nov 17 03:26:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c9325ac6-3f31-4c04-8a95-ae45bb2b4c1a tempest-ServerBootFromVolumeStableRescueTest-507656828 tempest-ServerBootFromVolumeStableRescueTest-507656828-project-member] Lock "13449e5c-809b-4db2-af0b-53f5865eb3a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.816s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:26:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d0db4b76-d67c-4d8d-837d-8cbe898087c4 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "d40e6f31-1df9-4af5-8a34-9317ae55baa8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:26:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d0db4b76-d67c-4d8d-837d-8cbe898087c4 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "d40e6f31-1df9-4af5-8a34-9317ae55baa8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:26:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d0db4b76-d67c-4d8d-837d-8cbe898087c4 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "d40e6f31-1df9-4af5-8a34-9317ae55baa8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:26:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d0db4b76-d67c-4d8d-837d-8cbe898087c4 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "d40e6f31-1df9-4af5-8a34-9317ae55baa8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:26:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d0db4b76-d67c-4d8d-837d-8cbe898087c4 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "d40e6f31-1df9-4af5-8a34-9317ae55baa8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:26:52 user nova-compute[74898]: INFO nova.compute.manager [None req-d0db4b76-d67c-4d8d-837d-8cbe898087c4 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Terminating instance
Nov 17 03:26:52 user nova-compute[74898]: DEBUG nova.compute.manager [None req-d0db4b76-d67c-4d8d-837d-8cbe898087c4 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:26:52 user nova-compute[74898]: DEBUG nova.compute.manager [req-0086f8cf-f876-426f-b5ff-c253e12a7b64 req-58e3295a-2d14-4041-bcf2-cb06b2f72bb2 service nova] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Received event network-vif-plugged-2bdfdbe2-b457-4078-b4be-979a51ba442a {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:26:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0086f8cf-f876-426f-b5ff-c253e12a7b64 req-58e3295a-2d14-4041-bcf2-cb06b2f72bb2 service nova] Acquiring lock "13449e5c-809b-4db2-af0b-53f5865eb3a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:26:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0086f8cf-f876-426f-b5ff-c253e12a7b64 req-58e3295a-2d14-4041-bcf2-cb06b2f72bb2 service nova] Lock "13449e5c-809b-4db2-af0b-53f5865eb3a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:26:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0086f8cf-f876-426f-b5ff-c253e12a7b64 req-58e3295a-2d14-4041-bcf2-cb06b2f72bb2 service nova] Lock "13449e5c-809b-4db2-af0b-53f5865eb3a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:26:52 user nova-compute[74898]: DEBUG nova.compute.manager [req-0086f8cf-f876-426f-b5ff-c253e12a7b64 req-58e3295a-2d14-4041-bcf2-cb06b2f72bb2 service nova] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] No waiting events found dispatching network-vif-plugged-2bdfdbe2-b457-4078-b4be-979a51ba442a {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:26:52 user nova-compute[74898]: WARNING nova.compute.manager [req-0086f8cf-f876-426f-b5ff-c253e12a7b64 req-58e3295a-2d14-4041-bcf2-cb06b2f72bb2 service nova] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Received unexpected event network-vif-plugged-2bdfdbe2-b457-4078-b4be-979a51ba442a for instance with vm_state deleted and task_state None.
Nov 17 03:26:52 user nova-compute[74898]: DEBUG nova.compute.manager [req-0086f8cf-f876-426f-b5ff-c253e12a7b64 req-58e3295a-2d14-4041-bcf2-cb06b2f72bb2 service nova] [instance: 13449e5c-809b-4db2-af0b-53f5865eb3a4] Received event network-vif-deleted-2bdfdbe2-b457-4078-b4be-979a51ba442a {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:26:52 user nova-compute[74898]: DEBUG nova.compute.manager [req-0086f8cf-f876-426f-b5ff-c253e12a7b64 req-58e3295a-2d14-4041-bcf2-cb06b2f72bb2 service nova] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Received event network-changed-e398a0eb-e160-4b6f-860f-515f7a39f3f2 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:26:52 user nova-compute[74898]: DEBUG nova.compute.manager [req-0086f8cf-f876-426f-b5ff-c253e12a7b64 req-58e3295a-2d14-4041-bcf2-cb06b2f72bb2 service nova] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Refreshing instance network info cache due to event network-changed-e398a0eb-e160-4b6f-860f-515f7a39f3f2. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:26:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0086f8cf-f876-426f-b5ff-c253e12a7b64 req-58e3295a-2d14-4041-bcf2-cb06b2f72bb2 service nova] Acquiring lock "refresh_cache-d40e6f31-1df9-4af5-8a34-9317ae55baa8" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:26:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0086f8cf-f876-426f-b5ff-c253e12a7b64 req-58e3295a-2d14-4041-bcf2-cb06b2f72bb2 service nova] Acquired lock "refresh_cache-d40e6f31-1df9-4af5-8a34-9317ae55baa8" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:26:52 user nova-compute[74898]: DEBUG nova.network.neutron [req-0086f8cf-f876-426f-b5ff-c253e12a7b64 req-58e3295a-2d14-4041-bcf2-cb06b2f72bb2 service nova] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Refreshing network info cache for port e398a0eb-e160-4b6f-860f-515f7a39f3f2 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:26:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:53 user nova-compute[74898]: DEBUG nova.compute.manager [req-ba0aafce-683f-4c62-89f9-e259fd18127b req-914f3216-af04-4db9-ab56-6d3a729243af service nova] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Received event network-vif-unplugged-e398a0eb-e160-4b6f-860f-515f7a39f3f2 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:26:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ba0aafce-683f-4c62-89f9-e259fd18127b req-914f3216-af04-4db9-ab56-6d3a729243af service nova] Acquiring lock "d40e6f31-1df9-4af5-8a34-9317ae55baa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:26:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ba0aafce-683f-4c62-89f9-e259fd18127b req-914f3216-af04-4db9-ab56-6d3a729243af service nova] Lock "d40e6f31-1df9-4af5-8a34-9317ae55baa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:26:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ba0aafce-683f-4c62-89f9-e259fd18127b req-914f3216-af04-4db9-ab56-6d3a729243af service nova] Lock "d40e6f31-1df9-4af5-8a34-9317ae55baa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:26:53 user nova-compute[74898]: DEBUG nova.compute.manager [req-ba0aafce-683f-4c62-89f9-e259fd18127b req-914f3216-af04-4db9-ab56-6d3a729243af service nova] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] No waiting events found dispatching network-vif-unplugged-e398a0eb-e160-4b6f-860f-515f7a39f3f2 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:26:53 user nova-compute[74898]: DEBUG nova.compute.manager [req-ba0aafce-683f-4c62-89f9-e259fd18127b req-914f3216-af04-4db9-ab56-6d3a729243af service nova] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Received event network-vif-unplugged-e398a0eb-e160-4b6f-860f-515f7a39f3f2 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:26:53 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Instance destroyed successfully.
Nov 17 03:26:53 user nova-compute[74898]: DEBUG nova.objects.instance [None req-d0db4b76-d67c-4d8d-837d-8cbe898087c4 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lazy-loading 'resources' on Instance uuid d40e6f31-1df9-4af5-8a34-9317ae55baa8 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:26:53 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-d0db4b76-d67c-4d8d-837d-8cbe898087c4 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:25:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-513601840',display_name='tempest-AttachVolumeNegativeTest-server-513601840',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-513601840',id=39,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmC8td6ybCBRj+GI84tLrFKin3CzQOm9O+EvhG3Egx+pzcz/3PchtEq8yk6XW8tR9yOy6G50NAALE/p7BWqs2JGhPVMYB3rqR8rpKR5D851KpBb6RD38aeVyeTZ5YNBWQ==',key_name='tempest-keypair-1420990439',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:25:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='498d9d0f6667441791a7175256e4c557',ramdisk_id='',reservation_id='r-5do6q9w3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1401299497',owner_user_name='tempest-AttachVolumeNegativeTest-1401299497-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:25:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7660b84c605b4a459065b10fda42043f',uuid=d40e6f31-1df9-4af5-8a34-9317ae55baa8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e398a0eb-e160-4b6f-860f-515f7a39f3f2", "address": "fa:16:3e:b7:9e:25", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape398a0eb-e1", "ovs_interfaceid": "e398a0eb-e160-4b6f-860f-515f7a39f3f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:26:53 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-d0db4b76-d67c-4d8d-837d-8cbe898087c4 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Converting VIF {"id": "e398a0eb-e160-4b6f-860f-515f7a39f3f2", "address": "fa:16:3e:b7:9e:25", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape398a0eb-e1", "ovs_interfaceid": "e398a0eb-e160-4b6f-860f-515f7a39f3f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:26:53 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-d0db4b76-d67c-4d8d-837d-8cbe898087c4 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:9e:25,bridge_name='br-int',has_traffic_filtering=True,id=e398a0eb-e160-4b6f-860f-515f7a39f3f2,network=Network(d02a6f85-70ee-4ed7-ae00-decabd94d542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape398a0eb-e1') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:26:53 user nova-compute[74898]: DEBUG os_vif [None req-d0db4b76-d67c-4d8d-837d-8cbe898087c4 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:9e:25,bridge_name='br-int',has_traffic_filtering=True,id=e398a0eb-e160-4b6f-860f-515f7a39f3f2,network=Network(d02a6f85-70ee-4ed7-ae00-decabd94d542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape398a0eb-e1') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:26:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape398a0eb-e1, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:26:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:26:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c32676e9-4fbb-4c35-97ca-c51376dc6f58) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:26:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:26:53 user nova-compute[74898]: INFO os_vif [None req-d0db4b76-d67c-4d8d-837d-8cbe898087c4 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:9e:25,bridge_name='br-int',has_traffic_filtering=True,id=e398a0eb-e160-4b6f-860f-515f7a39f3f2,network=Network(d02a6f85-70ee-4ed7-ae00-decabd94d542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape398a0eb-e1')
Nov 17 03:26:53 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-d0db4b76-d67c-4d8d-837d-8cbe898087c4 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Deleting instance files /opt/stack/data/nova/instances/d40e6f31-1df9-4af5-8a34-9317ae55baa8_del
Nov 17 03:26:53 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-d0db4b76-d67c-4d8d-837d-8cbe898087c4 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Deletion of /opt/stack/data/nova/instances/d40e6f31-1df9-4af5-8a34-9317ae55baa8_del complete
Nov 17 03:26:53 user nova-compute[74898]: INFO nova.compute.manager [None req-d0db4b76-d67c-4d8d-837d-8cbe898087c4 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Took 0.75 seconds to destroy the instance on the hypervisor.
Nov 17 03:26:53 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-d0db4b76-d67c-4d8d-837d-8cbe898087c4 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:26:53 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:26:53 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:26:53 user nova-compute[74898]: DEBUG nova.network.neutron [req-0086f8cf-f876-426f-b5ff-c253e12a7b64 req-58e3295a-2d14-4041-bcf2-cb06b2f72bb2 service nova] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Updated VIF entry in instance network info cache for port e398a0eb-e160-4b6f-860f-515f7a39f3f2. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:26:53 user nova-compute[74898]: DEBUG nova.network.neutron [req-0086f8cf-f876-426f-b5ff-c253e12a7b64 req-58e3295a-2d14-4041-bcf2-cb06b2f72bb2 service nova] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Updating instance_info_cache with network_info: [{"id": "e398a0eb-e160-4b6f-860f-515f7a39f3f2", "address": "fa:16:3e:b7:9e:25", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape398a0eb-e1", "ovs_interfaceid": "e398a0eb-e160-4b6f-860f-515f7a39f3f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:26:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0086f8cf-f876-426f-b5ff-c253e12a7b64 req-58e3295a-2d14-4041-bcf2-cb06b2f72bb2 service nova] Releasing lock "refresh_cache-d40e6f31-1df9-4af5-8a34-9317ae55baa8" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:26:54 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:26:54 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Took 0.61 seconds to deallocate network for instance.
Nov 17 03:26:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d0db4b76-d67c-4d8d-837d-8cbe898087c4 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:26:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d0db4b76-d67c-4d8d-837d-8cbe898087c4 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:26:54 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-d0db4b76-d67c-4d8d-837d-8cbe898087c4 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:26:54 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-d0db4b76-d67c-4d8d-837d-8cbe898087c4 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:26:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d0db4b76-d67c-4d8d-837d-8cbe898087c4 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.138s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:26:54 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-d0db4b76-d67c-4d8d-837d-8cbe898087c4 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Deleted allocations for instance d40e6f31-1df9-4af5-8a34-9317ae55baa8
Nov 17 03:26:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d0db4b76-d67c-4d8d-837d-8cbe898087c4 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "d40e6f31-1df9-4af5-8a34-9317ae55baa8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.674s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:26:55 user nova-compute[74898]: DEBUG nova.compute.manager [req-06d3e2d8-14bd-4963-94c8-36ffd4d42849 req-763fd416-001c-466e-965d-d3c2a0347778 service nova] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Received event network-vif-plugged-e398a0eb-e160-4b6f-860f-515f7a39f3f2 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:26:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-06d3e2d8-14bd-4963-94c8-36ffd4d42849 req-763fd416-001c-466e-965d-d3c2a0347778 service nova] Acquiring lock "d40e6f31-1df9-4af5-8a34-9317ae55baa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:26:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-06d3e2d8-14bd-4963-94c8-36ffd4d42849 req-763fd416-001c-466e-965d-d3c2a0347778 service nova] Lock "d40e6f31-1df9-4af5-8a34-9317ae55baa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:26:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-06d3e2d8-14bd-4963-94c8-36ffd4d42849 req-763fd416-001c-466e-965d-d3c2a0347778 service nova] Lock "d40e6f31-1df9-4af5-8a34-9317ae55baa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:26:55 user nova-compute[74898]: DEBUG nova.compute.manager [req-06d3e2d8-14bd-4963-94c8-36ffd4d42849 req-763fd416-001c-466e-965d-d3c2a0347778 service nova] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] No waiting events found dispatching network-vif-plugged-e398a0eb-e160-4b6f-860f-515f7a39f3f2 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:26:55 user nova-compute[74898]: WARNING nova.compute.manager [req-06d3e2d8-14bd-4963-94c8-36ffd4d42849 req-763fd416-001c-466e-965d-d3c2a0347778 service nova] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Received unexpected event network-vif-plugged-e398a0eb-e160-4b6f-860f-515f7a39f3f2 for instance with vm_state deleted and task_state None.
Nov 17 03:26:55 user nova-compute[74898]: DEBUG nova.compute.manager [req-06d3e2d8-14bd-4963-94c8-36ffd4d42849 req-763fd416-001c-466e-965d-d3c2a0347778 service nova] [instance: d40e6f31-1df9-4af5-8a34-9317ae55baa8] Received event network-vif-deleted-e398a0eb-e160-4b6f-860f-515f7a39f3f2 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:26:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:26:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:27:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:27:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:27:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:27:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:27:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:27:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:27:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "4d9346e0-9692-43b0-a806-8d8dd003fe81" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "4d9346e0-9692-43b0-a806-8d8dd003fe81" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG nova.compute.manager [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:27:10 user nova-compute[74898]: INFO nova.compute.claims [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Claim successful on node user
Nov 17 03:27:10 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.220s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG nova.compute.manager [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG nova.compute.manager [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG nova.network.neutron [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:27:10 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:27:10 user nova-compute[74898]: DEBUG nova.compute.manager [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG nova.policy [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa779a5f98394629b6b9fa9d04233e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d36087cc8e842c0bfcae89553fb9841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:27:10 user nova-compute[74898]: INFO nova.virt.block_device [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Booting with volume 137dde58-30b0-4893-8678-f1fb9a2c4e6f at /dev/vda
Nov 17 03:27:10 user nova-compute[74898]: DEBUG os_brick.utils [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c317d9-2cdf-4ed8-a4cc-189c45f727bb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf50866c-c05a-4840-aaa4-5e99beda5268]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b210fa25-7f5e-4c7b-b167-59c6bc64b41d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56fac4e-8298-436c-98da-1e8d85982d38]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:27:10 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:27:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fc452f-6814-4b69-8323-b234fd82c142]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG os_brick.utils [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:27:10 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Updating existing volume attachment record: 97e2a1ed-b03e-4b09-927d-74601a14ca90 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:27:11 user nova-compute[74898]: DEBUG nova.network.neutron [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Successfully created port: 5ebae55c-de20-446a-86ca-1b569310a2f4 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:27:11 user nova-compute[74898]: DEBUG nova.network.neutron [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Successfully updated port: 5ebae55c-de20-446a-86ca-1b569310a2f4 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:27:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "refresh_cache-4d9346e0-9692-43b0-a806-8d8dd003fe81" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:27:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquired lock "refresh_cache-4d9346e0-9692-43b0-a806-8d8dd003fe81" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:27:11 user nova-compute[74898]: DEBUG nova.network.neutron [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:27:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-3aef21da-11aa-49d7-8308-0f6cc8a8d0d2 req-67c4f517-ee35-44dd-b790-88db395b1932 service nova] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Received event network-changed-5ebae55c-de20-446a-86ca-1b569310a2f4 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:27:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-3aef21da-11aa-49d7-8308-0f6cc8a8d0d2 req-67c4f517-ee35-44dd-b790-88db395b1932 service nova] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Refreshing instance network info cache due to event network-changed-5ebae55c-de20-446a-86ca-1b569310a2f4. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:27:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3aef21da-11aa-49d7-8308-0f6cc8a8d0d2 req-67c4f517-ee35-44dd-b790-88db395b1932 service nova] Acquiring lock "refresh_cache-4d9346e0-9692-43b0-a806-8d8dd003fe81" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:27:11 user nova-compute[74898]: DEBUG nova.network.neutron [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:27:12 user nova-compute[74898]: DEBUG nova.network.neutron [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Updating instance_info_cache with network_info: [{"id": "5ebae55c-de20-446a-86ca-1b569310a2f4", "address": "fa:16:3e:c8:63:88", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ebae55c-de", "ovs_interfaceid": "5ebae55c-de20-446a-86ca-1b569310a2f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:27:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Releasing lock "refresh_cache-4d9346e0-9692-43b0-a806-8d8dd003fe81" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:27:12 user nova-compute[74898]: DEBUG nova.compute.manager [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Instance network_info: |[{"id": "5ebae55c-de20-446a-86ca-1b569310a2f4", "address": "fa:16:3e:c8:63:88", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ebae55c-de", "ovs_interfaceid": "5ebae55c-de20-446a-86ca-1b569310a2f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:27:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3aef21da-11aa-49d7-8308-0f6cc8a8d0d2 req-67c4f517-ee35-44dd-b790-88db395b1932 service nova] Acquired lock "refresh_cache-4d9346e0-9692-43b0-a806-8d8dd003fe81" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:27:12 user nova-compute[74898]: DEBUG nova.network.neutron [req-3aef21da-11aa-49d7-8308-0f6cc8a8d0d2 req-67c4f517-ee35-44dd-b790-88db395b1932 service nova] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Refreshing network info cache for port 5ebae55c-de20-446a-86ca-1b569310a2f4 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:27:12 user nova-compute[74898]: DEBUG nova.network.neutron [req-3aef21da-11aa-49d7-8308-0f6cc8a8d0d2 req-67c4f517-ee35-44dd-b790-88db395b1932 service nova] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Updated VIF entry in instance network info cache for port 5ebae55c-de20-446a-86ca-1b569310a2f4. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:27:12 user nova-compute[74898]: DEBUG nova.network.neutron [req-3aef21da-11aa-49d7-8308-0f6cc8a8d0d2 req-67c4f517-ee35-44dd-b790-88db395b1932 service nova] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Updating instance_info_cache with network_info: [{"id": "5ebae55c-de20-446a-86ca-1b569310a2f4", "address": "fa:16:3e:c8:63:88", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ebae55c-de", "ovs_interfaceid": "5ebae55c-de20-446a-86ca-1b569310a2f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:27:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3aef21da-11aa-49d7-8308-0f6cc8a8d0d2 req-67c4f517-ee35-44dd-b790-88db395b1932 service nova] Releasing lock "refresh_cache-4d9346e0-9692-43b0-a806-8d8dd003fe81" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:27:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG nova.compute.manager [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:27:16 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Creating image(s)
Nov 17 03:27:16 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Did not create local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Ensure instance console log exists: /opt/stack/data/nova/instances/4d9346e0-9692-43b0-a806-8d8dd003fe81/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Start _get_guest_xml network_info=[{"id": "5ebae55c-de20-446a-86ca-1b569310a2f4", "address": "fa:16:3e:c8:63:88", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ebae55c-de", "ovs_interfaceid": "5ebae55c-de20-446a-86ca-1b569310a2f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxlbaNWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4d9346e0-9692-43b0-a806-8d8dd003fe81', 'attached_at': '', 'detached_at': '', 'volume_id': '137dde58-30b0-4893-8678-f1fb9a2c4e6f', 'serial': '137dde58-30b0-4893-8678-f1fb9a2c4e6f'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '97e2a1ed-b03e-4b09-927d-74601a14ca90', 'volume_type': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:27:16 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:27:16 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:27:16 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxlbaNWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:27:16 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:27:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:27:16 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:27:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:27:16 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc917d7f-1801-44df-a015-4e1b97523289]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:27:16 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae5f201-4afc-40e1-9154-f3a28e04e759]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f] added
Nov 17 03:27:16 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3204df22-b73b-4d37-b346-07088ed07c9d]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[209c4ff2-c9f3-4172-9a37-934c7d24dc6f]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kxlbaNWT {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kxlbaNWT" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2997ece8-6f9f-4096-9314-89a77638aa45]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kxlbaNWT'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ece7dca-c256-4c23-a44b-996c03f2a9c5]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f95a5cb-ca62-4a8d-ad12-11760c2eaa00]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 (non-flash)
Nov 17 03:27:16 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 (non-flash)
Nov 17 03:27:16 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e78856-34d0-4dc9-b0ea-e67baaf1a392]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f, portal: 172.16.0.220,3260]
Nov 17 03:27:16 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f, portal: 172.16.0.220,3260] successful.
Nov 17 03:27:16 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6321f51-1d78-4df5-aa48-798cbdc9a1c2]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[135ba938-5dae-4afe-aa34-265717ac0198]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 (non-flash)
Nov 17 03:27:16 user nova-compute[74898]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:27:16 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 (non-flash)
Nov 17 03:27:16 user nova-compute[74898]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:27:16 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[639635ec-a45e-4ec2-beb4-72e53f3b4ba0]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:27:16 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxlbaNWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:27:17 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:27:17 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23035313539643335', 'path': '/dev/sdb'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:27:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035313539643335', 'path': '/dev/sdb'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:27:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:27:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-851751850',display_name='tempest-TestVolumeBootPattern-server-851751850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-851751850',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJInWWavbu/6d6OQJPNghOKND7RIoCzZc2qCUfAkCC2TokwiJfdMvyOxWX8lLSW7Fx1YLwTdFBaDgYlG8DKkEJfoMkAf+B/utXvLWusVeA4Z9dMFCfioGuJoTmK0Ain2zQ==',key_name='tempest-TestVolumeBootPattern-1387915334',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d36087cc8e842c0bfcae89553fb9841',ramdisk_id='',reservation_id='r-46m0lb70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1382126375',owner_user_name='tempest-TestVolumeBootPattern-1382126375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:27:11Z,user_data=None,user_id='aa779a5f98394629b6b9fa9d04233e7a',uuid=4d9346e0-9692-43b0-a806-8d8dd003fe81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ebae55c-de20-446a-86ca-1b569310a2f4", "address": "fa:16:3e:c8:63:88", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ebae55c-de", "ovs_interfaceid": "5ebae55c-de20-446a-86ca-1b569310a2f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:27:17 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converting VIF {"id": "5ebae55c-de20-446a-86ca-1b569310a2f4", "address": "fa:16:3e:c8:63:88", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ebae55c-de", "ovs_interfaceid": "5ebae55c-de20-446a-86ca-1b569310a2f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:27:17 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:63:88,bridge_name='br-int',has_traffic_filtering=True,id=5ebae55c-de20-446a-86ca-1b569310a2f4,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ebae55c-de') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:27:17 user nova-compute[74898]: DEBUG nova.objects.instance [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d9346e0-9692-43b0-a806-8d8dd003fe81 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:27:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:27:17 user nova-compute[74898]:   <uuid>4d9346e0-9692-43b0-a806-8d8dd003fe81</uuid>
Nov 17 03:27:17 user nova-compute[74898]:   <name>instance-00000028</name>
Nov 17 03:27:17 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:27:17 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:27:17 user nova-compute[74898]:   <metadata>
Nov 17 03:27:17 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:27:17 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:27:17 user nova-compute[74898]:       <nova:name>tempest-TestVolumeBootPattern-server-851751850</nova:name>
Nov 17 03:27:17 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:27:16</nova:creationTime>
Nov 17 03:27:17 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:27:17 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:27:17 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:27:17 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:27:17 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:27:17 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:27:17 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:27:17 user nova-compute[74898]:       <nova:owner>
Nov 17 03:27:17 user nova-compute[74898]:         <nova:user uuid="aa779a5f98394629b6b9fa9d04233e7a">tempest-TestVolumeBootPattern-1382126375-project-member</nova:user>
Nov 17 03:27:17 user nova-compute[74898]:         <nova:project uuid="5d36087cc8e842c0bfcae89553fb9841">tempest-TestVolumeBootPattern-1382126375</nova:project>
Nov 17 03:27:17 user nova-compute[74898]:       </nova:owner>
Nov 17 03:27:17 user nova-compute[74898]:       <nova:ports>
Nov 17 03:27:17 user nova-compute[74898]:         <nova:port uuid="5ebae55c-de20-446a-86ca-1b569310a2f4">
Nov 17 03:27:17 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 17 03:27:17 user nova-compute[74898]:         </nova:port>
Nov 17 03:27:17 user nova-compute[74898]:       </nova:ports>
Nov 17 03:27:17 user nova-compute[74898]:     </nova:instance>
Nov 17 03:27:17 user nova-compute[74898]:   </metadata>
Nov 17 03:27:17 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:27:17 user nova-compute[74898]:     <system>
Nov 17 03:27:17 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:27:17 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:27:17 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:27:17 user nova-compute[74898]:       <entry name="serial">4d9346e0-9692-43b0-a806-8d8dd003fe81</entry>
Nov 17 03:27:17 user nova-compute[74898]:       <entry name="uuid">4d9346e0-9692-43b0-a806-8d8dd003fe81</entry>
Nov 17 03:27:17 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:27:17 user nova-compute[74898]:     </system>
Nov 17 03:27:17 user nova-compute[74898]:   </sysinfo>
Nov 17 03:27:17 user nova-compute[74898]:   <os>
Nov 17 03:27:17 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:27:17 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:27:17 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:27:17 user nova-compute[74898]:   </os>
Nov 17 03:27:17 user nova-compute[74898]:   <features>
Nov 17 03:27:17 user nova-compute[74898]:     <acpi/>
Nov 17 03:27:17 user nova-compute[74898]:     <apic/>
Nov 17 03:27:17 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:27:17 user nova-compute[74898]:   </features>
Nov 17 03:27:17 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:27:17 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:27:17 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:27:17 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:27:17 user nova-compute[74898]:   </clock>
Nov 17 03:27:17 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:27:17 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:27:17 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:27:17 user nova-compute[74898]:   </cpu>
Nov 17 03:27:17 user nova-compute[74898]:   <devices>
Nov 17 03:27:17 user nova-compute[74898]:     <disk type="block" device="disk">
Nov 17 03:27:17 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:27:17 user nova-compute[74898]:       <source dev="/dev/sdb"/>
Nov 17 03:27:17 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:27:17 user nova-compute[74898]:       <serial>137dde58-30b0-4893-8678-f1fb9a2c4e6f</serial>
Nov 17 03:27:17 user nova-compute[74898]:     </disk>
Nov 17 03:27:17 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:27:17 user nova-compute[74898]:       <mac address="fa:16:3e:c8:63:88"/>
Nov 17 03:27:17 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:27:17 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:27:17 user nova-compute[74898]:       <target dev="tap5ebae55c-de"/>
Nov 17 03:27:17 user nova-compute[74898]:     </interface>
Nov 17 03:27:17 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:27:17 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/4d9346e0-9692-43b0-a806-8d8dd003fe81/console.log" append="off"/>
Nov 17 03:27:17 user nova-compute[74898]:     </serial>
Nov 17 03:27:17 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:27:17 user nova-compute[74898]:     <video>
Nov 17 03:27:17 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:27:17 user nova-compute[74898]:     </video>
Nov 17 03:27:17 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:27:17 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:27:17 user nova-compute[74898]:     </rng>
Nov 17 03:27:17 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:27:17 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:27:17 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:27:17 user nova-compute[74898]:     </memballoon>
Nov 17 03:27:17 user nova-compute[74898]:   </devices>
Nov 17 03:27:17 user nova-compute[74898]: </domain>
Nov 17 03:27:17 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:27:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:27:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-851751850',display_name='tempest-TestVolumeBootPattern-server-851751850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-851751850',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJInWWavbu/6d6OQJPNghOKND7RIoCzZc2qCUfAkCC2TokwiJfdMvyOxWX8lLSW7Fx1YLwTdFBaDgYlG8DKkEJfoMkAf+B/utXvLWusVeA4Z9dMFCfioGuJoTmK0Ain2zQ==',key_name='tempest-TestVolumeBootPattern-1387915334',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d36087cc8e842c0bfcae89553fb9841',ramdisk_id='',reservation_id='r-46m0lb70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1382126375',owner_user_name='tempest-TestVolumeBootPattern-1382126375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:27:11Z,user_data=None,user_id='aa779a5f98394629b6b9fa9d04233e7a',uuid=4d9346e0-9692-43b0-a806-8d8dd003fe81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ebae55c-de20-446a-86ca-1b569310a2f4", "address": "fa:16:3e:c8:63:88", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ebae55c-de", "ovs_interfaceid": "5ebae55c-de20-446a-86ca-1b569310a2f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:27:17 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converting VIF {"id": "5ebae55c-de20-446a-86ca-1b569310a2f4", "address": "fa:16:3e:c8:63:88", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ebae55c-de", "ovs_interfaceid": "5ebae55c-de20-446a-86ca-1b569310a2f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:27:17 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:63:88,bridge_name='br-int',has_traffic_filtering=True,id=5ebae55c-de20-446a-86ca-1b569310a2f4,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ebae55c-de') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:27:17 user nova-compute[74898]: DEBUG os_vif [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:63:88,bridge_name='br-int',has_traffic_filtering=True,id=5ebae55c-de20-446a-86ca-1b569310a2f4,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ebae55c-de') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:27:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:27:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:27:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:27:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:27:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c7dae3b-7fcf-55a8-bcf1-2ca8abaa47a5', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:27:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:27:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:27:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:27:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ebae55c-de, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:27:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ebae55c-de, col_values=(('qos', UUID('86d56097-38ba-4da1-825e-27f0e1b3a828')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:27:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ebae55c-de, col_values=(('external_ids', {'iface-id': '5ebae55c-de20-446a-86ca-1b569310a2f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:63:88', 'vm-uuid': '4d9346e0-9692-43b0-a806-8d8dd003fe81'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:27:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:27:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:27:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:27:17 user nova-compute[74898]: INFO os_vif [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:63:88,bridge_name='br-int',has_traffic_filtering=True,id=5ebae55c-de20-446a-86ca-1b569310a2f4,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ebae55c-de')
Nov 17 03:27:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:27:17 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] No VIF found with MAC fa:16:3e:c8:63:88, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:27:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:27:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:27:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:27:19 user nova-compute[74898]: DEBUG nova.compute.manager [req-317a5c23-977d-4a7f-be76-a6a19acbfcf6 req-dc34633a-4ac9-4fa2-8ba9-18a2360f65f8 service nova] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Received event network-vif-plugged-5ebae55c-de20-446a-86ca-1b569310a2f4 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:27:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-317a5c23-977d-4a7f-be76-a6a19acbfcf6 req-dc34633a-4ac9-4fa2-8ba9-18a2360f65f8 service nova] Acquiring lock "4d9346e0-9692-43b0-a806-8d8dd003fe81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:27:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-317a5c23-977d-4a7f-be76-a6a19acbfcf6 req-dc34633a-4ac9-4fa2-8ba9-18a2360f65f8 service nova] Lock "4d9346e0-9692-43b0-a806-8d8dd003fe81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:27:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-317a5c23-977d-4a7f-be76-a6a19acbfcf6 req-dc34633a-4ac9-4fa2-8ba9-18a2360f65f8 service nova] Lock "4d9346e0-9692-43b0-a806-8d8dd003fe81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:27:19 user nova-compute[74898]: DEBUG nova.compute.manager [req-317a5c23-977d-4a7f-be76-a6a19acbfcf6 req-dc34633a-4ac9-4fa2-8ba9-18a2360f65f8 service nova] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] No waiting events found dispatching network-vif-plugged-5ebae55c-de20-446a-86ca-1b569310a2f4 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:27:19 user nova-compute[74898]: WARNING nova.compute.manager [req-317a5c23-977d-4a7f-be76-a6a19acbfcf6 req-dc34633a-4ac9-4fa2-8ba9-18a2360f65f8 service nova] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Received unexpected event network-vif-plugged-5ebae55c-de20-446a-86ca-1b569310a2f4 for instance with vm_state building and task_state spawning.
Nov 17 03:27:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:27:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:27:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:27:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:27:21 user nova-compute[74898]: DEBUG nova.compute.manager [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:27:21 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:27:21 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Instance spawned successfully.
Nov 17 03:27:21 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:27:21 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:27:21 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:27:21 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:27:21 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:27:21 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:27:21 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:27:21 user nova-compute[74898]: INFO nova.compute.manager [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Took 5.06 seconds to spawn the instance on the hypervisor.
Nov 17 03:27:21 user nova-compute[74898]: DEBUG nova.compute.manager [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:27:21 user nova-compute[74898]: DEBUG nova.compute.manager [req-6249ea8e-8539-4b6a-9508-309f4702105e req-ded0e0bc-6280-4385-b84e-3fec11d7bacc service nova] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Received event network-vif-plugged-5ebae55c-de20-446a-86ca-1b569310a2f4 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:27:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-6249ea8e-8539-4b6a-9508-309f4702105e req-ded0e0bc-6280-4385-b84e-3fec11d7bacc service nova] Acquiring lock "4d9346e0-9692-43b0-a806-8d8dd003fe81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:27:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-6249ea8e-8539-4b6a-9508-309f4702105e req-ded0e0bc-6280-4385-b84e-3fec11d7bacc service nova] Lock "4d9346e0-9692-43b0-a806-8d8dd003fe81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:27:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-6249ea8e-8539-4b6a-9508-309f4702105e req-ded0e0bc-6280-4385-b84e-3fec11d7bacc service nova] Lock "4d9346e0-9692-43b0-a806-8d8dd003fe81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:27:21 user nova-compute[74898]: DEBUG nova.compute.manager [req-6249ea8e-8539-4b6a-9508-309f4702105e req-ded0e0bc-6280-4385-b84e-3fec11d7bacc service nova] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] No waiting events found dispatching network-vif-plugged-5ebae55c-de20-446a-86ca-1b569310a2f4 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:27:21 user nova-compute[74898]: WARNING nova.compute.manager [req-6249ea8e-8539-4b6a-9508-309f4702105e req-ded0e0bc-6280-4385-b84e-3fec11d7bacc service nova] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Received unexpected event network-vif-plugged-5ebae55c-de20-446a-86ca-1b569310a2f4 for instance with vm_state building and task_state spawning.
Nov 17 03:27:21 user nova-compute[74898]: INFO nova.compute.manager [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Took 11.16 seconds to build instance.
Nov 17 03:27:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-97e1240b-68c7-4f43-bcfa-dbe67aa05ae1 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "4d9346e0-9692-43b0-a806-8d8dd003fe81" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.292s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:27:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:27:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:27:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:27:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:27:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:27:34 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:27:34 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:27:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:27:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:27:37 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:27:38 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:27:38 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:27:39 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:27:40 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:27:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:27:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:27:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:27:40 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:27:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:27:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:27:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:27:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:27:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:27:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:27:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:27:41 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:27:41 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:27:41 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=8734MB free_disk=25.347545623779297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:27:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:27:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:27:41 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 151bb1e2-b109-4f9c-a85c-bfed05bec7dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:27:41 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 4d9346e0-9692-43b0-a806-8d8dd003fe81 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:27:41 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:27:41 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:27:41 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:27:41 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:27:41 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:27:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:27:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:27:42 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:27:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:27:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:27:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:27:44 user nova-compute[74898]: INFO nova.compute.manager [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Detaching volume 59ed4582-972d-48e4-8b70-2331ffb98688
Nov 17 03:27:44 user nova-compute[74898]: INFO nova.virt.block_device [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Attempting to driver detach volume 59ed4582-972d-48e4-8b70-2331ffb98688 from mountpoint /dev/vdb
Nov 17 03:27:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Attempting to detach device vdb from instance 151bb1e2-b109-4f9c-a85c-bfed05bec7dd from the persistent domain config. {{(pid=74898) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 03:27:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:27:44 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:27:44 user nova-compute[74898]:   <source dev="/dev/sde"/>
Nov 17 03:27:44 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:27:44 user nova-compute[74898]:   <serial>59ed4582-972d-48e4-8b70-2331ffb98688</serial>
Nov 17 03:27:44 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:27:44 user nova-compute[74898]: </disk>
Nov 17 03:27:44 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:27:44 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Successfully detached device vdb from instance 151bb1e2-b109-4f9c-a85c-bfed05bec7dd from the persistent domain config.
Nov 17 03:27:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 151bb1e2-b109-4f9c-a85c-bfed05bec7dd from the live domain config. {{(pid=74898) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 03:27:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:27:44 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:27:44 user nova-compute[74898]:   <source dev="/dev/sde"/>
Nov 17 03:27:44 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:27:44 user nova-compute[74898]:   <serial>59ed4582-972d-48e4-8b70-2331ffb98688</serial>
Nov 17 03:27:44 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:27:44 user nova-compute[74898]: </disk>
Nov 17 03:27:44 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:27:44 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:27:44 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:27:44 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Didn't find any instances for network info cache update. {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 17 03:27:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 151bb1e2-b109-4f9c-a85c-bfed05bec7dd {{(pid=74898) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 03:27:45 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:27:45 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:27:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:27:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:27:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:27:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:27:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:28:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:28:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:28:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:28:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:28:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:04 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 151bb1e2-b109-4f9c-a85c-bfed05bec7dd is timed out.
Nov 17 03:28:04 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Successfully detached device vdb from instance 151bb1e2-b109-4f9c-a85c-bfed05bec7dd from the live domain config.
Nov 17 03:28:04 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:28:04 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lySmiPnN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:28:04 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:28:04 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:28:04 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:28:04 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d46d14b-ed18-4386-a8ee-a502365af2f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:28:05 user nova-compute[74898]: No targets found.
Nov 17 03:28:05 user nova-compute[74898]: iSNS:
Nov 17 03:28:05 user nova-compute[74898]: No targets found.
Nov 17 03:28:05 user nova-compute[74898]: STATIC:
Nov 17 03:28:05 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f
Nov 17 03:28:05 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:28:05 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:28:05 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688
Nov 17 03:28:05 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:28:05 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:28:05 user nova-compute[74898]: FIRMWARE:
Nov 17 03:28:05 user nova-compute[74898]: No targets found.
Nov 17 03:28:05 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:28:05 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:28:05 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6b4ef4-ce5e-4005-aedb-43eaef0a8c00]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa3b057-8d45-4275-b24d-3995914d58be]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 (non-flash)
Nov 17 03:28:05 user nova-compute[74898]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:28:05 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 (non-flash)
Nov 17 03:28:05 user nova-compute[74898]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:28:05 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf84cb9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688'): ({'sde'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Removing single pathed devices sde {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eecbf28-5f8e-4970-89e9-3836711281b3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8834db7c-602a-4332-8651-849643a064f8]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Flushing IO for device /dev/sde {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d04f28c-2038-43fe-81bc-c508c2219612]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[277332c5-c4ff-426c-97d4-949cf82874f8]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] SCSI volumes sde have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e02417-09c9-4056-bac9-69987b946973]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a6f51c-e3dd-4c5c-a373-c5bf96120b79]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688, portal: 172.16.0.220,3260]
Nov 17 03:28:05 user nova-compute[74898]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688, portal: 172.16.0.220,3260] successful.
Nov 17 03:28:05 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ed4582-972d-48e4-8b70-2331ffb98688 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6960d6-72b3-4251-87ae-0ed34c5d4d32]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] <== disconnect_volume: return (326ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:28:05 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:28:06 user nova-compute[74898]: DEBUG nova.objects.instance [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lazy-loading 'flavor' on Instance uuid 151bb1e2-b109-4f9c-a85c-bfed05bec7dd {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:28:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d3821ee0-da5c-412a-a777-4f5e74d9ddaf tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.776s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:28:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:28:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:28:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d20c9a62-122b-40bc-98ab-610f569f0353 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:28:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d20c9a62-122b-40bc-98ab-610f569f0353 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:28:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d20c9a62-122b-40bc-98ab-610f569f0353 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:28:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d20c9a62-122b-40bc-98ab-610f569f0353 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:28:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d20c9a62-122b-40bc-98ab-610f569f0353 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:28:34 user nova-compute[74898]: INFO nova.compute.manager [None req-d20c9a62-122b-40bc-98ab-610f569f0353 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Terminating instance
Nov 17 03:28:34 user nova-compute[74898]: DEBUG nova.compute.manager [None req-d20c9a62-122b-40bc-98ab-610f569f0353 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:28:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:35 user nova-compute[74898]: DEBUG nova.compute.manager [req-34192248-0132-453a-8a34-52bf5b22cfdc req-0f87fc13-9826-46ae-bd95-bd103d19cd9a service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Received event network-vif-unplugged-207dd9ce-91f5-4dcf-b77f-18501d94908c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:28:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-34192248-0132-453a-8a34-52bf5b22cfdc req-0f87fc13-9826-46ae-bd95-bd103d19cd9a service nova] Acquiring lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:28:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-34192248-0132-453a-8a34-52bf5b22cfdc req-0f87fc13-9826-46ae-bd95-bd103d19cd9a service nova] Lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:28:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-34192248-0132-453a-8a34-52bf5b22cfdc req-0f87fc13-9826-46ae-bd95-bd103d19cd9a service nova] Lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:28:35 user nova-compute[74898]: DEBUG nova.compute.manager [req-34192248-0132-453a-8a34-52bf5b22cfdc req-0f87fc13-9826-46ae-bd95-bd103d19cd9a service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] No waiting events found dispatching network-vif-unplugged-207dd9ce-91f5-4dcf-b77f-18501d94908c {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:28:35 user nova-compute[74898]: DEBUG nova.compute.manager [req-34192248-0132-453a-8a34-52bf5b22cfdc req-0f87fc13-9826-46ae-bd95-bd103d19cd9a service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Received event network-vif-unplugged-207dd9ce-91f5-4dcf-b77f-18501d94908c for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:28:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:35 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Instance destroyed successfully.
Nov 17 03:28:35 user nova-compute[74898]: DEBUG nova.objects.instance [None req-d20c9a62-122b-40bc-98ab-610f569f0353 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lazy-loading 'resources' on Instance uuid 151bb1e2-b109-4f9c-a85c-bfed05bec7dd {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:28:35 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-d20c9a62-122b-40bc-98ab-610f569f0353 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:22:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2092642174',display_name='tempest-AttachVolumeNegativeTest-server-2092642174',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2092642174',id=36,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtlckbxQcrXLRHqNIZUPzA6rU4pOrQcwGoq464PbkE81jDIakEtbJ7JOTwsODgDV8PXueRZhcmfyBf0PjHjG3tDDXsg1QlbJUU1+zWVAciLRmsZfGwH8b/INMWCufsKPw==',key_name='tempest-keypair-710022783',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:23:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='498d9d0f6667441791a7175256e4c557',ramdisk_id='',reservation_id='r-zkdzg80k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1401299497',owner_user_name='tempest-AttachVolumeNegativeTest-1401299497-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7660b84c605b4a459065b10fda42043f',uuid=151bb1e2-b109-4f9c-a85c-bfed05bec7dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "207dd9ce-91f5-4dcf-b77f-18501d94908c", "address": "fa:16:3e:a9:62:c3", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207dd9ce-91", "ovs_interfaceid": "207dd9ce-91f5-4dcf-b77f-18501d94908c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:28:35 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-d20c9a62-122b-40bc-98ab-610f569f0353 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Converting VIF {"id": "207dd9ce-91f5-4dcf-b77f-18501d94908c", "address": "fa:16:3e:a9:62:c3", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207dd9ce-91", "ovs_interfaceid": "207dd9ce-91f5-4dcf-b77f-18501d94908c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:28:35 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-d20c9a62-122b-40bc-98ab-610f569f0353 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:62:c3,bridge_name='br-int',has_traffic_filtering=True,id=207dd9ce-91f5-4dcf-b77f-18501d94908c,network=Network(d02a6f85-70ee-4ed7-ae00-decabd94d542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap207dd9ce-91') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:28:35 user nova-compute[74898]: DEBUG os_vif [None req-d20c9a62-122b-40bc-98ab-610f569f0353 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:62:c3,bridge_name='br-int',has_traffic_filtering=True,id=207dd9ce-91f5-4dcf-b77f-18501d94908c,network=Network(d02a6f85-70ee-4ed7-ae00-decabd94d542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap207dd9ce-91') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:28:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap207dd9ce-91, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:28:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:28:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a5231904-a115-4953-b342-c86b20eba080) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:28:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:28:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:35 user nova-compute[74898]: INFO os_vif [None req-d20c9a62-122b-40bc-98ab-610f569f0353 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:62:c3,bridge_name='br-int',has_traffic_filtering=True,id=207dd9ce-91f5-4dcf-b77f-18501d94908c,network=Network(d02a6f85-70ee-4ed7-ae00-decabd94d542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap207dd9ce-91')
Nov 17 03:28:35 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-d20c9a62-122b-40bc-98ab-610f569f0353 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Deleting instance files /opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd_del
Nov 17 03:28:35 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-d20c9a62-122b-40bc-98ab-610f569f0353 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Deletion of /opt/stack/data/nova/instances/151bb1e2-b109-4f9c-a85c-bfed05bec7dd_del complete
Nov 17 03:28:35 user nova-compute[74898]: INFO nova.compute.manager [None req-d20c9a62-122b-40bc-98ab-610f569f0353 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 17 03:28:35 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-d20c9a62-122b-40bc-98ab-610f569f0353 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:28:35 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:28:35 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:28:35 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:28:35 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:28:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:36 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:28:36 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Took 1.22 seconds to deallocate network for instance.
Nov 17 03:28:36 user nova-compute[74898]: DEBUG nova.compute.manager [req-4c032cc8-44df-4425-b2d3-756a6a15a8e6 req-b965040b-e783-4c28-875c-7f2fbe7b8700 service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Received event network-vif-deleted-207dd9ce-91f5-4dcf-b77f-18501d94908c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:28:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d20c9a62-122b-40bc-98ab-610f569f0353 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:28:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d20c9a62-122b-40bc-98ab-610f569f0353 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:28:37 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-d20c9a62-122b-40bc-98ab-610f569f0353 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:28:37 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-d20c9a62-122b-40bc-98ab-610f569f0353 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:28:37 user nova-compute[74898]: DEBUG nova.compute.manager [req-3029c986-56a0-4a59-af75-799c665def11 req-da738d27-a5c9-4318-a015-9a0c53760949 service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Received event network-vif-plugged-207dd9ce-91f5-4dcf-b77f-18501d94908c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:28:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3029c986-56a0-4a59-af75-799c665def11 req-da738d27-a5c9-4318-a015-9a0c53760949 service nova] Acquiring lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:28:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3029c986-56a0-4a59-af75-799c665def11 req-da738d27-a5c9-4318-a015-9a0c53760949 service nova] Lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:28:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3029c986-56a0-4a59-af75-799c665def11 req-da738d27-a5c9-4318-a015-9a0c53760949 service nova] Lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:28:37 user nova-compute[74898]: DEBUG nova.compute.manager [req-3029c986-56a0-4a59-af75-799c665def11 req-da738d27-a5c9-4318-a015-9a0c53760949 service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] No waiting events found dispatching network-vif-plugged-207dd9ce-91f5-4dcf-b77f-18501d94908c {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:28:37 user nova-compute[74898]: WARNING nova.compute.manager [req-3029c986-56a0-4a59-af75-799c665def11 req-da738d27-a5c9-4318-a015-9a0c53760949 service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Received unexpected event network-vif-plugged-207dd9ce-91f5-4dcf-b77f-18501d94908c for instance with vm_state deleted and task_state None.
Nov 17 03:28:37 user nova-compute[74898]: DEBUG nova.compute.manager [req-3029c986-56a0-4a59-af75-799c665def11 req-da738d27-a5c9-4318-a015-9a0c53760949 service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Received event network-vif-plugged-207dd9ce-91f5-4dcf-b77f-18501d94908c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:28:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3029c986-56a0-4a59-af75-799c665def11 req-da738d27-a5c9-4318-a015-9a0c53760949 service nova] Acquiring lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:28:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3029c986-56a0-4a59-af75-799c665def11 req-da738d27-a5c9-4318-a015-9a0c53760949 service nova] Lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:28:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3029c986-56a0-4a59-af75-799c665def11 req-da738d27-a5c9-4318-a015-9a0c53760949 service nova] Lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:28:37 user nova-compute[74898]: DEBUG nova.compute.manager [req-3029c986-56a0-4a59-af75-799c665def11 req-da738d27-a5c9-4318-a015-9a0c53760949 service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] No waiting events found dispatching network-vif-plugged-207dd9ce-91f5-4dcf-b77f-18501d94908c {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:28:37 user nova-compute[74898]: WARNING nova.compute.manager [req-3029c986-56a0-4a59-af75-799c665def11 req-da738d27-a5c9-4318-a015-9a0c53760949 service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Received unexpected event network-vif-plugged-207dd9ce-91f5-4dcf-b77f-18501d94908c for instance with vm_state deleted and task_state None.
Nov 17 03:28:37 user nova-compute[74898]: DEBUG nova.compute.manager [req-3029c986-56a0-4a59-af75-799c665def11 req-da738d27-a5c9-4318-a015-9a0c53760949 service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Received event network-vif-plugged-207dd9ce-91f5-4dcf-b77f-18501d94908c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:28:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3029c986-56a0-4a59-af75-799c665def11 req-da738d27-a5c9-4318-a015-9a0c53760949 service nova] Acquiring lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:28:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3029c986-56a0-4a59-af75-799c665def11 req-da738d27-a5c9-4318-a015-9a0c53760949 service nova] Lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:28:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3029c986-56a0-4a59-af75-799c665def11 req-da738d27-a5c9-4318-a015-9a0c53760949 service nova] Lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:28:37 user nova-compute[74898]: DEBUG nova.compute.manager [req-3029c986-56a0-4a59-af75-799c665def11 req-da738d27-a5c9-4318-a015-9a0c53760949 service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] No waiting events found dispatching network-vif-plugged-207dd9ce-91f5-4dcf-b77f-18501d94908c {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:28:37 user nova-compute[74898]: WARNING nova.compute.manager [req-3029c986-56a0-4a59-af75-799c665def11 req-da738d27-a5c9-4318-a015-9a0c53760949 service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Received unexpected event network-vif-plugged-207dd9ce-91f5-4dcf-b77f-18501d94908c for instance with vm_state deleted and task_state None.
Nov 17 03:28:37 user nova-compute[74898]: DEBUG nova.compute.manager [req-3029c986-56a0-4a59-af75-799c665def11 req-da738d27-a5c9-4318-a015-9a0c53760949 service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Received event network-vif-unplugged-207dd9ce-91f5-4dcf-b77f-18501d94908c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:28:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3029c986-56a0-4a59-af75-799c665def11 req-da738d27-a5c9-4318-a015-9a0c53760949 service nova] Acquiring lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:28:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3029c986-56a0-4a59-af75-799c665def11 req-da738d27-a5c9-4318-a015-9a0c53760949 service nova] Lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:28:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3029c986-56a0-4a59-af75-799c665def11 req-da738d27-a5c9-4318-a015-9a0c53760949 service nova] Lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:28:37 user nova-compute[74898]: DEBUG nova.compute.manager [req-3029c986-56a0-4a59-af75-799c665def11 req-da738d27-a5c9-4318-a015-9a0c53760949 service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] No waiting events found dispatching network-vif-unplugged-207dd9ce-91f5-4dcf-b77f-18501d94908c {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:28:37 user nova-compute[74898]: WARNING nova.compute.manager [req-3029c986-56a0-4a59-af75-799c665def11 req-da738d27-a5c9-4318-a015-9a0c53760949 service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Received unexpected event network-vif-unplugged-207dd9ce-91f5-4dcf-b77f-18501d94908c for instance with vm_state deleted and task_state None.
Nov 17 03:28:37 user nova-compute[74898]: DEBUG nova.compute.manager [req-3029c986-56a0-4a59-af75-799c665def11 req-da738d27-a5c9-4318-a015-9a0c53760949 service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Received event network-vif-plugged-207dd9ce-91f5-4dcf-b77f-18501d94908c {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:28:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3029c986-56a0-4a59-af75-799c665def11 req-da738d27-a5c9-4318-a015-9a0c53760949 service nova] Acquiring lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:28:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3029c986-56a0-4a59-af75-799c665def11 req-da738d27-a5c9-4318-a015-9a0c53760949 service nova] Lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:28:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3029c986-56a0-4a59-af75-799c665def11 req-da738d27-a5c9-4318-a015-9a0c53760949 service nova] Lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:28:37 user nova-compute[74898]: DEBUG nova.compute.manager [req-3029c986-56a0-4a59-af75-799c665def11 req-da738d27-a5c9-4318-a015-9a0c53760949 service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] No waiting events found dispatching network-vif-plugged-207dd9ce-91f5-4dcf-b77f-18501d94908c {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:28:37 user nova-compute[74898]: WARNING nova.compute.manager [req-3029c986-56a0-4a59-af75-799c665def11 req-da738d27-a5c9-4318-a015-9a0c53760949 service nova] [instance: 151bb1e2-b109-4f9c-a85c-bfed05bec7dd] Received unexpected event network-vif-plugged-207dd9ce-91f5-4dcf-b77f-18501d94908c for instance with vm_state deleted and task_state None.
Nov 17 03:28:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d20c9a62-122b-40bc-98ab-610f569f0353 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.165s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:28:37 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-d20c9a62-122b-40bc-98ab-610f569f0353 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Deleted allocations for instance 151bb1e2-b109-4f9c-a85c-bfed05bec7dd
Nov 17 03:28:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d20c9a62-122b-40bc-98ab-610f569f0353 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "151bb1e2-b109-4f9c-a85c-bfed05bec7dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.558s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:28:37 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:28:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "f794babb-75e5-41c3-8518-e1b0a78024be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:28:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "f794babb-75e5-41c3-8518-e1b0a78024be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:28:38 user nova-compute[74898]: DEBUG nova.compute.manager [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:28:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:28:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:28:38 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:28:38 user nova-compute[74898]: INFO nova.compute.claims [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Claim successful on node user
Nov 17 03:28:38 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:28:38 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:28:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.206s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:28:38 user nova-compute[74898]: DEBUG nova.compute.manager [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:28:38 user nova-compute[74898]: DEBUG nova.compute.manager [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:28:38 user nova-compute[74898]: DEBUG nova.network.neutron [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:28:38 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:28:38 user nova-compute[74898]: DEBUG nova.compute.manager [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:28:38 user nova-compute[74898]: DEBUG nova.policy [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f3d630e4ece4c6c87da71cedcf3a839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4596366f424fa7937aaf97828a7c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:28:38 user nova-compute[74898]: DEBUG nova.compute.manager [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:28:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:28:38 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Creating image(s)
Nov 17 03:28:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "/opt/stack/data/nova/instances/f794babb-75e5-41c3-8518-e1b0a78024be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:28:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "/opt/stack/data/nova/instances/f794babb-75e5-41c3-8518-e1b0a78024be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:28:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "/opt/stack/data/nova/instances/f794babb-75e5-41c3-8518-e1b0a78024be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:28:38 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:28:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.175s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:28:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:28:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:28:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:28:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.168s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:28:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/f794babb-75e5-41c3-8518-e1b0a78024be/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:28:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/f794babb-75e5-41c3-8518-e1b0a78024be/disk 1073741824" returned: 0 in 0.055s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:28:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:28:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:28:39 user nova-compute[74898]: DEBUG nova.network.neutron [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Successfully created port: 92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:28:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.183s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:28:39 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f794babb-75e5-41c3-8518-e1b0a78024be/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:28:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f794babb-75e5-41c3-8518-e1b0a78024be/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:28:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f794babb-75e5-41c3-8518-e1b0a78024be/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:28:39 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Cannot resize image /opt/stack/data/nova/instances/f794babb-75e5-41c3-8518-e1b0a78024be/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:28:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:28:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Ensure instance console log exists: /opt/stack/data/nova/instances/f794babb-75e5-41c3-8518-e1b0a78024be/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:28:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:28:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:28:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:28:39 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:28:39 user nova-compute[74898]: DEBUG nova.network.neutron [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Successfully updated port: 92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:28:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "refresh_cache-f794babb-75e5-41c3-8518-e1b0a78024be" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:28:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquired lock "refresh_cache-f794babb-75e5-41c3-8518-e1b0a78024be" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:28:39 user nova-compute[74898]: DEBUG nova.network.neutron [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:28:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-bdc092d8-b84d-40b2-ad09-2e666b52436b req-ef8a256c-8568-4012-ad89-c7f90643fe68 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Received event network-changed-92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:28:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-bdc092d8-b84d-40b2-ad09-2e666b52436b req-ef8a256c-8568-4012-ad89-c7f90643fe68 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Refreshing instance network info cache due to event network-changed-92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:28:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-bdc092d8-b84d-40b2-ad09-2e666b52436b req-ef8a256c-8568-4012-ad89-c7f90643fe68 service nova] Acquiring lock "refresh_cache-f794babb-75e5-41c3-8518-e1b0a78024be" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:28:39 user nova-compute[74898]: DEBUG nova.network.neutron [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.network.neutron [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Updating instance_info_cache with network_info: [{"id": "92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3", "address": "fa:16:3e:97:1d:8d", "network": {"id": "7ab9395e-a6a0-4b93-990e-d7d064bba5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-894693551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4596366f424fa7937aaf97828a7c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f7d6e9-a1", "ovs_interfaceid": "92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Releasing lock "refresh_cache-f794babb-75e5-41c3-8518-e1b0a78024be" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.compute.manager [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Instance network_info: |[{"id": "92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3", "address": "fa:16:3e:97:1d:8d", "network": {"id": "7ab9395e-a6a0-4b93-990e-d7d064bba5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-894693551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4596366f424fa7937aaf97828a7c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f7d6e9-a1", "ovs_interfaceid": "92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-bdc092d8-b84d-40b2-ad09-2e666b52436b req-ef8a256c-8568-4012-ad89-c7f90643fe68 service nova] Acquired lock "refresh_cache-f794babb-75e5-41c3-8518-e1b0a78024be" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.network.neutron [req-bdc092d8-b84d-40b2-ad09-2e666b52436b req-ef8a256c-8568-4012-ad89-c7f90643fe68 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Refreshing network info cache for port 92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Start _get_guest_xml network_info=[{"id": "92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3", "address": "fa:16:3e:97:1d:8d", "network": {"id": "7ab9395e-a6a0-4b93-990e-d7d064bba5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-894693551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4596366f424fa7937aaf97828a7c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f7d6e9-a1", "ovs_interfaceid": "92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:28:40 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:28:40 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:28:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1889443406',display_name='tempest-VolumesSnapshotTestJSON-instance-1889443406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1889443406',id=41,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKjwRjYJ+DEOyHgjZg3dlJK8MGATTQJe/2MTeOsMdCPM3IIX3Fg75cjYcrJ8yIZW/KVZgWrvJcBbec2x+urdoei3dplo6LLhriL2bcg8qMOpvq20aootvbMa0/rJdPuPA==',key_name='tempest-keypair-1447226380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e4596366f424fa7937aaf97828a7c65',ramdisk_id='',reservation_id='r-z8geuiau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1365341029',owner_user_name='tempest-VolumesSnapshotTestJSON-1365341029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:28:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f3d630e4ece4c6c87da71cedcf3a839',uuid=f794babb-75e5-41c3-8518-e1b0a78024be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3", "address": "fa:16:3e:97:1d:8d", "network": {"id": "7ab9395e-a6a0-4b93-990e-d7d064bba5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-894693551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4596366f424fa7937aaf97828a7c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f7d6e9-a1", "ovs_interfaceid": "92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Converting VIF {"id": "92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3", "address": "fa:16:3e:97:1d:8d", "network": {"id": "7ab9395e-a6a0-4b93-990e-d7d064bba5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-894693551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4596366f424fa7937aaf97828a7c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f7d6e9-a1", "ovs_interfaceid": "92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:1d:8d,bridge_name='br-int',has_traffic_filtering=True,id=92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3,network=Network(7ab9395e-a6a0-4b93-990e-d7d064bba5c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92f7d6e9-a1') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.objects.instance [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lazy-loading 'pci_devices' on Instance uuid f794babb-75e5-41c3-8518-e1b0a78024be {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:28:40 user nova-compute[74898]:   <uuid>f794babb-75e5-41c3-8518-e1b0a78024be</uuid>
Nov 17 03:28:40 user nova-compute[74898]:   <name>instance-00000029</name>
Nov 17 03:28:40 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:28:40 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:28:40 user nova-compute[74898]:   <metadata>
Nov 17 03:28:40 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:28:40 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:28:40 user nova-compute[74898]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1889443406</nova:name>
Nov 17 03:28:40 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:28:40</nova:creationTime>
Nov 17 03:28:40 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:28:40 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:28:40 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:28:40 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:28:40 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:28:40 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:28:40 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:28:40 user nova-compute[74898]:       <nova:owner>
Nov 17 03:28:40 user nova-compute[74898]:         <nova:user uuid="9f3d630e4ece4c6c87da71cedcf3a839">tempest-VolumesSnapshotTestJSON-1365341029-project-member</nova:user>
Nov 17 03:28:40 user nova-compute[74898]:         <nova:project uuid="4e4596366f424fa7937aaf97828a7c65">tempest-VolumesSnapshotTestJSON-1365341029</nova:project>
Nov 17 03:28:40 user nova-compute[74898]:       </nova:owner>
Nov 17 03:28:40 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:28:40 user nova-compute[74898]:       <nova:ports>
Nov 17 03:28:40 user nova-compute[74898]:         <nova:port uuid="92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3">
Nov 17 03:28:40 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 17 03:28:40 user nova-compute[74898]:         </nova:port>
Nov 17 03:28:40 user nova-compute[74898]:       </nova:ports>
Nov 17 03:28:40 user nova-compute[74898]:     </nova:instance>
Nov 17 03:28:40 user nova-compute[74898]:   </metadata>
Nov 17 03:28:40 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:28:40 user nova-compute[74898]:     <system>
Nov 17 03:28:40 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:28:40 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:28:40 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:28:40 user nova-compute[74898]:       <entry name="serial">f794babb-75e5-41c3-8518-e1b0a78024be</entry>
Nov 17 03:28:40 user nova-compute[74898]:       <entry name="uuid">f794babb-75e5-41c3-8518-e1b0a78024be</entry>
Nov 17 03:28:40 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:28:40 user nova-compute[74898]:     </system>
Nov 17 03:28:40 user nova-compute[74898]:   </sysinfo>
Nov 17 03:28:40 user nova-compute[74898]:   <os>
Nov 17 03:28:40 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:28:40 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:28:40 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:28:40 user nova-compute[74898]:   </os>
Nov 17 03:28:40 user nova-compute[74898]:   <features>
Nov 17 03:28:40 user nova-compute[74898]:     <acpi/>
Nov 17 03:28:40 user nova-compute[74898]:     <apic/>
Nov 17 03:28:40 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:28:40 user nova-compute[74898]:   </features>
Nov 17 03:28:40 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:28:40 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:28:40 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:28:40 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:28:40 user nova-compute[74898]:   </clock>
Nov 17 03:28:40 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:28:40 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:28:40 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:28:40 user nova-compute[74898]:   </cpu>
Nov 17 03:28:40 user nova-compute[74898]:   <devices>
Nov 17 03:28:40 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:28:40 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:28:40 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/f794babb-75e5-41c3-8518-e1b0a78024be/disk"/>
Nov 17 03:28:40 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:28:40 user nova-compute[74898]:     </disk>
Nov 17 03:28:40 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:28:40 user nova-compute[74898]:       <mac address="fa:16:3e:97:1d:8d"/>
Nov 17 03:28:40 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:28:40 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:28:40 user nova-compute[74898]:       <target dev="tap92f7d6e9-a1"/>
Nov 17 03:28:40 user nova-compute[74898]:     </interface>
Nov 17 03:28:40 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:28:40 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/f794babb-75e5-41c3-8518-e1b0a78024be/console.log" append="off"/>
Nov 17 03:28:40 user nova-compute[74898]:     </serial>
Nov 17 03:28:40 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:28:40 user nova-compute[74898]:     <video>
Nov 17 03:28:40 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:28:40 user nova-compute[74898]:     </video>
Nov 17 03:28:40 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:28:40 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:28:40 user nova-compute[74898]:     </rng>
Nov 17 03:28:40 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:28:40 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:28:40 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:28:40 user nova-compute[74898]:     </memballoon>
Nov 17 03:28:40 user nova-compute[74898]:   </devices>
Nov 17 03:28:40 user nova-compute[74898]: </domain>
Nov 17 03:28:40 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:28:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1889443406',display_name='tempest-VolumesSnapshotTestJSON-instance-1889443406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1889443406',id=41,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKjwRjYJ+DEOyHgjZg3dlJK8MGATTQJe/2MTeOsMdCPM3IIX3Fg75cjYcrJ8yIZW/KVZgWrvJcBbec2x+urdoei3dplo6LLhriL2bcg8qMOpvq20aootvbMa0/rJdPuPA==',key_name='tempest-keypair-1447226380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e4596366f424fa7937aaf97828a7c65',ramdisk_id='',reservation_id='r-z8geuiau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1365341029',owner_user_name='tempest-VolumesSnapshotTestJSON-1365341029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:28:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f3d630e4ece4c6c87da71cedcf3a839',uuid=f794babb-75e5-41c3-8518-e1b0a78024be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3", "address": "fa:16:3e:97:1d:8d", "network": {"id": "7ab9395e-a6a0-4b93-990e-d7d064bba5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-894693551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4596366f424fa7937aaf97828a7c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f7d6e9-a1", "ovs_interfaceid": "92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Converting VIF {"id": "92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3", "address": "fa:16:3e:97:1d:8d", "network": {"id": "7ab9395e-a6a0-4b93-990e-d7d064bba5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-894693551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4596366f424fa7937aaf97828a7c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f7d6e9-a1", "ovs_interfaceid": "92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:1d:8d,bridge_name='br-int',has_traffic_filtering=True,id=92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3,network=Network(7ab9395e-a6a0-4b93-990e-d7d064bba5c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92f7d6e9-a1') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG os_vif [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:1d:8d,bridge_name='br-int',has_traffic_filtering=True,id=92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3,network=Network(7ab9395e-a6a0-4b93-990e-d7d064bba5c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92f7d6e9-a1') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5350ab60-1755-5a16-9ce6-5aa4de41a7e7', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92f7d6e9-a1, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92f7d6e9-a1, col_values=(('qos', UUID('392cc3bd-a1f6-4b26-b6aa-591f99876899')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92f7d6e9-a1, col_values=(('external_ids', {'iface-id': '92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:1d:8d', 'vm-uuid': 'f794babb-75e5-41c3-8518-e1b0a78024be'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:40 user nova-compute[74898]: INFO os_vif [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:1d:8d,bridge_name='br-int',has_traffic_filtering=True,id=92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3,network=Network(7ab9395e-a6a0-4b93-990e-d7d064bba5c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92f7d6e9-a1')
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] No VIF found with MAC fa:16:3e:97:1d:8d, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.network.neutron [req-bdc092d8-b84d-40b2-ad09-2e666b52436b req-ef8a256c-8568-4012-ad89-c7f90643fe68 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Updated VIF entry in instance network info cache for port 92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG nova.network.neutron [req-bdc092d8-b84d-40b2-ad09-2e666b52436b req-ef8a256c-8568-4012-ad89-c7f90643fe68 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Updating instance_info_cache with network_info: [{"id": "92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3", "address": "fa:16:3e:97:1d:8d", "network": {"id": "7ab9395e-a6a0-4b93-990e-d7d064bba5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-894693551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4596366f424fa7937aaf97828a7c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f7d6e9-a1", "ovs_interfaceid": "92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-bdc092d8-b84d-40b2-ad09-2e666b52436b req-ef8a256c-8568-4012-ad89-c7f90643fe68 service nova] Releasing lock "refresh_cache-f794babb-75e5-41c3-8518-e1b0a78024be" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:28:40 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:28:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:41 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:28:41 user nova-compute[74898]: DEBUG nova.compute.manager [req-3a0c09fb-077f-48df-8b41-30896fea8b79 req-fdbd4607-369d-4671-b35d-53562ee5d740 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Received event network-vif-plugged-92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:28:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3a0c09fb-077f-48df-8b41-30896fea8b79 req-fdbd4607-369d-4671-b35d-53562ee5d740 service nova] Acquiring lock "f794babb-75e5-41c3-8518-e1b0a78024be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:28:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3a0c09fb-077f-48df-8b41-30896fea8b79 req-fdbd4607-369d-4671-b35d-53562ee5d740 service nova] Lock "f794babb-75e5-41c3-8518-e1b0a78024be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:28:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3a0c09fb-077f-48df-8b41-30896fea8b79 req-fdbd4607-369d-4671-b35d-53562ee5d740 service nova] Lock "f794babb-75e5-41c3-8518-e1b0a78024be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:28:41 user nova-compute[74898]: DEBUG nova.compute.manager [req-3a0c09fb-077f-48df-8b41-30896fea8b79 req-fdbd4607-369d-4671-b35d-53562ee5d740 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] No waiting events found dispatching network-vif-plugged-92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:28:41 user nova-compute[74898]: WARNING nova.compute.manager [req-3a0c09fb-077f-48df-8b41-30896fea8b79 req-fdbd4607-369d-4671-b35d-53562ee5d740 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Received unexpected event network-vif-plugged-92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 for instance with vm_state building and task_state spawning.
Nov 17 03:28:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:42 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:28:42 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:28:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:28:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:28:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:28:42 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:28:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f794babb-75e5-41c3-8518-e1b0a78024be/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:28:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f794babb-75e5-41c3-8518-e1b0a78024be/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:28:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f794babb-75e5-41c3-8518-e1b0a78024be/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:28:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f794babb-75e5-41c3-8518-e1b0a78024be/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:28:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:28:43 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:28:43 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:28:43 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=8846MB free_disk=25.371185302734375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:28:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:28:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:28:43 user nova-compute[74898]: DEBUG nova.compute.manager [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:28:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:28:43 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Instance spawned successfully.
Nov 17 03:28:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:28:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:28:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:28:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:28:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:28:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:28:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:28:43 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 4d9346e0-9692-43b0-a806-8d8dd003fe81 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:28:43 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance f794babb-75e5-41c3-8518-e1b0a78024be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:28:43 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:28:43 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:28:43 user nova-compute[74898]: INFO nova.compute.manager [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Took 5.03 seconds to spawn the instance on the hypervisor.
Nov 17 03:28:43 user nova-compute[74898]: DEBUG nova.compute.manager [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:28:43 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:28:43 user nova-compute[74898]: DEBUG nova.compute.manager [req-3f67637b-bcc7-4bb3-a0a5-782b7a56e1c1 req-1f1c821e-ba4b-4a62-aa6a-59c2f9482898 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Received event network-vif-plugged-92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:28:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3f67637b-bcc7-4bb3-a0a5-782b7a56e1c1 req-1f1c821e-ba4b-4a62-aa6a-59c2f9482898 service nova] Acquiring lock "f794babb-75e5-41c3-8518-e1b0a78024be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:28:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3f67637b-bcc7-4bb3-a0a5-782b7a56e1c1 req-1f1c821e-ba4b-4a62-aa6a-59c2f9482898 service nova] Lock "f794babb-75e5-41c3-8518-e1b0a78024be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:28:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3f67637b-bcc7-4bb3-a0a5-782b7a56e1c1 req-1f1c821e-ba4b-4a62-aa6a-59c2f9482898 service nova] Lock "f794babb-75e5-41c3-8518-e1b0a78024be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:28:43 user nova-compute[74898]: DEBUG nova.compute.manager [req-3f67637b-bcc7-4bb3-a0a5-782b7a56e1c1 req-1f1c821e-ba4b-4a62-aa6a-59c2f9482898 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] No waiting events found dispatching network-vif-plugged-92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:28:43 user nova-compute[74898]: WARNING nova.compute.manager [req-3f67637b-bcc7-4bb3-a0a5-782b7a56e1c1 req-1f1c821e-ba4b-4a62-aa6a-59c2f9482898 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Received unexpected event network-vif-plugged-92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 for instance with vm_state building and task_state spawning.
Nov 17 03:28:43 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:28:43 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:28:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:28:43 user nova-compute[74898]: INFO nova.compute.manager [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Took 5.54 seconds to build instance.
Nov 17 03:28:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4fbe269b-64b7-4ff3-893a-2e2d782462df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "f794babb-75e5-41c3-8518-e1b0a78024be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.624s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:28:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:45 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:28:45 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:28:45 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Rebuilding the list of instances to heal {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 03:28:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-4d9346e0-9692-43b0-a806-8d8dd003fe81" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:28:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-4d9346e0-9692-43b0-a806-8d8dd003fe81" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:28:45 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:28:45 user nova-compute[74898]: DEBUG nova.objects.instance [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lazy-loading 'info_cache' on Instance uuid 4d9346e0-9692-43b0-a806-8d8dd003fe81 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:28:46 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Updating instance_info_cache with network_info: [{"id": "5ebae55c-de20-446a-86ca-1b569310a2f4", "address": "fa:16:3e:c8:63:88", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ebae55c-de", "ovs_interfaceid": "5ebae55c-de20-446a-86ca-1b569310a2f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:28:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-4d9346e0-9692-43b0-a806-8d8dd003fe81" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:28:46 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:28:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:47 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:28:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:28:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:29:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:02 user nova-compute[74898]: DEBUG nova.compute.manager [req-163489b5-e3f5-42de-b512-de7568217322 req-65577d40-bfd1-4168-aea2-e8d32bca07eb service nova] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Received event network-changed-5ebae55c-de20-446a-86ca-1b569310a2f4 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:29:02 user nova-compute[74898]: DEBUG nova.compute.manager [req-163489b5-e3f5-42de-b512-de7568217322 req-65577d40-bfd1-4168-aea2-e8d32bca07eb service nova] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Refreshing instance network info cache due to event network-changed-5ebae55c-de20-446a-86ca-1b569310a2f4. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:29:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-163489b5-e3f5-42de-b512-de7568217322 req-65577d40-bfd1-4168-aea2-e8d32bca07eb service nova] Acquiring lock "refresh_cache-4d9346e0-9692-43b0-a806-8d8dd003fe81" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:29:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-163489b5-e3f5-42de-b512-de7568217322 req-65577d40-bfd1-4168-aea2-e8d32bca07eb service nova] Acquired lock "refresh_cache-4d9346e0-9692-43b0-a806-8d8dd003fe81" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:29:02 user nova-compute[74898]: DEBUG nova.network.neutron [req-163489b5-e3f5-42de-b512-de7568217322 req-65577d40-bfd1-4168-aea2-e8d32bca07eb service nova] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Refreshing network info cache for port 5ebae55c-de20-446a-86ca-1b569310a2f4 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:29:02 user nova-compute[74898]: DEBUG nova.network.neutron [req-163489b5-e3f5-42de-b512-de7568217322 req-65577d40-bfd1-4168-aea2-e8d32bca07eb service nova] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Updated VIF entry in instance network info cache for port 5ebae55c-de20-446a-86ca-1b569310a2f4. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:29:02 user nova-compute[74898]: DEBUG nova.network.neutron [req-163489b5-e3f5-42de-b512-de7568217322 req-65577d40-bfd1-4168-aea2-e8d32bca07eb service nova] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Updating instance_info_cache with network_info: [{"id": "5ebae55c-de20-446a-86ca-1b569310a2f4", "address": "fa:16:3e:c8:63:88", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ebae55c-de", "ovs_interfaceid": "5ebae55c-de20-446a-86ca-1b569310a2f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:29:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-163489b5-e3f5-42de-b512-de7568217322 req-65577d40-bfd1-4168-aea2-e8d32bca07eb service nova] Releasing lock "refresh_cache-4d9346e0-9692-43b0-a806-8d8dd003fe81" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:29:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "4d9346e0-9692-43b0-a806-8d8dd003fe81" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:29:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "4d9346e0-9692-43b0-a806-8d8dd003fe81" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:29:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "4d9346e0-9692-43b0-a806-8d8dd003fe81-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:29:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "4d9346e0-9692-43b0-a806-8d8dd003fe81-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:29:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "4d9346e0-9692-43b0-a806-8d8dd003fe81-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:29:02 user nova-compute[74898]: INFO nova.compute.manager [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Terminating instance
Nov 17 03:29:02 user nova-compute[74898]: DEBUG nova.compute.manager [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:29:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:02 user nova-compute[74898]: DEBUG nova.compute.manager [req-f7322696-dce9-497b-977c-32bf8fae7470 req-427ad3c2-3d71-4c02-8ea3-f519e86fea6b service nova] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Received event network-vif-unplugged-5ebae55c-de20-446a-86ca-1b569310a2f4 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:29:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f7322696-dce9-497b-977c-32bf8fae7470 req-427ad3c2-3d71-4c02-8ea3-f519e86fea6b service nova] Acquiring lock "4d9346e0-9692-43b0-a806-8d8dd003fe81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:29:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f7322696-dce9-497b-977c-32bf8fae7470 req-427ad3c2-3d71-4c02-8ea3-f519e86fea6b service nova] Lock "4d9346e0-9692-43b0-a806-8d8dd003fe81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:29:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f7322696-dce9-497b-977c-32bf8fae7470 req-427ad3c2-3d71-4c02-8ea3-f519e86fea6b service nova] Lock "4d9346e0-9692-43b0-a806-8d8dd003fe81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:29:02 user nova-compute[74898]: DEBUG nova.compute.manager [req-f7322696-dce9-497b-977c-32bf8fae7470 req-427ad3c2-3d71-4c02-8ea3-f519e86fea6b service nova] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] No waiting events found dispatching network-vif-unplugged-5ebae55c-de20-446a-86ca-1b569310a2f4 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:29:02 user nova-compute[74898]: DEBUG nova.compute.manager [req-f7322696-dce9-497b-977c-32bf8fae7470 req-427ad3c2-3d71-4c02-8ea3-f519e86fea6b service nova] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Received event network-vif-unplugged-5ebae55c-de20-446a-86ca-1b569310a2f4 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:29:03 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Instance destroyed successfully.
Nov 17 03:29:03 user nova-compute[74898]: DEBUG nova.objects.instance [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lazy-loading 'resources' on Instance uuid 4d9346e0-9692-43b0-a806-8d8dd003fe81 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:27:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-851751850',display_name='tempest-TestVolumeBootPattern-server-851751850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-851751850',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJInWWavbu/6d6OQJPNghOKND7RIoCzZc2qCUfAkCC2TokwiJfdMvyOxWX8lLSW7Fx1YLwTdFBaDgYlG8DKkEJfoMkAf+B/utXvLWusVeA4Z9dMFCfioGuJoTmK0Ain2zQ==',key_name='tempest-TestVolumeBootPattern-1387915334',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:27:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d36087cc8e842c0bfcae89553fb9841',ramdisk_id='',reservation_id='r-46m0lb70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1382126375',owner_user_name='tempest-TestVolumeBootPattern-1382126375-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:27:21Z,user_data=None,user_id='aa779a5f98394629b6b9fa9d04233e7a',uuid=4d9346e0-9692-43b0-a806-8d8dd003fe81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ebae55c-de20-446a-86ca-1b569310a2f4", "address": "fa:16:3e:c8:63:88", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ebae55c-de", "ovs_interfaceid": "5ebae55c-de20-446a-86ca-1b569310a2f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converting VIF {"id": "5ebae55c-de20-446a-86ca-1b569310a2f4", "address": "fa:16:3e:c8:63:88", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ebae55c-de", "ovs_interfaceid": "5ebae55c-de20-446a-86ca-1b569310a2f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:63:88,bridge_name='br-int',has_traffic_filtering=True,id=5ebae55c-de20-446a-86ca-1b569310a2f4,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ebae55c-de') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG os_vif [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:63:88,bridge_name='br-int',has_traffic_filtering=True,id=5ebae55c-de20-446a-86ca-1b569310a2f4,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ebae55c-de') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ebae55c-de, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=86d56097-38ba-4da1-825e-27f0e1b3a828) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:29:03 user nova-compute[74898]: INFO os_vif [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:63:88,bridge_name='br-int',has_traffic_filtering=True,id=5ebae55c-de20-446a-86ca-1b569310a2f4,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ebae55c-de')
Nov 17 03:29:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxlbaNWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:29:03 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:29:03 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e455ff97-c810-4380-969a-3489f8ece889]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:29:03 user nova-compute[74898]: No targets found.
Nov 17 03:29:03 user nova-compute[74898]: iSNS:
Nov 17 03:29:03 user nova-compute[74898]: No targets found.
Nov 17 03:29:03 user nova-compute[74898]: STATIC:
Nov 17 03:29:03 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f
Nov 17 03:29:03 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:29:03 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:29:03 user nova-compute[74898]: FIRMWARE:
Nov 17 03:29:03 user nova-compute[74898]: No targets found.
Nov 17 03:29:03 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:29:03 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:29:03 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcd6330-c9ed-43cb-bb5f-4d02944d1084]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e2866d-29bb-4b63-b0d0-9e2b92e2aa12]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:29:03 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:29:03 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf8699750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f'): ({'sdb'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Removing single pathed devices sdb {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1515a1-e476-4f50-ac5d-21e6ee070131]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de702aa-7d2c-4f0d-8a7e-2159f7225780]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Flushing IO for device /dev/sdb {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ee067b-553b-45e6-bfe4-1be31b355d15]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[19275acc-3d7a-4bfd-bafe-b4e69e1564bd]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23035313539643335', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9d1897e7', '/dev/disk/by-id/scsi-1SCST_BIO9d1897e7-05159d35a4048cc6') {{(pid=86021) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bf115f-256c-4856-8694-5e5909b30206]: (4, None) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb8343d-f120-42ff-b25e-26acc277e5c1]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[530e0330-8d64-4161-9465-f865c8b77846]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f, portal: 172.16.0.220,3260]
Nov 17 03:29:03 user nova-compute[74898]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f, portal: 172.16.0.220,3260] successful.
Nov 17 03:29:03 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12fcb59-7669-4ed7-ad0a-42d2e7cac5e6]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] <== disconnect_volume: return (287ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:29:03 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Deleting instance files /opt/stack/data/nova/instances/4d9346e0-9692-43b0-a806-8d8dd003fe81_del
Nov 17 03:29:03 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Deletion of /opt/stack/data/nova/instances/4d9346e0-9692-43b0-a806-8d8dd003fe81_del complete
Nov 17 03:29:03 user nova-compute[74898]: INFO nova.compute.manager [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 17 03:29:03 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:29:03 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:29:04 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:29:04 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Took 1.04 seconds to deallocate network for instance.
Nov 17 03:29:04 user nova-compute[74898]: DEBUG nova.compute.manager [req-986a1af0-1928-48c0-a94c-7bd4c7bdbe93 req-ad745194-9cb2-448f-aabc-49db4d9d358d service nova] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Received event network-vif-deleted-5ebae55c-de20-446a-86ca-1b569310a2f4 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:29:04 user nova-compute[74898]: DEBUG nova.compute.manager [req-4460ed44-80d7-4310-b59e-8155a5df8975 req-0d5fc78e-c0db-4818-a332-da9a3be94de5 service nova] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Received event network-vif-plugged-5ebae55c-de20-446a-86ca-1b569310a2f4 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:29:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4460ed44-80d7-4310-b59e-8155a5df8975 req-0d5fc78e-c0db-4818-a332-da9a3be94de5 service nova] Acquiring lock "4d9346e0-9692-43b0-a806-8d8dd003fe81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:29:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4460ed44-80d7-4310-b59e-8155a5df8975 req-0d5fc78e-c0db-4818-a332-da9a3be94de5 service nova] Lock "4d9346e0-9692-43b0-a806-8d8dd003fe81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:29:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-4460ed44-80d7-4310-b59e-8155a5df8975 req-0d5fc78e-c0db-4818-a332-da9a3be94de5 service nova] Lock "4d9346e0-9692-43b0-a806-8d8dd003fe81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:29:04 user nova-compute[74898]: DEBUG nova.compute.manager [req-4460ed44-80d7-4310-b59e-8155a5df8975 req-0d5fc78e-c0db-4818-a332-da9a3be94de5 service nova] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] No waiting events found dispatching network-vif-plugged-5ebae55c-de20-446a-86ca-1b569310a2f4 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:29:04 user nova-compute[74898]: WARNING nova.compute.manager [req-4460ed44-80d7-4310-b59e-8155a5df8975 req-0d5fc78e-c0db-4818-a332-da9a3be94de5 service nova] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Received unexpected event network-vif-plugged-5ebae55c-de20-446a-86ca-1b569310a2f4 for instance with vm_state active and task_state deleting.
Nov 17 03:29:05 user nova-compute[74898]: INFO nova.compute.manager [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 4d9346e0-9692-43b0-a806-8d8dd003fe81] Took 0.73 seconds to detach 1 volumes for instance.
Nov 17 03:29:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:29:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:29:05 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:29:05 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:29:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:29:05 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Deleted allocations for instance 4d9346e0-9692-43b0-a806-8d8dd003fe81
Nov 17 03:29:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-28794d55-8279-47bf-9599-50461ec493e9 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "4d9346e0-9692-43b0-a806-8d8dd003fe81" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.222s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:29:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:16 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:29:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "21cd1abc-80ab-470b-9f69-19ccfa835f25" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:29:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "21cd1abc-80ab-470b-9f69-19ccfa835f25" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:29:28 user nova-compute[74898]: DEBUG nova.compute.manager [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:29:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:29:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:29:28 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:29:28 user nova-compute[74898]: INFO nova.compute.claims [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Claim successful on node user
Nov 17 03:29:28 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:29:28 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:29:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.218s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:29:28 user nova-compute[74898]: DEBUG nova.compute.manager [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:29:28 user nova-compute[74898]: DEBUG nova.compute.manager [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:29:28 user nova-compute[74898]: DEBUG nova.network.neutron [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:29:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:28 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:29:28 user nova-compute[74898]: DEBUG nova.compute.manager [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:29:28 user nova-compute[74898]: DEBUG nova.policy [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7660b84c605b4a459065b10fda42043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498d9d0f6667441791a7175256e4c557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:29:28 user nova-compute[74898]: DEBUG nova.compute.manager [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:29:28 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:29:28 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Creating image(s)
Nov 17 03:29:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "/opt/stack/data/nova/instances/21cd1abc-80ab-470b-9f69-19ccfa835f25/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:29:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "/opt/stack/data/nova/instances/21cd1abc-80ab-470b-9f69-19ccfa835f25/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:29:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "/opt/stack/data/nova/instances/21cd1abc-80ab-470b-9f69-19ccfa835f25/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:29:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:29:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.179s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:29:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:29:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:29:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:29:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:29:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/21cd1abc-80ab-470b-9f69-19ccfa835f25/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:29:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/21cd1abc-80ab-470b-9f69-19ccfa835f25/disk 1073741824" returned: 0 in 0.048s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:29:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:29:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG nova.network.neutron [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Successfully created port: 89bde492-00b9-4912-a5b7-54a57e2c6350 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.179s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Checking if we can resize image /opt/stack/data/nova/instances/21cd1abc-80ab-470b-9f69-19ccfa835f25/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cd1abc-80ab-470b-9f69-19ccfa835f25/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cd1abc-80ab-470b-9f69-19ccfa835f25/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Cannot resize image /opt/stack/data/nova/instances/21cd1abc-80ab-470b-9f69-19ccfa835f25/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Ensure instance console log exists: /opt/stack/data/nova/instances/21cd1abc-80ab-470b-9f69-19ccfa835f25/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG nova.network.neutron [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Successfully updated port: 89bde492-00b9-4912-a5b7-54a57e2c6350 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "refresh_cache-21cd1abc-80ab-470b-9f69-19ccfa835f25" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquired lock "refresh_cache-21cd1abc-80ab-470b-9f69-19ccfa835f25" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG nova.network.neutron [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG nova.compute.manager [req-e51912f1-22f8-40cd-91ca-b664e300ac40 req-8adac570-8ca0-4df5-9391-39d79b64fd5b service nova] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Received event network-changed-89bde492-00b9-4912-a5b7-54a57e2c6350 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG nova.compute.manager [req-e51912f1-22f8-40cd-91ca-b664e300ac40 req-8adac570-8ca0-4df5-9391-39d79b64fd5b service nova] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Refreshing instance network info cache due to event network-changed-89bde492-00b9-4912-a5b7-54a57e2c6350. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e51912f1-22f8-40cd-91ca-b664e300ac40 req-8adac570-8ca0-4df5-9391-39d79b64fd5b service nova] Acquiring lock "refresh_cache-21cd1abc-80ab-470b-9f69-19ccfa835f25" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG nova.network.neutron [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG nova.network.neutron [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Updating instance_info_cache with network_info: [{"id": "89bde492-00b9-4912-a5b7-54a57e2c6350", "address": "fa:16:3e:48:24:a3", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bde492-00", "ovs_interfaceid": "89bde492-00b9-4912-a5b7-54a57e2c6350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Releasing lock "refresh_cache-21cd1abc-80ab-470b-9f69-19ccfa835f25" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG nova.compute.manager [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Instance network_info: |[{"id": "89bde492-00b9-4912-a5b7-54a57e2c6350", "address": "fa:16:3e:48:24:a3", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bde492-00", "ovs_interfaceid": "89bde492-00b9-4912-a5b7-54a57e2c6350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e51912f1-22f8-40cd-91ca-b664e300ac40 req-8adac570-8ca0-4df5-9391-39d79b64fd5b service nova] Acquired lock "refresh_cache-21cd1abc-80ab-470b-9f69-19ccfa835f25" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG nova.network.neutron [req-e51912f1-22f8-40cd-91ca-b664e300ac40 req-8adac570-8ca0-4df5-9391-39d79b64fd5b service nova] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Refreshing network info cache for port 89bde492-00b9-4912-a5b7-54a57e2c6350 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Start _get_guest_xml network_info=[{"id": "89bde492-00b9-4912-a5b7-54a57e2c6350", "address": "fa:16:3e:48:24:a3", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bde492-00", "ovs_interfaceid": "89bde492-00b9-4912-a5b7-54a57e2c6350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:29:29 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:29:29 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:29:29 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:29:29 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:29:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1495709360',display_name='tempest-AttachVolumeNegativeTest-server-1495709360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1495709360',id=42,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1vcerUzfGrP33vHioK84oKFHRJydnC1QBOhoPYxHB54rEwf+omA4vyl3thKR/44zo0TKlIfFRjFLoL43B9i7jjoyf88XL/H7DGliodGbhx/QpN/fiUlkdbAg5G9DV7tQ==',key_name='tempest-keypair-1964879227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='498d9d0f6667441791a7175256e4c557',ramdisk_id='',reservation_id='r-oahdlzbv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1401299497',owner_user_name='tempest-AttachVolumeNegativeTest-1401299497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:29:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7660b84c605b4a459065b10fda42043f',uuid=21cd1abc-80ab-470b-9f69-19ccfa835f25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89bde492-00b9-4912-a5b7-54a57e2c6350", "address": "fa:16:3e:48:24:a3", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bde492-00", "ovs_interfaceid": "89bde492-00b9-4912-a5b7-54a57e2c6350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:29:30 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Converting VIF {"id": "89bde492-00b9-4912-a5b7-54a57e2c6350", "address": "fa:16:3e:48:24:a3", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bde492-00", "ovs_interfaceid": "89bde492-00b9-4912-a5b7-54a57e2c6350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:29:30 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:24:a3,bridge_name='br-int',has_traffic_filtering=True,id=89bde492-00b9-4912-a5b7-54a57e2c6350,network=Network(d02a6f85-70ee-4ed7-ae00-decabd94d542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89bde492-00') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:29:30 user nova-compute[74898]: DEBUG nova.objects.instance [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lazy-loading 'pci_devices' on Instance uuid 21cd1abc-80ab-470b-9f69-19ccfa835f25 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:29:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:29:30 user nova-compute[74898]:   <uuid>21cd1abc-80ab-470b-9f69-19ccfa835f25</uuid>
Nov 17 03:29:30 user nova-compute[74898]:   <name>instance-0000002a</name>
Nov 17 03:29:30 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:29:30 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:29:30 user nova-compute[74898]:   <metadata>
Nov 17 03:29:30 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:29:30 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:29:30 user nova-compute[74898]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1495709360</nova:name>
Nov 17 03:29:30 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:29:29</nova:creationTime>
Nov 17 03:29:30 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:29:30 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:29:30 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:29:30 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:29:30 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:29:30 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:29:30 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:29:30 user nova-compute[74898]:       <nova:owner>
Nov 17 03:29:30 user nova-compute[74898]:         <nova:user uuid="7660b84c605b4a459065b10fda42043f">tempest-AttachVolumeNegativeTest-1401299497-project-member</nova:user>
Nov 17 03:29:30 user nova-compute[74898]:         <nova:project uuid="498d9d0f6667441791a7175256e4c557">tempest-AttachVolumeNegativeTest-1401299497</nova:project>
Nov 17 03:29:30 user nova-compute[74898]:       </nova:owner>
Nov 17 03:29:30 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:29:30 user nova-compute[74898]:       <nova:ports>
Nov 17 03:29:30 user nova-compute[74898]:         <nova:port uuid="89bde492-00b9-4912-a5b7-54a57e2c6350">
Nov 17 03:29:30 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 17 03:29:30 user nova-compute[74898]:         </nova:port>
Nov 17 03:29:30 user nova-compute[74898]:       </nova:ports>
Nov 17 03:29:30 user nova-compute[74898]:     </nova:instance>
Nov 17 03:29:30 user nova-compute[74898]:   </metadata>
Nov 17 03:29:30 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:29:30 user nova-compute[74898]:     <system>
Nov 17 03:29:30 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:29:30 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:29:30 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:29:30 user nova-compute[74898]:       <entry name="serial">21cd1abc-80ab-470b-9f69-19ccfa835f25</entry>
Nov 17 03:29:30 user nova-compute[74898]:       <entry name="uuid">21cd1abc-80ab-470b-9f69-19ccfa835f25</entry>
Nov 17 03:29:30 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:29:30 user nova-compute[74898]:     </system>
Nov 17 03:29:30 user nova-compute[74898]:   </sysinfo>
Nov 17 03:29:30 user nova-compute[74898]:   <os>
Nov 17 03:29:30 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:29:30 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:29:30 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:29:30 user nova-compute[74898]:   </os>
Nov 17 03:29:30 user nova-compute[74898]:   <features>
Nov 17 03:29:30 user nova-compute[74898]:     <acpi/>
Nov 17 03:29:30 user nova-compute[74898]:     <apic/>
Nov 17 03:29:30 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:29:30 user nova-compute[74898]:   </features>
Nov 17 03:29:30 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:29:30 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:29:30 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:29:30 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:29:30 user nova-compute[74898]:   </clock>
Nov 17 03:29:30 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:29:30 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:29:30 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:29:30 user nova-compute[74898]:   </cpu>
Nov 17 03:29:30 user nova-compute[74898]:   <devices>
Nov 17 03:29:30 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:29:30 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:29:30 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/21cd1abc-80ab-470b-9f69-19ccfa835f25/disk"/>
Nov 17 03:29:30 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:29:30 user nova-compute[74898]:     </disk>
Nov 17 03:29:30 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:29:30 user nova-compute[74898]:       <mac address="fa:16:3e:48:24:a3"/>
Nov 17 03:29:30 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:29:30 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:29:30 user nova-compute[74898]:       <target dev="tap89bde492-00"/>
Nov 17 03:29:30 user nova-compute[74898]:     </interface>
Nov 17 03:29:30 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:29:30 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/21cd1abc-80ab-470b-9f69-19ccfa835f25/console.log" append="off"/>
Nov 17 03:29:30 user nova-compute[74898]:     </serial>
Nov 17 03:29:30 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:29:30 user nova-compute[74898]:     <video>
Nov 17 03:29:30 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:29:30 user nova-compute[74898]:     </video>
Nov 17 03:29:30 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:29:30 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:29:30 user nova-compute[74898]:     </rng>
Nov 17 03:29:30 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:29:30 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:29:30 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:29:30 user nova-compute[74898]:     </memballoon>
Nov 17 03:29:30 user nova-compute[74898]:   </devices>
Nov 17 03:29:30 user nova-compute[74898]: </domain>
Nov 17 03:29:30 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:29:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1495709360',display_name='tempest-AttachVolumeNegativeTest-server-1495709360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1495709360',id=42,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1vcerUzfGrP33vHioK84oKFHRJydnC1QBOhoPYxHB54rEwf+omA4vyl3thKR/44zo0TKlIfFRjFLoL43B9i7jjoyf88XL/H7DGliodGbhx/QpN/fiUlkdbAg5G9DV7tQ==',key_name='tempest-keypair-1964879227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='498d9d0f6667441791a7175256e4c557',ramdisk_id='',reservation_id='r-oahdlzbv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1401299497',owner_user_name='tempest-AttachVolumeNegativeTest-1401299497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:29:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7660b84c605b4a459065b10fda42043f',uuid=21cd1abc-80ab-470b-9f69-19ccfa835f25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89bde492-00b9-4912-a5b7-54a57e2c6350", "address": "fa:16:3e:48:24:a3", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bde492-00", "ovs_interfaceid": "89bde492-00b9-4912-a5b7-54a57e2c6350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:29:30 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Converting VIF {"id": "89bde492-00b9-4912-a5b7-54a57e2c6350", "address": "fa:16:3e:48:24:a3", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bde492-00", "ovs_interfaceid": "89bde492-00b9-4912-a5b7-54a57e2c6350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:29:30 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:24:a3,bridge_name='br-int',has_traffic_filtering=True,id=89bde492-00b9-4912-a5b7-54a57e2c6350,network=Network(d02a6f85-70ee-4ed7-ae00-decabd94d542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89bde492-00') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:29:30 user nova-compute[74898]: DEBUG os_vif [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:24:a3,bridge_name='br-int',has_traffic_filtering=True,id=89bde492-00b9-4912-a5b7-54a57e2c6350,network=Network(d02a6f85-70ee-4ed7-ae00-decabd94d542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89bde492-00') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:29:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:29:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:29:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4e9d98b-44eb-5c1c-bf5d-aebe9fc8612e', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:29:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89bde492-00, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:29:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89bde492-00, col_values=(('qos', UUID('70d0cc26-6d56-4a47-9e3d-03a6f15b21b9')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:29:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89bde492-00, col_values=(('external_ids', {'iface-id': '89bde492-00b9-4912-a5b7-54a57e2c6350', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:24:a3', 'vm-uuid': '21cd1abc-80ab-470b-9f69-19ccfa835f25'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:29:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:29:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:30 user nova-compute[74898]: INFO os_vif [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:24:a3,bridge_name='br-int',has_traffic_filtering=True,id=89bde492-00b9-4912-a5b7-54a57e2c6350,network=Network(d02a6f85-70ee-4ed7-ae00-decabd94d542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89bde492-00')
Nov 17 03:29:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:29:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] No VIF found with MAC fa:16:3e:48:24:a3, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:29:30 user nova-compute[74898]: DEBUG nova.network.neutron [req-e51912f1-22f8-40cd-91ca-b664e300ac40 req-8adac570-8ca0-4df5-9391-39d79b64fd5b service nova] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Updated VIF entry in instance network info cache for port 89bde492-00b9-4912-a5b7-54a57e2c6350. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:29:30 user nova-compute[74898]: DEBUG nova.network.neutron [req-e51912f1-22f8-40cd-91ca-b664e300ac40 req-8adac570-8ca0-4df5-9391-39d79b64fd5b service nova] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Updating instance_info_cache with network_info: [{"id": "89bde492-00b9-4912-a5b7-54a57e2c6350", "address": "fa:16:3e:48:24:a3", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bde492-00", "ovs_interfaceid": "89bde492-00b9-4912-a5b7-54a57e2c6350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:29:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e51912f1-22f8-40cd-91ca-b664e300ac40 req-8adac570-8ca0-4df5-9391-39d79b64fd5b service nova] Releasing lock "refresh_cache-21cd1abc-80ab-470b-9f69-19ccfa835f25" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:29:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:31 user nova-compute[74898]: DEBUG nova.compute.manager [req-764b3ad0-22c5-4d99-a1d8-79ba69cdd874 req-a4c145dd-35a3-428d-ba64-382390aaea46 service nova] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Received event network-vif-plugged-89bde492-00b9-4912-a5b7-54a57e2c6350 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:29:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-764b3ad0-22c5-4d99-a1d8-79ba69cdd874 req-a4c145dd-35a3-428d-ba64-382390aaea46 service nova] Acquiring lock "21cd1abc-80ab-470b-9f69-19ccfa835f25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:29:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-764b3ad0-22c5-4d99-a1d8-79ba69cdd874 req-a4c145dd-35a3-428d-ba64-382390aaea46 service nova] Lock "21cd1abc-80ab-470b-9f69-19ccfa835f25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:29:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-764b3ad0-22c5-4d99-a1d8-79ba69cdd874 req-a4c145dd-35a3-428d-ba64-382390aaea46 service nova] Lock "21cd1abc-80ab-470b-9f69-19ccfa835f25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:29:31 user nova-compute[74898]: DEBUG nova.compute.manager [req-764b3ad0-22c5-4d99-a1d8-79ba69cdd874 req-a4c145dd-35a3-428d-ba64-382390aaea46 service nova] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] No waiting events found dispatching network-vif-plugged-89bde492-00b9-4912-a5b7-54a57e2c6350 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:29:31 user nova-compute[74898]: WARNING nova.compute.manager [req-764b3ad0-22c5-4d99-a1d8-79ba69cdd874 req-a4c145dd-35a3-428d-ba64-382390aaea46 service nova] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Received unexpected event network-vif-plugged-89bde492-00b9-4912-a5b7-54a57e2c6350 for instance with vm_state building and task_state spawning.
Nov 17 03:29:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:33 user nova-compute[74898]: DEBUG nova.compute.manager [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:29:33 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:29:33 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Instance spawned successfully.
Nov 17 03:29:33 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:29:33 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:29:33 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:29:33 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:29:33 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:29:33 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:29:33 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:29:33 user nova-compute[74898]: DEBUG nova.compute.manager [req-ebe8273f-7224-42b3-b42e-e20a83b7e88f req-374e9460-8e5a-4761-9397-43827b0b133e service nova] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Received event network-vif-plugged-89bde492-00b9-4912-a5b7-54a57e2c6350 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:29:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ebe8273f-7224-42b3-b42e-e20a83b7e88f req-374e9460-8e5a-4761-9397-43827b0b133e service nova] Acquiring lock "21cd1abc-80ab-470b-9f69-19ccfa835f25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:29:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ebe8273f-7224-42b3-b42e-e20a83b7e88f req-374e9460-8e5a-4761-9397-43827b0b133e service nova] Lock "21cd1abc-80ab-470b-9f69-19ccfa835f25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:29:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ebe8273f-7224-42b3-b42e-e20a83b7e88f req-374e9460-8e5a-4761-9397-43827b0b133e service nova] Lock "21cd1abc-80ab-470b-9f69-19ccfa835f25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:29:33 user nova-compute[74898]: DEBUG nova.compute.manager [req-ebe8273f-7224-42b3-b42e-e20a83b7e88f req-374e9460-8e5a-4761-9397-43827b0b133e service nova] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] No waiting events found dispatching network-vif-plugged-89bde492-00b9-4912-a5b7-54a57e2c6350 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:29:33 user nova-compute[74898]: WARNING nova.compute.manager [req-ebe8273f-7224-42b3-b42e-e20a83b7e88f req-374e9460-8e5a-4761-9397-43827b0b133e service nova] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Received unexpected event network-vif-plugged-89bde492-00b9-4912-a5b7-54a57e2c6350 for instance with vm_state building and task_state spawning.
Nov 17 03:29:33 user nova-compute[74898]: INFO nova.compute.manager [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Took 5.12 seconds to spawn the instance on the hypervisor.
Nov 17 03:29:33 user nova-compute[74898]: DEBUG nova.compute.manager [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:29:33 user nova-compute[74898]: INFO nova.compute.manager [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Took 5.65 seconds to build instance.
Nov 17 03:29:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-293a6b9e-5e1c-4fbe-8ca5-d769f68500be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "21cd1abc-80ab-470b-9f69-19ccfa835f25" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.754s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:29:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:37 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:29:37 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:29:39 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:29:39 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:29:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:40 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:29:41 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:29:42 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:29:43 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:29:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:29:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:29:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:29:43 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:29:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cd1abc-80ab-470b-9f69-19ccfa835f25/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:29:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cd1abc-80ab-470b-9f69-19ccfa835f25/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:29:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cd1abc-80ab-470b-9f69-19ccfa835f25/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:29:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cd1abc-80ab-470b-9f69-19ccfa835f25/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:29:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f794babb-75e5-41c3-8518-e1b0a78024be/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:29:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f794babb-75e5-41c3-8518-e1b0a78024be/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:29:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f794babb-75e5-41c3-8518-e1b0a78024be/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:29:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f794babb-75e5-41c3-8518-e1b0a78024be/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:29:44 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:29:44 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:29:44 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=8846MB free_disk=25.325149536132812GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:29:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:29:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:29:45 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance f794babb-75e5-41c3-8518-e1b0a78024be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:29:45 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 21cd1abc-80ab-470b-9f69-19ccfa835f25 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:29:45 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:29:45 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:29:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:45 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:29:45 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:29:45 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:29:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.225s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:29:47 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:29:47 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:29:47 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:29:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-f794babb-75e5-41c3-8518-e1b0a78024be" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:29:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-f794babb-75e5-41c3-8518-e1b0a78024be" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:29:47 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:29:47 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Updating instance_info_cache with network_info: [{"id": "92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3", "address": "fa:16:3e:97:1d:8d", "network": {"id": "7ab9395e-a6a0-4b93-990e-d7d064bba5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-894693551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4596366f424fa7937aaf97828a7c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f7d6e9-a1", "ovs_interfaceid": "92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:29:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-f794babb-75e5-41c3-8518-e1b0a78024be" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:29:47 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:29:47 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:29:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "f3c85dac-e42c-4b33-842f-3fb681cdc2ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "f3c85dac-e42c-4b33-842f-3fb681cdc2ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG nova.compute.manager [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:29:54 user nova-compute[74898]: INFO nova.compute.claims [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Claim successful on node user
Nov 17 03:29:54 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG nova.compute.manager [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG nova.compute.manager [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG nova.network.neutron [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:29:54 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:29:54 user nova-compute[74898]: DEBUG nova.compute.manager [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:29:54 user nova-compute[74898]: INFO nova.virt.block_device [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Booting with volume 137dde58-30b0-4893-8678-f1fb9a2c4e6f at /dev/vda
Nov 17 03:29:54 user nova-compute[74898]: DEBUG nova.policy [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa779a5f98394629b6b9fa9d04233e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d36087cc8e842c0bfcae89553fb9841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG os_brick.utils [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a658b3-a0be-4ad6-8c01-005200669b61]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce25eab-e7b9-4be0-8eb1-0c29909e6813]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[de08aad1-72ec-4501-a4b0-5ce7c6fc8875]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7413f924-c560-4389-a3d3-f08ed955a984]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:29:54 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:29:54 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b95bf28-4b99-4c2c-84ea-64f8d22de2ea]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG os_brick.utils [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:29:54 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Updating existing volume attachment record: 7c8b8d40-77c8-4c8f-8252-4dc147600c44 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:29:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:29:55 user nova-compute[74898]: DEBUG nova.network.neutron [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Successfully created port: 4fe8a0b3-a4f4-488d-937b-cdd22978a04e {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:29:55 user nova-compute[74898]: DEBUG nova.network.neutron [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Successfully updated port: 4fe8a0b3-a4f4-488d-937b-cdd22978a04e {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:29:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "refresh_cache-f3c85dac-e42c-4b33-842f-3fb681cdc2ee" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:29:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquired lock "refresh_cache-f3c85dac-e42c-4b33-842f-3fb681cdc2ee" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:29:56 user nova-compute[74898]: DEBUG nova.network.neutron [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:29:56 user nova-compute[74898]: DEBUG nova.compute.manager [req-94e1fa35-54b4-4fd6-a552-c757b04cfaef req-08d714d3-2def-4ba8-ad62-8f3baee3c42a service nova] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Received event network-changed-4fe8a0b3-a4f4-488d-937b-cdd22978a04e {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:29:56 user nova-compute[74898]: DEBUG nova.compute.manager [req-94e1fa35-54b4-4fd6-a552-c757b04cfaef req-08d714d3-2def-4ba8-ad62-8f3baee3c42a service nova] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Refreshing instance network info cache due to event network-changed-4fe8a0b3-a4f4-488d-937b-cdd22978a04e. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:29:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-94e1fa35-54b4-4fd6-a552-c757b04cfaef req-08d714d3-2def-4ba8-ad62-8f3baee3c42a service nova] Acquiring lock "refresh_cache-f3c85dac-e42c-4b33-842f-3fb681cdc2ee" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:29:56 user nova-compute[74898]: DEBUG nova.network.neutron [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:29:56 user nova-compute[74898]: DEBUG nova.network.neutron [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Updating instance_info_cache with network_info: [{"id": "4fe8a0b3-a4f4-488d-937b-cdd22978a04e", "address": "fa:16:3e:fc:f8:0f", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe8a0b3-a4", "ovs_interfaceid": "4fe8a0b3-a4f4-488d-937b-cdd22978a04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:29:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Releasing lock "refresh_cache-f3c85dac-e42c-4b33-842f-3fb681cdc2ee" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:29:56 user nova-compute[74898]: DEBUG nova.compute.manager [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Instance network_info: |[{"id": "4fe8a0b3-a4f4-488d-937b-cdd22978a04e", "address": "fa:16:3e:fc:f8:0f", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe8a0b3-a4", "ovs_interfaceid": "4fe8a0b3-a4f4-488d-937b-cdd22978a04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:29:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-94e1fa35-54b4-4fd6-a552-c757b04cfaef req-08d714d3-2def-4ba8-ad62-8f3baee3c42a service nova] Acquired lock "refresh_cache-f3c85dac-e42c-4b33-842f-3fb681cdc2ee" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:29:56 user nova-compute[74898]: DEBUG nova.network.neutron [req-94e1fa35-54b4-4fd6-a552-c757b04cfaef req-08d714d3-2def-4ba8-ad62-8f3baee3c42a service nova] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Refreshing network info cache for port 4fe8a0b3-a4f4-488d-937b-cdd22978a04e {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:29:56 user nova-compute[74898]: DEBUG nova.network.neutron [req-94e1fa35-54b4-4fd6-a552-c757b04cfaef req-08d714d3-2def-4ba8-ad62-8f3baee3c42a service nova] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Updated VIF entry in instance network info cache for port 4fe8a0b3-a4f4-488d-937b-cdd22978a04e. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:29:56 user nova-compute[74898]: DEBUG nova.network.neutron [req-94e1fa35-54b4-4fd6-a552-c757b04cfaef req-08d714d3-2def-4ba8-ad62-8f3baee3c42a service nova] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Updating instance_info_cache with network_info: [{"id": "4fe8a0b3-a4f4-488d-937b-cdd22978a04e", "address": "fa:16:3e:fc:f8:0f", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe8a0b3-a4", "ovs_interfaceid": "4fe8a0b3-a4f4-488d-937b-cdd22978a04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:29:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-94e1fa35-54b4-4fd6-a552-c757b04cfaef req-08d714d3-2def-4ba8-ad62-8f3baee3c42a service nova] Releasing lock "refresh_cache-f3c85dac-e42c-4b33-842f-3fb681cdc2ee" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:29:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG nova.compute.manager [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:30:01 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Creating image(s)
Nov 17 03:30:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Did not create local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Ensure instance console log exists: /opt/stack/data/nova/instances/f3c85dac-e42c-4b33-842f-3fb681cdc2ee/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Start _get_guest_xml network_info=[{"id": "4fe8a0b3-a4f4-488d-937b-cdd22978a04e", "address": "fa:16:3e:fc:f8:0f", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe8a0b3-a4", "ovs_interfaceid": "4fe8a0b3-a4f4-488d-937b-cdd22978a04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxlbaNWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f3c85dac-e42c-4b33-842f-3fb681cdc2ee', 'attached_at': '', 'detached_at': '', 'volume_id': '137dde58-30b0-4893-8678-f1fb9a2c4e6f', 'serial': '137dde58-30b0-4893-8678-f1fb9a2c4e6f'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '7c8b8d40-77c8-4c8f-8252-4dc147600c44', 'volume_type': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:30:01 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:30:01 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:30:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxlbaNWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:30:01 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:30:01 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:30:01 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:30:01 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:30:01 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[65030402-c2d5-4795-b336-181699ae717f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:30:01 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd37058b-9bfd-4bbf-86fa-1aeb273d4fb6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f] added
Nov 17 03:30:01 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a5d0e3-a959-4cb7-b507-b25d1d1c0070]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[292d54a5-bfd7-4855-8704-fd233c21b04b]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kxlbaNWT {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kxlbaNWT" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54c424e-d3dc-4d54-8346-35ce95478dcb]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kxlbaNWT'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5124d85f-271f-432f-ba80-5b8b8abb8ec4]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ae2c56-066d-4dde-991c-a47154b2a4cf]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 17 03:30:01 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 17 03:30:01 user nova-compute[74898]:  {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:30:01 user nova-compute[74898]: WARNING os_brick.initiator.connectors.iscsi [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 17 03:30:01 user nova-compute[74898]: 
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4892d2b1-7a19-43f2-acc2-46a317109ef9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f, portal: 172.16.0.220,3260]
Nov 17 03:30:01 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f, portal: 172.16.0.220,3260] successful.
Nov 17 03:30:01 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[956f853b-37aa-470b-b428-72407d898361]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:30:01 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:30:02 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1936de8-332d-491d-93a0-c09e716b7923]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:30:02 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:30:02 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:30:02 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:30:02 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:30:02 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.578s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:30:02 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:30:02 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:30:02 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:30:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:02 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:30:02 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2aa28f5-f154-4287-8923-2ce1042dd681]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:30:02 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:30:02 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxlbaNWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:30:03 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.608s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:30:03 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] <== connect_volume: return (1611ms) {'type': 'block', 'scsi_wwn': '23035313539643335', 'path': '/dev/sdb'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:30:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035313539643335', 'path': '/dev/sdb'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:30:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:29:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-914343371',display_name='tempest-TestVolumeBootPattern-server-914343371',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-914343371',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJInWWavbu/6d6OQJPNghOKND7RIoCzZc2qCUfAkCC2TokwiJfdMvyOxWX8lLSW7Fx1YLwTdFBaDgYlG8DKkEJfoMkAf+B/utXvLWusVeA4Z9dMFCfioGuJoTmK0Ain2zQ==',key_name='tempest-TestVolumeBootPattern-1387915334',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d36087cc8e842c0bfcae89553fb9841',ramdisk_id='',reservation_id='r-sf277u2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1382126375',owner_user_name='tempest-TestVolumeBootPattern-1382126375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:29:55Z,user_data=None,user_id='aa779a5f98394629b6b9fa9d04233e7a',uuid=f3c85dac-e42c-4b33-842f-3fb681cdc2ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fe8a0b3-a4f4-488d-937b-cdd22978a04e", "address": "fa:16:3e:fc:f8:0f", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe8a0b3-a4", "ovs_interfaceid": "4fe8a0b3-a4f4-488d-937b-cdd22978a04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:30:03 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converting VIF {"id": "4fe8a0b3-a4f4-488d-937b-cdd22978a04e", "address": "fa:16:3e:fc:f8:0f", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe8a0b3-a4", "ovs_interfaceid": "4fe8a0b3-a4f4-488d-937b-cdd22978a04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:30:03 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f8:0f,bridge_name='br-int',has_traffic_filtering=True,id=4fe8a0b3-a4f4-488d-937b-cdd22978a04e,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fe8a0b3-a4') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:30:03 user nova-compute[74898]: DEBUG nova.objects.instance [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lazy-loading 'pci_devices' on Instance uuid f3c85dac-e42c-4b33-842f-3fb681cdc2ee {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:30:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:30:03 user nova-compute[74898]:   <uuid>f3c85dac-e42c-4b33-842f-3fb681cdc2ee</uuid>
Nov 17 03:30:03 user nova-compute[74898]:   <name>instance-0000002b</name>
Nov 17 03:30:03 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:30:03 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:30:03 user nova-compute[74898]:   <metadata>
Nov 17 03:30:03 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:30:03 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:30:03 user nova-compute[74898]:       <nova:name>tempest-TestVolumeBootPattern-server-914343371</nova:name>
Nov 17 03:30:03 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:30:01</nova:creationTime>
Nov 17 03:30:03 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:30:03 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:30:03 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:30:03 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:30:03 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:30:03 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:30:03 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:30:03 user nova-compute[74898]:       <nova:owner>
Nov 17 03:30:03 user nova-compute[74898]:         <nova:user uuid="aa779a5f98394629b6b9fa9d04233e7a">tempest-TestVolumeBootPattern-1382126375-project-member</nova:user>
Nov 17 03:30:03 user nova-compute[74898]:         <nova:project uuid="5d36087cc8e842c0bfcae89553fb9841">tempest-TestVolumeBootPattern-1382126375</nova:project>
Nov 17 03:30:03 user nova-compute[74898]:       </nova:owner>
Nov 17 03:30:03 user nova-compute[74898]:       <nova:ports>
Nov 17 03:30:03 user nova-compute[74898]:         <nova:port uuid="4fe8a0b3-a4f4-488d-937b-cdd22978a04e">
Nov 17 03:30:03 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 17 03:30:03 user nova-compute[74898]:         </nova:port>
Nov 17 03:30:03 user nova-compute[74898]:       </nova:ports>
Nov 17 03:30:03 user nova-compute[74898]:     </nova:instance>
Nov 17 03:30:03 user nova-compute[74898]:   </metadata>
Nov 17 03:30:03 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:30:03 user nova-compute[74898]:     <system>
Nov 17 03:30:03 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:30:03 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:30:03 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:30:03 user nova-compute[74898]:       <entry name="serial">f3c85dac-e42c-4b33-842f-3fb681cdc2ee</entry>
Nov 17 03:30:03 user nova-compute[74898]:       <entry name="uuid">f3c85dac-e42c-4b33-842f-3fb681cdc2ee</entry>
Nov 17 03:30:03 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:30:03 user nova-compute[74898]:     </system>
Nov 17 03:30:03 user nova-compute[74898]:   </sysinfo>
Nov 17 03:30:03 user nova-compute[74898]:   <os>
Nov 17 03:30:03 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:30:03 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:30:03 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:30:03 user nova-compute[74898]:   </os>
Nov 17 03:30:03 user nova-compute[74898]:   <features>
Nov 17 03:30:03 user nova-compute[74898]:     <acpi/>
Nov 17 03:30:03 user nova-compute[74898]:     <apic/>
Nov 17 03:30:03 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:30:03 user nova-compute[74898]:   </features>
Nov 17 03:30:03 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:30:03 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:30:03 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:30:03 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:30:03 user nova-compute[74898]:   </clock>
Nov 17 03:30:03 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:30:03 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:30:03 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:30:03 user nova-compute[74898]:   </cpu>
Nov 17 03:30:03 user nova-compute[74898]:   <devices>
Nov 17 03:30:03 user nova-compute[74898]:     <disk type="block" device="disk">
Nov 17 03:30:03 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:30:03 user nova-compute[74898]:       <source dev="/dev/sdb"/>
Nov 17 03:30:03 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:30:03 user nova-compute[74898]:       <serial>137dde58-30b0-4893-8678-f1fb9a2c4e6f</serial>
Nov 17 03:30:03 user nova-compute[74898]:     </disk>
Nov 17 03:30:03 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:30:03 user nova-compute[74898]:       <mac address="fa:16:3e:fc:f8:0f"/>
Nov 17 03:30:03 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:30:03 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:30:03 user nova-compute[74898]:       <target dev="tap4fe8a0b3-a4"/>
Nov 17 03:30:03 user nova-compute[74898]:     </interface>
Nov 17 03:30:03 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:30:03 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/f3c85dac-e42c-4b33-842f-3fb681cdc2ee/console.log" append="off"/>
Nov 17 03:30:03 user nova-compute[74898]:     </serial>
Nov 17 03:30:03 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:30:03 user nova-compute[74898]:     <video>
Nov 17 03:30:03 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:30:03 user nova-compute[74898]:     </video>
Nov 17 03:30:03 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:30:03 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:30:03 user nova-compute[74898]:     </rng>
Nov 17 03:30:03 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:30:03 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:30:03 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:30:03 user nova-compute[74898]:     </memballoon>
Nov 17 03:30:03 user nova-compute[74898]:   </devices>
Nov 17 03:30:03 user nova-compute[74898]: </domain>
Nov 17 03:30:03 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:30:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:29:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-914343371',display_name='tempest-TestVolumeBootPattern-server-914343371',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-914343371',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJInWWavbu/6d6OQJPNghOKND7RIoCzZc2qCUfAkCC2TokwiJfdMvyOxWX8lLSW7Fx1YLwTdFBaDgYlG8DKkEJfoMkAf+B/utXvLWusVeA4Z9dMFCfioGuJoTmK0Ain2zQ==',key_name='tempest-TestVolumeBootPattern-1387915334',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d36087cc8e842c0bfcae89553fb9841',ramdisk_id='',reservation_id='r-sf277u2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1382126375',owner_user_name='tempest-TestVolumeBootPattern-1382126375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:29:55Z,user_data=None,user_id='aa779a5f98394629b6b9fa9d04233e7a',uuid=f3c85dac-e42c-4b33-842f-3fb681cdc2ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fe8a0b3-a4f4-488d-937b-cdd22978a04e", "address": "fa:16:3e:fc:f8:0f", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe8a0b3-a4", "ovs_interfaceid": "4fe8a0b3-a4f4-488d-937b-cdd22978a04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:30:03 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converting VIF {"id": "4fe8a0b3-a4f4-488d-937b-cdd22978a04e", "address": "fa:16:3e:fc:f8:0f", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe8a0b3-a4", "ovs_interfaceid": "4fe8a0b3-a4f4-488d-937b-cdd22978a04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:30:03 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f8:0f,bridge_name='br-int',has_traffic_filtering=True,id=4fe8a0b3-a4f4-488d-937b-cdd22978a04e,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fe8a0b3-a4') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:30:03 user nova-compute[74898]: DEBUG os_vif [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f8:0f,bridge_name='br-int',has_traffic_filtering=True,id=4fe8a0b3-a4f4-488d-937b-cdd22978a04e,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fe8a0b3-a4') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:30:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:30:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:30:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4cec791-26c7-52a5-aef8-df2b2d6f1ecd', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:30:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fe8a0b3-a4, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:30:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4fe8a0b3-a4, col_values=(('qos', UUID('ac4ec899-b2bb-412c-a74e-8adf87793236')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:30:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4fe8a0b3-a4, col_values=(('external_ids', {'iface-id': '4fe8a0b3-a4f4-488d-937b-cdd22978a04e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:f8:0f', 'vm-uuid': 'f3c85dac-e42c-4b33-842f-3fb681cdc2ee'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:30:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:30:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:03 user nova-compute[74898]: INFO os_vif [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f8:0f,bridge_name='br-int',has_traffic_filtering=True,id=4fe8a0b3-a4f4-488d-937b-cdd22978a04e,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fe8a0b3-a4')
Nov 17 03:30:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:30:03 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] No VIF found with MAC fa:16:3e:fc:f8:0f, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:30:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:04 user nova-compute[74898]: DEBUG nova.compute.manager [req-40a5ca1e-763d-4efe-9cb6-4786a3f268d1 req-6251ab0c-3688-497b-9149-6c84ec6d9816 service nova] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Received event network-vif-plugged-4fe8a0b3-a4f4-488d-937b-cdd22978a04e {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:30:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-40a5ca1e-763d-4efe-9cb6-4786a3f268d1 req-6251ab0c-3688-497b-9149-6c84ec6d9816 service nova] Acquiring lock "f3c85dac-e42c-4b33-842f-3fb681cdc2ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:30:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-40a5ca1e-763d-4efe-9cb6-4786a3f268d1 req-6251ab0c-3688-497b-9149-6c84ec6d9816 service nova] Lock "f3c85dac-e42c-4b33-842f-3fb681cdc2ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:30:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-40a5ca1e-763d-4efe-9cb6-4786a3f268d1 req-6251ab0c-3688-497b-9149-6c84ec6d9816 service nova] Lock "f3c85dac-e42c-4b33-842f-3fb681cdc2ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:30:04 user nova-compute[74898]: DEBUG nova.compute.manager [req-40a5ca1e-763d-4efe-9cb6-4786a3f268d1 req-6251ab0c-3688-497b-9149-6c84ec6d9816 service nova] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] No waiting events found dispatching network-vif-plugged-4fe8a0b3-a4f4-488d-937b-cdd22978a04e {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:30:04 user nova-compute[74898]: WARNING nova.compute.manager [req-40a5ca1e-763d-4efe-9cb6-4786a3f268d1 req-6251ab0c-3688-497b-9149-6c84ec6d9816 service nova] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Received unexpected event network-vif-plugged-4fe8a0b3-a4f4-488d-937b-cdd22978a04e for instance with vm_state building and task_state spawning.
Nov 17 03:30:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:06 user nova-compute[74898]: DEBUG nova.compute.manager [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:30:06 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:30:06 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Instance spawned successfully.
Nov 17 03:30:06 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:30:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:06 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:30:06 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:30:06 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:30:06 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:30:06 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:30:06 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:30:06 user nova-compute[74898]: INFO nova.compute.manager [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 17 03:30:06 user nova-compute[74898]: DEBUG nova.compute.manager [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:30:06 user nova-compute[74898]: INFO nova.compute.manager [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Took 12.76 seconds to build instance.
Nov 17 03:30:06 user nova-compute[74898]: DEBUG nova.compute.manager [req-7bb6fca5-3d25-4035-9525-62fa3b7a7d78 req-5025089f-c9b6-4e14-bd34-2c8a67402865 service nova] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Received event network-vif-plugged-4fe8a0b3-a4f4-488d-937b-cdd22978a04e {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:30:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7bb6fca5-3d25-4035-9525-62fa3b7a7d78 req-5025089f-c9b6-4e14-bd34-2c8a67402865 service nova] Acquiring lock "f3c85dac-e42c-4b33-842f-3fb681cdc2ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:30:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7bb6fca5-3d25-4035-9525-62fa3b7a7d78 req-5025089f-c9b6-4e14-bd34-2c8a67402865 service nova] Lock "f3c85dac-e42c-4b33-842f-3fb681cdc2ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:30:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7bb6fca5-3d25-4035-9525-62fa3b7a7d78 req-5025089f-c9b6-4e14-bd34-2c8a67402865 service nova] Lock "f3c85dac-e42c-4b33-842f-3fb681cdc2ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:30:06 user nova-compute[74898]: DEBUG nova.compute.manager [req-7bb6fca5-3d25-4035-9525-62fa3b7a7d78 req-5025089f-c9b6-4e14-bd34-2c8a67402865 service nova] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] No waiting events found dispatching network-vif-plugged-4fe8a0b3-a4f4-488d-937b-cdd22978a04e {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:30:06 user nova-compute[74898]: WARNING nova.compute.manager [req-7bb6fca5-3d25-4035-9525-62fa3b7a7d78 req-5025089f-c9b6-4e14-bd34-2c8a67402865 service nova] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Received unexpected event network-vif-plugged-4fe8a0b3-a4f4-488d-937b-cdd22978a04e for instance with vm_state active and task_state None.
Nov 17 03:30:06 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f0f8e4f9-149b-4ac6-9f55-17e4fb33c9b6 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "f3c85dac-e42c-4b33-842f-3fb681cdc2ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.849s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:30:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:30:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG nova.compute.manager [req-9f36cf96-3f7f-4b3d-89e7-76126e612dc2 req-cf972e8c-050a-4599-847b-cce3677ed822 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Received event network-changed-92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG nova.compute.manager [req-9f36cf96-3f7f-4b3d-89e7-76126e612dc2 req-cf972e8c-050a-4599-847b-cce3677ed822 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Refreshing instance network info cache due to event network-changed-92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9f36cf96-3f7f-4b3d-89e7-76126e612dc2 req-cf972e8c-050a-4599-847b-cce3677ed822 service nova] Acquiring lock "refresh_cache-f794babb-75e5-41c3-8518-e1b0a78024be" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9f36cf96-3f7f-4b3d-89e7-76126e612dc2 req-cf972e8c-050a-4599-847b-cce3677ed822 service nova] Acquired lock "refresh_cache-f794babb-75e5-41c3-8518-e1b0a78024be" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG nova.network.neutron [req-9f36cf96-3f7f-4b3d-89e7-76126e612dc2 req-cf972e8c-050a-4599-847b-cce3677ed822 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Refreshing network info cache for port 92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "f794babb-75e5-41c3-8518-e1b0a78024be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "f794babb-75e5-41c3-8518-e1b0a78024be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG nova.objects.instance [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lazy-loading 'flavor' on Instance uuid f794babb-75e5-41c3-8518-e1b0a78024be {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:30:29 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Ignoring supplied device name: /dev/vdb
Nov 17 03:30:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "f794babb-75e5-41c3-8518-e1b0a78024be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "f794babb-75e5-41c3-8518-e1b0a78024be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "f794babb-75e5-41c3-8518-e1b0a78024be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:30:29 user nova-compute[74898]: INFO nova.compute.manager [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Attaching volume abe378b5-c4e9-4284-99e0-b1b9b693f6d6 to /dev/vdb
Nov 17 03:30:29 user nova-compute[74898]: DEBUG os_brick.utils [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG nova.network.neutron [req-9f36cf96-3f7f-4b3d-89e7-76126e612dc2 req-cf972e8c-050a-4599-847b-cce3677ed822 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Updated VIF entry in instance network info cache for port 92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG nova.network.neutron [req-9f36cf96-3f7f-4b3d-89e7-76126e612dc2 req-cf972e8c-050a-4599-847b-cce3677ed822 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Updating instance_info_cache with network_info: [{"id": "92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3", "address": "fa:16:3e:97:1d:8d", "network": {"id": "7ab9395e-a6a0-4b93-990e-d7d064bba5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-894693551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4596366f424fa7937aaf97828a7c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f7d6e9-a1", "ovs_interfaceid": "92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[79226589-0763-4b84-9bae-b5974e24bdd4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9f36cf96-3f7f-4b3d-89e7-76126e612dc2 req-cf972e8c-050a-4599-847b-cce3677ed822 service nova] Releasing lock "refresh_cache-f794babb-75e5-41c3-8518-e1b0a78024be" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e4ea4d-4c65-4e71-bd08-ba440bbd5224]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[28722ccd-d8c4-475d-be6c-8acdce2f7e53]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4241529d-39ee-4f4d-844d-11d9dfbd427d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:30:29 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:30:29 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91adaac-d300-438c-bfc4-87e59d833875]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG os_brick.utils [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:30:29 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Updating existing volume attachment record: 58d896e2-26a1-4881-a69a-6b661223d733 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:30:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:30:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSTApncI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:30:34 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:30:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:30:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:30:34 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:30:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:30:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:30:34 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:30:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[541d48c7-3737-4a7a-ad11-3835b0d4d48a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:30:35 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d53ec4-b554-4bc7-ba14-563c382a5cac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6] added
Nov 17 03:30:35 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd203026-433e-40b5-adfd-13b5aa6e8876]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[927f55e2-423c-41eb-956a-a8aca511b2eb]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bSTApncI {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bSTApncI" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0701e25a-098c-4433-bd7e-8715a5c02fc3]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bSTApncI'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab6f07f-282e-4432-93a6-70b4519a0e8b]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b81fa7-bd73-4389-902f-fa33b7297c8f]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:30:35 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:30:35 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4c21aa-d181-4179-a00f-932ecdbe2573]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6, portal: 172.16.0.220,3260]
Nov 17 03:30:35 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6, portal: 172.16.0.220,3260] successful.
Nov 17 03:30:35 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[46744689-1f6a-464e-84f6-c109921635e2]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aba712c-ae2c-40b8-92ce-aa979d760c30]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:30:35 user nova-compute[74898]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6 (non-flash)
Nov 17 03:30:35 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:30:35 user nova-compute[74898]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6 (non-flash)
Nov 17 03:30:35 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68e8cf4-a4de-4f74-9d00-b2862a982388]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:30:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSTApncI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:30:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:30:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23461653731306436', 'path': '/dev/sdc'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:30:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461653731306436', 'path': '/dev/sdc'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:30:36 user nova-compute[74898]: DEBUG nova.objects.instance [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lazy-loading 'flavor' on Instance uuid f794babb-75e5-41c3-8518-e1b0a78024be {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:30:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 03:30:36 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:30:36 user nova-compute[74898]:   <source dev="/dev/sdc"/>
Nov 17 03:30:36 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:30:36 user nova-compute[74898]:   <serial>abe378b5-c4e9-4284-99e0-b1b9b693f6d6</serial>
Nov 17 03:30:36 user nova-compute[74898]: </disk>
Nov 17 03:30:36 user nova-compute[74898]:  {{(pid=74898) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 03:30:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:30:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:30:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] No VIF found with MAC fa:16:3e:97:1d:8d, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:30:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-56c4c244-2bf8-4d3e-b815-be1501b14e06 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "f794babb-75e5-41c3-8518-e1b0a78024be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.216s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:30:37 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:30:37 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:30:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:39 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:30:40 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:30:40 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:30:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:30:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:30:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:30:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:30:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:43 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:30:43 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:30:45 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:30:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:30:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:30:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:30:45 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:30:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cd1abc-80ab-470b-9f69-19ccfa835f25/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cd1abc-80ab-470b-9f69-19ccfa835f25/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:30:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cd1abc-80ab-470b-9f69-19ccfa835f25/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cd1abc-80ab-470b-9f69-19ccfa835f25/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:30:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f794babb-75e5-41c3-8518-e1b0a78024be/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f794babb-75e5-41c3-8518-e1b0a78024be/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:30:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f794babb-75e5-41c3-8518-e1b0a78024be/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:30:46 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f794babb-75e5-41c3-8518-e1b0a78024be/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:30:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:30:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:30:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:47 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:30:47 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:30:47 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=8664MB free_disk=25.295143127441406GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:30:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:30:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:30:47 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance f794babb-75e5-41c3-8518-e1b0a78024be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:30:47 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 21cd1abc-80ab-470b-9f69-19ccfa835f25 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:30:47 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance f3c85dac-e42c-4b33-842f-3fb681cdc2ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:30:47 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:30:47 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:30:47 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Refreshing inventories for resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 17 03:30:47 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Updating ProviderTree inventory for provider b743bdc9-a8bb-467c-98c8-06f1954f87df from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 17 03:30:47 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Updating inventory in ProviderTree for provider b743bdc9-a8bb-467c-98c8-06f1954f87df with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 17 03:30:47 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Refreshing aggregate associations for resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df, aggregates: None {{(pid=74898) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 17 03:30:47 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Refreshing trait associations for resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=74898) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 17 03:30:47 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:30:47 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:30:47 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:30:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.533s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:30:47 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:30:47 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Cleaning up deleted instances {{(pid=74898) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 17 03:30:47 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] There are 0 instances to clean {{(pid=74898) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 17 03:30:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:50 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:30:50 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:30:50 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Rebuilding the list of instances to heal {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 03:30:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-f794babb-75e5-41c3-8518-e1b0a78024be" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:30:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-f794babb-75e5-41c3-8518-e1b0a78024be" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:30:50 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:30:50 user nova-compute[74898]: DEBUG nova.objects.instance [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lazy-loading 'info_cache' on Instance uuid f794babb-75e5-41c3-8518-e1b0a78024be {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:30:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "f794babb-75e5-41c3-8518-e1b0a78024be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:30:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "f794babb-75e5-41c3-8518-e1b0a78024be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:30:50 user nova-compute[74898]: INFO nova.compute.manager [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Detaching volume abe378b5-c4e9-4284-99e0-b1b9b693f6d6
Nov 17 03:30:50 user nova-compute[74898]: INFO nova.virt.block_device [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Attempting to driver detach volume abe378b5-c4e9-4284-99e0-b1b9b693f6d6 from mountpoint /dev/vdb
Nov 17 03:30:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Attempting to detach device vdb from instance f794babb-75e5-41c3-8518-e1b0a78024be from the persistent domain config. {{(pid=74898) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 03:30:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:30:50 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:30:50 user nova-compute[74898]:   <source dev="/dev/sdc"/>
Nov 17 03:30:50 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:30:50 user nova-compute[74898]:   <serial>abe378b5-c4e9-4284-99e0-b1b9b693f6d6</serial>
Nov 17 03:30:50 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:30:50 user nova-compute[74898]: </disk>
Nov 17 03:30:50 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:30:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "f794babb-75e5-41c3-8518-e1b0a78024be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:30:50 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Successfully detached device vdb from instance f794babb-75e5-41c3-8518-e1b0a78024be from the persistent domain config.
Nov 17 03:30:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f794babb-75e5-41c3-8518-e1b0a78024be from the live domain config. {{(pid=74898) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 03:30:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:30:50 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:30:50 user nova-compute[74898]:   <source dev="/dev/sdc"/>
Nov 17 03:30:50 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:30:50 user nova-compute[74898]:   <serial>abe378b5-c4e9-4284-99e0-b1b9b693f6d6</serial>
Nov 17 03:30:50 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:30:50 user nova-compute[74898]: </disk>
Nov 17 03:30:50 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:30:51 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Updating instance_info_cache with network_info: [{"id": "92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3", "address": "fa:16:3e:97:1d:8d", "network": {"id": "7ab9395e-a6a0-4b93-990e-d7d064bba5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-894693551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4596366f424fa7937aaf97828a7c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f7d6e9-a1", "ovs_interfaceid": "92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:30:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-f794babb-75e5-41c3-8518-e1b0a78024be" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:30:51 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:30:51 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:30:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f794babb-75e5-41c3-8518-e1b0a78024be {{(pid=74898) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 03:30:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:30:55 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:30:55 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Cleaning up deleted instances with incomplete migration  {{(pid=74898) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 17 03:30:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:30:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:30:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:30:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:30:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:30:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:31:10 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:31:11 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f794babb-75e5-41c3-8518-e1b0a78024be is timed out.
Nov 17 03:31:11 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Successfully detached device vdb from instance f794babb-75e5-41c3-8518-e1b0a78024be from the live domain config.
Nov 17 03:31:11 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSTApncI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:31:11 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:31:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9652507f-80b4-4c6a-97a2-d5eefff2b780]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:31:11 user nova-compute[74898]: No targets found.
Nov 17 03:31:11 user nova-compute[74898]: iSNS:
Nov 17 03:31:11 user nova-compute[74898]: No targets found.
Nov 17 03:31:11 user nova-compute[74898]: STATIC:
Nov 17 03:31:11 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6
Nov 17 03:31:11 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:31:11 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:31:11 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f
Nov 17 03:31:11 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:31:11 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:31:11 user nova-compute[74898]: FIRMWARE:
Nov 17 03:31:11 user nova-compute[74898]: No targets found.
Nov 17 03:31:11 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:31:11 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:31:11 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c4b44f-63ff-4a93-9503-0cbc269efc30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e1d41e-7958-4fc8-929a-0e6cb2123649]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:31:11 user nova-compute[74898]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6 (non-flash)
Nov 17 03:31:11 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:31:11 user nova-compute[74898]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6 (non-flash)
Nov 17 03:31:11 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf859c8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6'): ({'sdc'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Removing single pathed devices sdc {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8b9cfb-f7e9-47e4-b73a-c87745cdbdaa]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8d82de-540c-429e-a218-e62b6ebff56a]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Flushing IO for device /dev/sdc {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4434e0-121a-443b-9d3b-407183e5bac1]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c862cb-714b-46c2-b7ff-90269ea0228f]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] SCSI volumes sdc have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfd6d45-a771-48e6-b879-149ada95bbf9]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb247b8-ea9c-404f-a430-9b4ba63397ef]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6, portal: 172.16.0.220,3260]
Nov 17 03:31:11 user nova-compute[74898]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6, portal: 172.16.0.220,3260] successful.
Nov 17 03:31:11 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45208a4-f5e2-4dc7-ab78-37f1e735e1e4]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] <== disconnect_volume: return (308ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:31:11 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:31:12 user nova-compute[74898]: DEBUG nova.objects.instance [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lazy-loading 'flavor' on Instance uuid f794babb-75e5-41c3-8518-e1b0a78024be {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:31:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3c8c69f8-1aef-4179-ac98-03652471cb70 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "f794babb-75e5-41c3-8518-e1b0a78024be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.662s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:31:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "f794babb-75e5-41c3-8518-e1b0a78024be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.542s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:31:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "f794babb-75e5-41c3-8518-e1b0a78024be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:31:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "f794babb-75e5-41c3-8518-e1b0a78024be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:31:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "f794babb-75e5-41c3-8518-e1b0a78024be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:31:12 user nova-compute[74898]: INFO nova.compute.manager [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Terminating instance
Nov 17 03:31:12 user nova-compute[74898]: DEBUG nova.compute.manager [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:31:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:12 user nova-compute[74898]: DEBUG nova.compute.manager [req-944f564e-033f-4b30-93ea-0e4764003452 req-1534e660-7b9d-46d7-8b47-ffbd80a8afb7 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Received event network-vif-unplugged-92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:31:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-944f564e-033f-4b30-93ea-0e4764003452 req-1534e660-7b9d-46d7-8b47-ffbd80a8afb7 service nova] Acquiring lock "f794babb-75e5-41c3-8518-e1b0a78024be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:31:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-944f564e-033f-4b30-93ea-0e4764003452 req-1534e660-7b9d-46d7-8b47-ffbd80a8afb7 service nova] Lock "f794babb-75e5-41c3-8518-e1b0a78024be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:31:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-944f564e-033f-4b30-93ea-0e4764003452 req-1534e660-7b9d-46d7-8b47-ffbd80a8afb7 service nova] Lock "f794babb-75e5-41c3-8518-e1b0a78024be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:31:12 user nova-compute[74898]: DEBUG nova.compute.manager [req-944f564e-033f-4b30-93ea-0e4764003452 req-1534e660-7b9d-46d7-8b47-ffbd80a8afb7 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] No waiting events found dispatching network-vif-unplugged-92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:31:12 user nova-compute[74898]: DEBUG nova.compute.manager [req-944f564e-033f-4b30-93ea-0e4764003452 req-1534e660-7b9d-46d7-8b47-ffbd80a8afb7 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Received event network-vif-unplugged-92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:31:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:13 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Instance destroyed successfully.
Nov 17 03:31:13 user nova-compute[74898]: DEBUG nova.objects.instance [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lazy-loading 'resources' on Instance uuid f794babb-75e5-41c3-8518-e1b0a78024be {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:28:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1889443406',display_name='tempest-VolumesSnapshotTestJSON-instance-1889443406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1889443406',id=41,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKjwRjYJ+DEOyHgjZg3dlJK8MGATTQJe/2MTeOsMdCPM3IIX3Fg75cjYcrJ8yIZW/KVZgWrvJcBbec2x+urdoei3dplo6LLhriL2bcg8qMOpvq20aootvbMa0/rJdPuPA==',key_name='tempest-keypair-1447226380',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:28:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e4596366f424fa7937aaf97828a7c65',ramdisk_id='',reservation_id='r-z8geuiau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1365341029',owner_user_name='tempest-VolumesSnapshotTestJSON-1365341029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:28:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f3d630e4ece4c6c87da71cedcf3a839',uuid=f794babb-75e5-41c3-8518-e1b0a78024be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3", "address": "fa:16:3e:97:1d:8d", "network": {"id": "7ab9395e-a6a0-4b93-990e-d7d064bba5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-894693551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4596366f424fa7937aaf97828a7c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f7d6e9-a1", "ovs_interfaceid": "92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Converting VIF {"id": "92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3", "address": "fa:16:3e:97:1d:8d", "network": {"id": "7ab9395e-a6a0-4b93-990e-d7d064bba5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-894693551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4596366f424fa7937aaf97828a7c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f7d6e9-a1", "ovs_interfaceid": "92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:1d:8d,bridge_name='br-int',has_traffic_filtering=True,id=92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3,network=Network(7ab9395e-a6a0-4b93-990e-d7d064bba5c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92f7d6e9-a1') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG os_vif [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:1d:8d,bridge_name='br-int',has_traffic_filtering=True,id=92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3,network=Network(7ab9395e-a6a0-4b93-990e-d7d064bba5c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92f7d6e9-a1') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92f7d6e9-a1, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=392cc3bd-a1f6-4b26-b6aa-591f99876899) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:31:13 user nova-compute[74898]: INFO os_vif [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:1d:8d,bridge_name='br-int',has_traffic_filtering=True,id=92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3,network=Network(7ab9395e-a6a0-4b93-990e-d7d064bba5c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92f7d6e9-a1')
Nov 17 03:31:13 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSTApncI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:31:13 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:31:13 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c81104-9f93-4fe4-a623-46e98e45ebc4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:31:13 user nova-compute[74898]: No targets found.
Nov 17 03:31:13 user nova-compute[74898]: iSNS:
Nov 17 03:31:13 user nova-compute[74898]: No targets found.
Nov 17 03:31:13 user nova-compute[74898]: STATIC:
Nov 17 03:31:13 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f
Nov 17 03:31:13 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:31:13 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:31:13 user nova-compute[74898]: FIRMWARE:
Nov 17 03:31:13 user nova-compute[74898]: No targets found.
Nov 17 03:31:13 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:31:13 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:31:13 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abe378b5-c4e9-4284-99e0-b1b9b693f6d6', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[49434ace-bee7-4d08-8ed9-fc7932fc999f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e38f27-ee90-408f-93f7-17feed5252f1]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:31:13 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:31:13 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9c1854f1c0>, {}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Disconnecting from: [] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] <== disconnect_volume: return (72ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:31:13 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Deleting instance files /opt/stack/data/nova/instances/f794babb-75e5-41c3-8518-e1b0a78024be_del
Nov 17 03:31:13 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Deletion of /opt/stack/data/nova/instances/f794babb-75e5-41c3-8518-e1b0a78024be_del complete
Nov 17 03:31:13 user nova-compute[74898]: INFO nova.compute.manager [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 17 03:31:13 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:14 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:31:14 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Took 1.03 seconds to deallocate network for instance.
Nov 17 03:31:14 user nova-compute[74898]: DEBUG nova.compute.manager [req-57a9fabd-35df-446c-92a3-a88955b69e8e req-4aab09b3-36c3-4d94-b7ae-cb7596a68f49 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Received event network-vif-deleted-92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:31:14 user nova-compute[74898]: WARNING nova.volume.cinder [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Attachment 58d896e2-26a1-4881-a69a-6b661223d733 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 58d896e2-26a1-4881-a69a-6b661223d733. (HTTP 404) (Request-ID: req-6d181b37-5e1e-4c61-a7ba-76c05040886c)
Nov 17 03:31:14 user nova-compute[74898]: INFO nova.compute.manager [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Took 0.03 seconds to detach 1 volumes for instance.
Nov 17 03:31:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:31:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:31:14 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:31:14 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:31:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.175s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:31:14 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Deleted allocations for instance f794babb-75e5-41c3-8518-e1b0a78024be
Nov 17 03:31:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-7e13492a-723d-4acc-8861-abc478fa02df tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "f794babb-75e5-41c3-8518-e1b0a78024be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.373s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:31:14 user nova-compute[74898]: DEBUG nova.compute.manager [req-cb37d022-a4b4-4d19-b3b2-0ce500a004e3 req-a9727bf1-10f3-454d-be09-a60b3caa92d5 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Received event network-vif-plugged-92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:31:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-cb37d022-a4b4-4d19-b3b2-0ce500a004e3 req-a9727bf1-10f3-454d-be09-a60b3caa92d5 service nova] Acquiring lock "f794babb-75e5-41c3-8518-e1b0a78024be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:31:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-cb37d022-a4b4-4d19-b3b2-0ce500a004e3 req-a9727bf1-10f3-454d-be09-a60b3caa92d5 service nova] Lock "f794babb-75e5-41c3-8518-e1b0a78024be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:31:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-cb37d022-a4b4-4d19-b3b2-0ce500a004e3 req-a9727bf1-10f3-454d-be09-a60b3caa92d5 service nova] Lock "f794babb-75e5-41c3-8518-e1b0a78024be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:31:14 user nova-compute[74898]: DEBUG nova.compute.manager [req-cb37d022-a4b4-4d19-b3b2-0ce500a004e3 req-a9727bf1-10f3-454d-be09-a60b3caa92d5 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] No waiting events found dispatching network-vif-plugged-92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:31:14 user nova-compute[74898]: WARNING nova.compute.manager [req-cb37d022-a4b4-4d19-b3b2-0ce500a004e3 req-a9727bf1-10f3-454d-be09-a60b3caa92d5 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Received unexpected event network-vif-plugged-92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 for instance with vm_state deleted and task_state None.
Nov 17 03:31:14 user nova-compute[74898]: DEBUG nova.compute.manager [req-cb37d022-a4b4-4d19-b3b2-0ce500a004e3 req-a9727bf1-10f3-454d-be09-a60b3caa92d5 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Received event network-vif-plugged-92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:31:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-cb37d022-a4b4-4d19-b3b2-0ce500a004e3 req-a9727bf1-10f3-454d-be09-a60b3caa92d5 service nova] Acquiring lock "f794babb-75e5-41c3-8518-e1b0a78024be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:31:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-cb37d022-a4b4-4d19-b3b2-0ce500a004e3 req-a9727bf1-10f3-454d-be09-a60b3caa92d5 service nova] Lock "f794babb-75e5-41c3-8518-e1b0a78024be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:31:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-cb37d022-a4b4-4d19-b3b2-0ce500a004e3 req-a9727bf1-10f3-454d-be09-a60b3caa92d5 service nova] Lock "f794babb-75e5-41c3-8518-e1b0a78024be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:31:14 user nova-compute[74898]: DEBUG nova.compute.manager [req-cb37d022-a4b4-4d19-b3b2-0ce500a004e3 req-a9727bf1-10f3-454d-be09-a60b3caa92d5 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] No waiting events found dispatching network-vif-plugged-92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:31:14 user nova-compute[74898]: WARNING nova.compute.manager [req-cb37d022-a4b4-4d19-b3b2-0ce500a004e3 req-a9727bf1-10f3-454d-be09-a60b3caa92d5 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Received unexpected event network-vif-plugged-92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 for instance with vm_state deleted and task_state None.
Nov 17 03:31:14 user nova-compute[74898]: DEBUG nova.compute.manager [req-cb37d022-a4b4-4d19-b3b2-0ce500a004e3 req-a9727bf1-10f3-454d-be09-a60b3caa92d5 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Received event network-vif-plugged-92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:31:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-cb37d022-a4b4-4d19-b3b2-0ce500a004e3 req-a9727bf1-10f3-454d-be09-a60b3caa92d5 service nova] Acquiring lock "f794babb-75e5-41c3-8518-e1b0a78024be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:31:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-cb37d022-a4b4-4d19-b3b2-0ce500a004e3 req-a9727bf1-10f3-454d-be09-a60b3caa92d5 service nova] Lock "f794babb-75e5-41c3-8518-e1b0a78024be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:31:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-cb37d022-a4b4-4d19-b3b2-0ce500a004e3 req-a9727bf1-10f3-454d-be09-a60b3caa92d5 service nova] Lock "f794babb-75e5-41c3-8518-e1b0a78024be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:31:14 user nova-compute[74898]: DEBUG nova.compute.manager [req-cb37d022-a4b4-4d19-b3b2-0ce500a004e3 req-a9727bf1-10f3-454d-be09-a60b3caa92d5 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] No waiting events found dispatching network-vif-plugged-92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:31:14 user nova-compute[74898]: WARNING nova.compute.manager [req-cb37d022-a4b4-4d19-b3b2-0ce500a004e3 req-a9727bf1-10f3-454d-be09-a60b3caa92d5 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Received unexpected event network-vif-plugged-92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 for instance with vm_state deleted and task_state None.
Nov 17 03:31:14 user nova-compute[74898]: DEBUG nova.compute.manager [req-cb37d022-a4b4-4d19-b3b2-0ce500a004e3 req-a9727bf1-10f3-454d-be09-a60b3caa92d5 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Received event network-vif-unplugged-92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:31:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-cb37d022-a4b4-4d19-b3b2-0ce500a004e3 req-a9727bf1-10f3-454d-be09-a60b3caa92d5 service nova] Acquiring lock "f794babb-75e5-41c3-8518-e1b0a78024be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:31:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-cb37d022-a4b4-4d19-b3b2-0ce500a004e3 req-a9727bf1-10f3-454d-be09-a60b3caa92d5 service nova] Lock "f794babb-75e5-41c3-8518-e1b0a78024be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:31:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-cb37d022-a4b4-4d19-b3b2-0ce500a004e3 req-a9727bf1-10f3-454d-be09-a60b3caa92d5 service nova] Lock "f794babb-75e5-41c3-8518-e1b0a78024be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:31:14 user nova-compute[74898]: DEBUG nova.compute.manager [req-cb37d022-a4b4-4d19-b3b2-0ce500a004e3 req-a9727bf1-10f3-454d-be09-a60b3caa92d5 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] No waiting events found dispatching network-vif-unplugged-92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:31:14 user nova-compute[74898]: WARNING nova.compute.manager [req-cb37d022-a4b4-4d19-b3b2-0ce500a004e3 req-a9727bf1-10f3-454d-be09-a60b3caa92d5 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Received unexpected event network-vif-unplugged-92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 for instance with vm_state deleted and task_state None.
Nov 17 03:31:14 user nova-compute[74898]: DEBUG nova.compute.manager [req-cb37d022-a4b4-4d19-b3b2-0ce500a004e3 req-a9727bf1-10f3-454d-be09-a60b3caa92d5 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Received event network-vif-plugged-92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:31:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-cb37d022-a4b4-4d19-b3b2-0ce500a004e3 req-a9727bf1-10f3-454d-be09-a60b3caa92d5 service nova] Acquiring lock "f794babb-75e5-41c3-8518-e1b0a78024be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:31:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-cb37d022-a4b4-4d19-b3b2-0ce500a004e3 req-a9727bf1-10f3-454d-be09-a60b3caa92d5 service nova] Lock "f794babb-75e5-41c3-8518-e1b0a78024be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:31:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-cb37d022-a4b4-4d19-b3b2-0ce500a004e3 req-a9727bf1-10f3-454d-be09-a60b3caa92d5 service nova] Lock "f794babb-75e5-41c3-8518-e1b0a78024be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:31:14 user nova-compute[74898]: DEBUG nova.compute.manager [req-cb37d022-a4b4-4d19-b3b2-0ce500a004e3 req-a9727bf1-10f3-454d-be09-a60b3caa92d5 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] No waiting events found dispatching network-vif-plugged-92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:31:14 user nova-compute[74898]: WARNING nova.compute.manager [req-cb37d022-a4b4-4d19-b3b2-0ce500a004e3 req-a9727bf1-10f3-454d-be09-a60b3caa92d5 service nova] [instance: f794babb-75e5-41c3-8518-e1b0a78024be] Received unexpected event network-vif-plugged-92f7d6e9-a1f4-4ca5-94fe-2a551e3d10b3 for instance with vm_state deleted and task_state None.
Nov 17 03:31:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:18 user nova-compute[74898]: DEBUG nova.compute.manager [req-e745f851-46d1-450c-a860-f0fd5a82abe3 req-f4e7715e-be19-406a-97f7-e5afcf044ce0 service nova] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Received event network-changed-89bde492-00b9-4912-a5b7-54a57e2c6350 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:31:18 user nova-compute[74898]: DEBUG nova.compute.manager [req-e745f851-46d1-450c-a860-f0fd5a82abe3 req-f4e7715e-be19-406a-97f7-e5afcf044ce0 service nova] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Refreshing instance network info cache due to event network-changed-89bde492-00b9-4912-a5b7-54a57e2c6350. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:31:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e745f851-46d1-450c-a860-f0fd5a82abe3 req-f4e7715e-be19-406a-97f7-e5afcf044ce0 service nova] Acquiring lock "refresh_cache-21cd1abc-80ab-470b-9f69-19ccfa835f25" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:31:18 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e745f851-46d1-450c-a860-f0fd5a82abe3 req-f4e7715e-be19-406a-97f7-e5afcf044ce0 service nova] Acquired lock "refresh_cache-21cd1abc-80ab-470b-9f69-19ccfa835f25" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:31:18 user nova-compute[74898]: DEBUG nova.network.neutron [req-e745f851-46d1-450c-a860-f0fd5a82abe3 req-f4e7715e-be19-406a-97f7-e5afcf044ce0 service nova] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Refreshing network info cache for port 89bde492-00b9-4912-a5b7-54a57e2c6350 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:31:19 user nova-compute[74898]: DEBUG nova.network.neutron [req-e745f851-46d1-450c-a860-f0fd5a82abe3 req-f4e7715e-be19-406a-97f7-e5afcf044ce0 service nova] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Updated VIF entry in instance network info cache for port 89bde492-00b9-4912-a5b7-54a57e2c6350. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:31:19 user nova-compute[74898]: DEBUG nova.network.neutron [req-e745f851-46d1-450c-a860-f0fd5a82abe3 req-f4e7715e-be19-406a-97f7-e5afcf044ce0 service nova] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Updating instance_info_cache with network_info: [{"id": "89bde492-00b9-4912-a5b7-54a57e2c6350", "address": "fa:16:3e:48:24:a3", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bde492-00", "ovs_interfaceid": "89bde492-00b9-4912-a5b7-54a57e2c6350", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:31:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e745f851-46d1-450c-a860-f0fd5a82abe3 req-f4e7715e-be19-406a-97f7-e5afcf044ce0 service nova] Releasing lock "refresh_cache-21cd1abc-80ab-470b-9f69-19ccfa835f25" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:31:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "21cd1abc-80ab-470b-9f69-19ccfa835f25" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:31:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "21cd1abc-80ab-470b-9f69-19ccfa835f25" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:31:21 user nova-compute[74898]: DEBUG nova.objects.instance [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lazy-loading 'flavor' on Instance uuid 21cd1abc-80ab-470b-9f69-19ccfa835f25 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:31:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "21cd1abc-80ab-470b-9f69-19ccfa835f25" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:31:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "21cd1abc-80ab-470b-9f69-19ccfa835f25" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:31:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "21cd1abc-80ab-470b-9f69-19ccfa835f25" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:31:21 user nova-compute[74898]: INFO nova.compute.manager [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Attaching volume 8a8357d8-ff03-40bf-8cfe-784ef1f78342 to /dev/vdb
Nov 17 03:31:21 user nova-compute[74898]: DEBUG os_brick.utils [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:31:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[487c97ed-3339-4cbd-9de2-fe1149f15f59]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94d4424-e013-45e7-8bf9-496ea8555439]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[340e43d2-5a69-4a8f-9ce3-6c113a31caca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c3a35c-ac13-4abd-bb7a-dbb7e3e3e454]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:31:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:31:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:31:21 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:31:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[797b7e83-eaa3-44b2-af6c-23f7710ec493]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:31:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:31:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:31:21 user nova-compute[74898]: DEBUG os_brick.utils [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:31:21 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Updating existing volume attachment record: 51b1728c-ad1f-46f5-8383-da10d0efd507 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:31:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JIPnBHFU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:31:27 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:31:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:31:27 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:31:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:31:27 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[66140c71-da20-4fab-81ed-8826f72a1727]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:31:27 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c451807-1556-49ed-96e3-4e963cec85e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342] added
Nov 17 03:31:27 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[49351b02-d305-472f-87d1-d48e8e633a10]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f88a6b-0645-407f-b572-2d9356e8108e]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JIPnBHFU {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JIPnBHFU" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8503b5c3-4980-4e4e-90d3-87abe5c75be1]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JIPnBHFU'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32b13be-a882-4da8-b06e-a16a98cd8702]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fb97a9-e9a2-44b3-a026-da58f0da1f85]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:31:27 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:31:27 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[697ccd02-d40a-4ec5-891a-f8aa927cbe85]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342, portal: 172.16.0.220,3260]
Nov 17 03:31:27 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342, portal: 172.16.0.220,3260] successful.
Nov 17 03:31:27 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fe8e29-c66f-4231-8aa9-4b2f9cbcf301]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d13554a-618a-4d0f-82f6-f799bdd555e8]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:31:27 user nova-compute[74898]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342 (non-flash)
Nov 17 03:31:27 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:31:27 user nova-compute[74898]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342 (non-flash)
Nov 17 03:31:27 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d3a608-8c1c-4f16-834d-ee1facd56a7a]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:27 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: None {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:31:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:28 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:31:28 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JIPnBHFU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:31:28 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:31:28 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26663353064356131', 'path': '/dev/sdc'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:31:28 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663353064356131', 'path': '/dev/sdc'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:31:28 user nova-compute[74898]: DEBUG nova.objects.instance [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lazy-loading 'flavor' on Instance uuid 21cd1abc-80ab-470b-9f69-19ccfa835f25 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:31:28 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 03:31:28 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:31:28 user nova-compute[74898]:   <source dev="/dev/sdc"/>
Nov 17 03:31:28 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:31:28 user nova-compute[74898]:   <serial>8a8357d8-ff03-40bf-8cfe-784ef1f78342</serial>
Nov 17 03:31:28 user nova-compute[74898]: </disk>
Nov 17 03:31:28 user nova-compute[74898]:  {{(pid=74898) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 03:31:28 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:31:28 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:31:28 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] No VIF found with MAC fa:16:3e:48:24:a3, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:31:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b4d547b6-7174-48e7-824e-3b86770aa321 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "21cd1abc-80ab-470b-9f69-19ccfa835f25" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.191s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:31:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "21cd1abc-80ab-470b-9f69-19ccfa835f25" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:31:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "21cd1abc-80ab-470b-9f69-19ccfa835f25" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:31:29 user nova-compute[74898]: INFO nova.compute.manager [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Detaching volume 8a8357d8-ff03-40bf-8cfe-784ef1f78342
Nov 17 03:31:29 user nova-compute[74898]: INFO nova.virt.block_device [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Attempting to driver detach volume 8a8357d8-ff03-40bf-8cfe-784ef1f78342 from mountpoint /dev/vdb
Nov 17 03:31:29 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Attempting to detach device vdb from instance 21cd1abc-80ab-470b-9f69-19ccfa835f25 from the persistent domain config. {{(pid=74898) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 03:31:29 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:31:29 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:31:29 user nova-compute[74898]:   <source dev="/dev/sdc"/>
Nov 17 03:31:29 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:31:29 user nova-compute[74898]:   <serial>8a8357d8-ff03-40bf-8cfe-784ef1f78342</serial>
Nov 17 03:31:29 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:31:29 user nova-compute[74898]: </disk>
Nov 17 03:31:29 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:31:29 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Successfully detached device vdb from instance 21cd1abc-80ab-470b-9f69-19ccfa835f25 from the persistent domain config.
Nov 17 03:31:29 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 21cd1abc-80ab-470b-9f69-19ccfa835f25 from the live domain config. {{(pid=74898) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 03:31:29 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:31:29 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:31:29 user nova-compute[74898]:   <source dev="/dev/sdc"/>
Nov 17 03:31:29 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:31:29 user nova-compute[74898]:   <serial>8a8357d8-ff03-40bf-8cfe-784ef1f78342</serial>
Nov 17 03:31:29 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:31:29 user nova-compute[74898]: </disk>
Nov 17 03:31:29 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:31:30 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 21cd1abc-80ab-470b-9f69-19ccfa835f25 {{(pid=74898) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 03:31:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:31:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:39 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:31:39 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:31:39 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:31:40 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:31:42 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:31:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:31:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:31:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:31:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:31:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:44 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:31:45 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:31:45 user nova-compute[74898]: DEBUG nova.compute.manager [req-2c08d1c2-02ce-44db-b2ba-a7a9b703f145 req-cb14a2dd-d005-4a44-ad16-709ec6c81bdf service nova] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Received event network-changed-4fe8a0b3-a4f4-488d-937b-cdd22978a04e {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:31:45 user nova-compute[74898]: DEBUG nova.compute.manager [req-2c08d1c2-02ce-44db-b2ba-a7a9b703f145 req-cb14a2dd-d005-4a44-ad16-709ec6c81bdf service nova] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Refreshing instance network info cache due to event network-changed-4fe8a0b3-a4f4-488d-937b-cdd22978a04e. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:31:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-2c08d1c2-02ce-44db-b2ba-a7a9b703f145 req-cb14a2dd-d005-4a44-ad16-709ec6c81bdf service nova] Acquiring lock "refresh_cache-f3c85dac-e42c-4b33-842f-3fb681cdc2ee" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:31:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-2c08d1c2-02ce-44db-b2ba-a7a9b703f145 req-cb14a2dd-d005-4a44-ad16-709ec6c81bdf service nova] Acquired lock "refresh_cache-f3c85dac-e42c-4b33-842f-3fb681cdc2ee" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:31:45 user nova-compute[74898]: DEBUG nova.network.neutron [req-2c08d1c2-02ce-44db-b2ba-a7a9b703f145 req-cb14a2dd-d005-4a44-ad16-709ec6c81bdf service nova] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Refreshing network info cache for port 4fe8a0b3-a4f4-488d-937b-cdd22978a04e {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:31:46 user nova-compute[74898]: DEBUG nova.network.neutron [req-2c08d1c2-02ce-44db-b2ba-a7a9b703f145 req-cb14a2dd-d005-4a44-ad16-709ec6c81bdf service nova] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Updated VIF entry in instance network info cache for port 4fe8a0b3-a4f4-488d-937b-cdd22978a04e. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:31:46 user nova-compute[74898]: DEBUG nova.network.neutron [req-2c08d1c2-02ce-44db-b2ba-a7a9b703f145 req-cb14a2dd-d005-4a44-ad16-709ec6c81bdf service nova] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Updating instance_info_cache with network_info: [{"id": "4fe8a0b3-a4f4-488d-937b-cdd22978a04e", "address": "fa:16:3e:fc:f8:0f", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe8a0b3-a4", "ovs_interfaceid": "4fe8a0b3-a4f4-488d-937b-cdd22978a04e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:31:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-2c08d1c2-02ce-44db-b2ba-a7a9b703f145 req-cb14a2dd-d005-4a44-ad16-709ec6c81bdf service nova] Releasing lock "refresh_cache-f3c85dac-e42c-4b33-842f-3fb681cdc2ee" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:31:46 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:31:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:47 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:31:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:31:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:31:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:31:47 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:31:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cd1abc-80ab-470b-9f69-19ccfa835f25/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cd1abc-80ab-470b-9f69-19ccfa835f25/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cd1abc-80ab-470b-9f69-19ccfa835f25/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21cd1abc-80ab-470b-9f69-19ccfa835f25/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:31:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:48 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:31:48 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:31:48 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=8821MB free_disk=25.3133544921875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:31:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:31:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:31:48 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 21cd1abc-80ab-470b-9f69-19ccfa835f25 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:31:48 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance f3c85dac-e42c-4b33-842f-3fb681cdc2ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:31:48 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:31:48 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:31:48 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:31:48 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:31:48 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:31:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.212s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:31:50 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 21cd1abc-80ab-470b-9f69-19ccfa835f25 is timed out.
Nov 17 03:31:50 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Successfully detached device vdb from instance 21cd1abc-80ab-470b-9f69-19ccfa835f25 from the live domain config.
Nov 17 03:31:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JIPnBHFU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:31:50 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:31:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4d1eab-977e-4c1c-9c72-f6c117662661]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:31:50 user nova-compute[74898]: No targets found.
Nov 17 03:31:50 user nova-compute[74898]: iSNS:
Nov 17 03:31:50 user nova-compute[74898]: No targets found.
Nov 17 03:31:50 user nova-compute[74898]: STATIC:
Nov 17 03:31:50 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342
Nov 17 03:31:50 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:31:50 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:31:50 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f
Nov 17 03:31:50 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:31:50 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:31:50 user nova-compute[74898]: FIRMWARE:
Nov 17 03:31:50 user nova-compute[74898]: No targets found.
Nov 17 03:31:50 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:31:50 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:31:50 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0961451c-f37d-4945-8657-63fa31e0eb7e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c053e9-dc9b-4e81-8efe-7b35203e8d19]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:31:50 user nova-compute[74898]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342 (non-flash)
Nov 17 03:31:50 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:31:50 user nova-compute[74898]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342 (non-flash)
Nov 17 03:31:50 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9c187589d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342'): ({'sdc'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Removing single pathed devices sdc {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3270ed-4def-460b-bb4a-5abe94af8187]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86e7c73-4284-4fc8-95dd-415b7fd7ea29]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Flushing IO for device /dev/sdc {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3777e90a-8782-4ec8-afd6-ea07e9545402]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[667a5c02-754d-4b4d-8b3d-3a1eb1cc90a1]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] SCSI volumes sdc have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2e46b8-faa2-4901-8bf7-ff437a668660]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbdd728-0ccc-4890-83c9-8c5f53910953]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342, portal: 172.16.0.220,3260]
Nov 17 03:31:50 user nova-compute[74898]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342, portal: 172.16.0.220,3260] successful.
Nov 17 03:31:50 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a8357d8-ff03-40bf-8cfe-784ef1f78342 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[97df3e01-80db-4a18-b44f-c1d0d9a04408]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] <== disconnect_volume: return (282ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-21cd1abc-80ab-470b-9f69-19ccfa835f25" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-21cd1abc-80ab-470b-9f69-19ccfa835f25" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:31:50 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:31:51 user nova-compute[74898]: DEBUG nova.objects.instance [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lazy-loading 'flavor' on Instance uuid 21cd1abc-80ab-470b-9f69-19ccfa835f25 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:31:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-a9fb4292-244a-45df-9dac-62c9485e4ca2 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "21cd1abc-80ab-470b-9f69-19ccfa835f25" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.646s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:31:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "7958c15b-0903-458f-b718-94643d88661b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:31:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "7958c15b-0903-458f-b718-94643d88661b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:31:51 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:31:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:31:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:31:51 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:31:51 user nova-compute[74898]: INFO nova.compute.claims [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Claim successful on node user
Nov 17 03:31:51 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Updating instance_info_cache with network_info: [{"id": "89bde492-00b9-4912-a5b7-54a57e2c6350", "address": "fa:16:3e:48:24:a3", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bde492-00", "ovs_interfaceid": "89bde492-00b9-4912-a5b7-54a57e2c6350", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:31:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-21cd1abc-80ab-470b-9f69-19ccfa835f25" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:31:51 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:31:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:51 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:31:51 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:31:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.244s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:31:51 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:31:51 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:31:51 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:31:51 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:31:51 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:31:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:51 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:31:51 user nova-compute[74898]: DEBUG nova.policy [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa779a5f98394629b6b9fa9d04233e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d36087cc8e842c0bfcae89553fb9841', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:31:51 user nova-compute[74898]: INFO nova.virt.block_device [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Booting with volume e49e073a-536a-42eb-abce-5683ba197079 at /dev/vda
Nov 17 03:31:51 user nova-compute[74898]: DEBUG os_brick.utils [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:31:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f3382f-58ed-4924-9d65-524e0a61a670]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0a7ff4-375e-46a0-9372-03a7273db985]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c649323d-b668-4547-b2fe-0ecbd24638b1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9480a608-4d25-4960-896f-2c0f386847e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:31:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:31:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:31:52 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:31:52 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c213d4-2460-411f-ae2b-a3899645eda0]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:31:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:31:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:31:52 user nova-compute[74898]: DEBUG os_brick.utils [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:31:52 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Updating existing volume attachment record: dcd21767-48ef-4a7a-a55a-73d05256eb12 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:31:52 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Successfully created port: 5b744e4b-04ce-4fde-a250-95246dbcf97b {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:31:53 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Successfully updated port: 5b744e4b-04ce-4fde-a250-95246dbcf97b {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:31:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "refresh_cache-7958c15b-0903-458f-b718-94643d88661b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:31:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquired lock "refresh_cache-7958c15b-0903-458f-b718-94643d88661b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:31:53 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:31:53 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:31:53 user nova-compute[74898]: DEBUG nova.compute.manager [req-31b404fd-2687-4427-807e-abae234148fd req-9ef3c7af-a7bf-458a-84d1-c49fff4df1ff service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] Received event network-changed-5b744e4b-04ce-4fde-a250-95246dbcf97b {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:31:53 user nova-compute[74898]: DEBUG nova.compute.manager [req-31b404fd-2687-4427-807e-abae234148fd req-9ef3c7af-a7bf-458a-84d1-c49fff4df1ff service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] Refreshing instance network info cache due to event network-changed-5b744e4b-04ce-4fde-a250-95246dbcf97b. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:31:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-31b404fd-2687-4427-807e-abae234148fd req-9ef3c7af-a7bf-458a-84d1-c49fff4df1ff service nova] Acquiring lock "refresh_cache-7958c15b-0903-458f-b718-94643d88661b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:31:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:53 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Updating instance_info_cache with network_info: [{"id": "5b744e4b-04ce-4fde-a250-95246dbcf97b", "address": "fa:16:3e:e6:87:0a", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b744e4b-04", "ovs_interfaceid": "5b744e4b-04ce-4fde-a250-95246dbcf97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:31:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Releasing lock "refresh_cache-7958c15b-0903-458f-b718-94643d88661b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:31:53 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Instance network_info: |[{"id": "5b744e4b-04ce-4fde-a250-95246dbcf97b", "address": "fa:16:3e:e6:87:0a", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b744e4b-04", "ovs_interfaceid": "5b744e4b-04ce-4fde-a250-95246dbcf97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:31:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-31b404fd-2687-4427-807e-abae234148fd req-9ef3c7af-a7bf-458a-84d1-c49fff4df1ff service nova] Acquired lock "refresh_cache-7958c15b-0903-458f-b718-94643d88661b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:31:53 user nova-compute[74898]: DEBUG nova.network.neutron [req-31b404fd-2687-4427-807e-abae234148fd req-9ef3c7af-a7bf-458a-84d1-c49fff4df1ff service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] Refreshing network info cache for port 5b744e4b-04ce-4fde-a250-95246dbcf97b {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:31:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:31:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:31:53 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:31:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:31:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:31:54 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:31:54 user nova-compute[74898]: INFO nova.compute.claims [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Claim successful on node user
Nov 17 03:31:54 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:31:54 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:31:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.256s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:31:54 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:31:54 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:31:54 user nova-compute[74898]: DEBUG nova.network.neutron [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:31:54 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:31:54 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:31:54 user nova-compute[74898]: DEBUG nova.policy [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f3d630e4ece4c6c87da71cedcf3a839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4596366f424fa7937aaf97828a7c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:31:54 user nova-compute[74898]: DEBUG nova.network.neutron [req-31b404fd-2687-4427-807e-abae234148fd req-9ef3c7af-a7bf-458a-84d1-c49fff4df1ff service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] Updated VIF entry in instance network info cache for port 5b744e4b-04ce-4fde-a250-95246dbcf97b. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:31:54 user nova-compute[74898]: DEBUG nova.network.neutron [req-31b404fd-2687-4427-807e-abae234148fd req-9ef3c7af-a7bf-458a-84d1-c49fff4df1ff service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] Updating instance_info_cache with network_info: [{"id": "5b744e4b-04ce-4fde-a250-95246dbcf97b", "address": "fa:16:3e:e6:87:0a", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b744e4b-04", "ovs_interfaceid": "5b744e4b-04ce-4fde-a250-95246dbcf97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:31:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-31b404fd-2687-4427-807e-abae234148fd req-9ef3c7af-a7bf-458a-84d1-c49fff4df1ff service nova] Releasing lock "refresh_cache-7958c15b-0903-458f-b718-94643d88661b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:31:54 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:31:54 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:31:54 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Creating image(s)
Nov 17 03:31:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "/opt/stack/data/nova/instances/6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:31:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "/opt/stack/data/nova/instances/6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:31:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "/opt/stack/data/nova/instances/6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:31:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:31:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:31:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.170s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5/disk 1073741824" returned: 0 in 0.055s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:31:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:55 user nova-compute[74898]: DEBUG nova.network.neutron [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Successfully created port: 182a94b3-1f52-47cf-95b7-900b82afd9ab {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:31:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.171s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:55 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:31:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:55 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Cannot resize image /opt/stack/data/nova/instances/6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:31:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:31:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Ensure instance console log exists: /opt/stack/data/nova/instances/6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:31:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:31:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:31:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:31:55 user nova-compute[74898]: DEBUG nova.network.neutron [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Successfully updated port: 182a94b3-1f52-47cf-95b7-900b82afd9ab {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:31:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "refresh_cache-6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:31:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquired lock "refresh_cache-6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:31:55 user nova-compute[74898]: DEBUG nova.network.neutron [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:31:55 user nova-compute[74898]: DEBUG nova.network.neutron [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:31:55 user nova-compute[74898]: DEBUG nova.compute.manager [req-81fc4fd0-b922-41ca-9fde-7ae1379cb64e req-aa6f4c2e-be71-40ba-a1a2-877777f1a704 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Received event network-changed-182a94b3-1f52-47cf-95b7-900b82afd9ab {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:31:55 user nova-compute[74898]: DEBUG nova.compute.manager [req-81fc4fd0-b922-41ca-9fde-7ae1379cb64e req-aa6f4c2e-be71-40ba-a1a2-877777f1a704 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Refreshing instance network info cache due to event network-changed-182a94b3-1f52-47cf-95b7-900b82afd9ab. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:31:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-81fc4fd0-b922-41ca-9fde-7ae1379cb64e req-aa6f4c2e-be71-40ba-a1a2-877777f1a704 service nova] Acquiring lock "refresh_cache-6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:31:55 user nova-compute[74898]: DEBUG nova.network.neutron [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Updating instance_info_cache with network_info: [{"id": "182a94b3-1f52-47cf-95b7-900b82afd9ab", "address": "fa:16:3e:d3:3c:3c", "network": {"id": "7ab9395e-a6a0-4b93-990e-d7d064bba5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-894693551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4596366f424fa7937aaf97828a7c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182a94b3-1f", "ovs_interfaceid": "182a94b3-1f52-47cf-95b7-900b82afd9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:31:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Releasing lock "refresh_cache-6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:31:55 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Instance network_info: |[{"id": "182a94b3-1f52-47cf-95b7-900b82afd9ab", "address": "fa:16:3e:d3:3c:3c", "network": {"id": "7ab9395e-a6a0-4b93-990e-d7d064bba5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-894693551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4596366f424fa7937aaf97828a7c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182a94b3-1f", "ovs_interfaceid": "182a94b3-1f52-47cf-95b7-900b82afd9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:31:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-81fc4fd0-b922-41ca-9fde-7ae1379cb64e req-aa6f4c2e-be71-40ba-a1a2-877777f1a704 service nova] Acquired lock "refresh_cache-6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:31:55 user nova-compute[74898]: DEBUG nova.network.neutron [req-81fc4fd0-b922-41ca-9fde-7ae1379cb64e req-aa6f4c2e-be71-40ba-a1a2-877777f1a704 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Refreshing network info cache for port 182a94b3-1f52-47cf-95b7-900b82afd9ab {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:31:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Start _get_guest_xml network_info=[{"id": "182a94b3-1f52-47cf-95b7-900b82afd9ab", "address": "fa:16:3e:d3:3c:3c", "network": {"id": "7ab9395e-a6a0-4b93-990e-d7d064bba5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-894693551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4596366f424fa7937aaf97828a7c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182a94b3-1f", "ovs_interfaceid": "182a94b3-1f52-47cf-95b7-900b82afd9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:31:55 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:31:55 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:31:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:31:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-682903395',display_name='tempest-VolumesSnapshotTestJSON-instance-682903395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-682903395',id=45,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2foVnlAbfw6vEG8OK5AE+3JkpZbJFApHX1WJ3fxZH4PCQ8LIvPzvJlRtoBugbm5cJ4YnJlTXZMiqB3lznIiHQ1FBjQ3ozxN1IChZ24x/ZgeHfijcntMbYZTo4b5g3++Q==',key_name='tempest-keypair-308840350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e4596366f424fa7937aaf97828a7c65',ramdisk_id='',reservation_id='r-hgf0yhbo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1365341029',owner_user_name='tempest-VolumesSnapshotTestJSON-1365341029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:31:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f3d630e4ece4c6c87da71cedcf3a839',uuid=6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "182a94b3-1f52-47cf-95b7-900b82afd9ab", "address": "fa:16:3e:d3:3c:3c", "network": {"id": "7ab9395e-a6a0-4b93-990e-d7d064bba5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-894693551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4596366f424fa7937aaf97828a7c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182a94b3-1f", "ovs_interfaceid": "182a94b3-1f52-47cf-95b7-900b82afd9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Converting VIF {"id": "182a94b3-1f52-47cf-95b7-900b82afd9ab", "address": "fa:16:3e:d3:3c:3c", "network": {"id": "7ab9395e-a6a0-4b93-990e-d7d064bba5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-894693551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4596366f424fa7937aaf97828a7c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182a94b3-1f", "ovs_interfaceid": "182a94b3-1f52-47cf-95b7-900b82afd9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:3c:3c,bridge_name='br-int',has_traffic_filtering=True,id=182a94b3-1f52-47cf-95b7-900b82afd9ab,network=Network(7ab9395e-a6a0-4b93-990e-d7d064bba5c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap182a94b3-1f') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG nova.objects.instance [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lazy-loading 'pci_devices' on Instance uuid 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:31:56 user nova-compute[74898]:   <uuid>6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5</uuid>
Nov 17 03:31:56 user nova-compute[74898]:   <name>instance-0000002d</name>
Nov 17 03:31:56 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:31:56 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:31:56 user nova-compute[74898]:   <metadata>
Nov 17 03:31:56 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:31:56 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:31:56 user nova-compute[74898]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-682903395</nova:name>
Nov 17 03:31:56 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:31:55</nova:creationTime>
Nov 17 03:31:56 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:31:56 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:31:56 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:31:56 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:31:56 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:31:56 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:31:56 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:31:56 user nova-compute[74898]:       <nova:owner>
Nov 17 03:31:56 user nova-compute[74898]:         <nova:user uuid="9f3d630e4ece4c6c87da71cedcf3a839">tempest-VolumesSnapshotTestJSON-1365341029-project-member</nova:user>
Nov 17 03:31:56 user nova-compute[74898]:         <nova:project uuid="4e4596366f424fa7937aaf97828a7c65">tempest-VolumesSnapshotTestJSON-1365341029</nova:project>
Nov 17 03:31:56 user nova-compute[74898]:       </nova:owner>
Nov 17 03:31:56 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:31:56 user nova-compute[74898]:       <nova:ports>
Nov 17 03:31:56 user nova-compute[74898]:         <nova:port uuid="182a94b3-1f52-47cf-95b7-900b82afd9ab">
Nov 17 03:31:56 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 17 03:31:56 user nova-compute[74898]:         </nova:port>
Nov 17 03:31:56 user nova-compute[74898]:       </nova:ports>
Nov 17 03:31:56 user nova-compute[74898]:     </nova:instance>
Nov 17 03:31:56 user nova-compute[74898]:   </metadata>
Nov 17 03:31:56 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:31:56 user nova-compute[74898]:     <system>
Nov 17 03:31:56 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:31:56 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:31:56 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:31:56 user nova-compute[74898]:       <entry name="serial">6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5</entry>
Nov 17 03:31:56 user nova-compute[74898]:       <entry name="uuid">6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5</entry>
Nov 17 03:31:56 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:31:56 user nova-compute[74898]:     </system>
Nov 17 03:31:56 user nova-compute[74898]:   </sysinfo>
Nov 17 03:31:56 user nova-compute[74898]:   <os>
Nov 17 03:31:56 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:31:56 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:31:56 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:31:56 user nova-compute[74898]:   </os>
Nov 17 03:31:56 user nova-compute[74898]:   <features>
Nov 17 03:31:56 user nova-compute[74898]:     <acpi/>
Nov 17 03:31:56 user nova-compute[74898]:     <apic/>
Nov 17 03:31:56 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:31:56 user nova-compute[74898]:   </features>
Nov 17 03:31:56 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:31:56 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:31:56 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:31:56 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:31:56 user nova-compute[74898]:   </clock>
Nov 17 03:31:56 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:31:56 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:31:56 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:31:56 user nova-compute[74898]:   </cpu>
Nov 17 03:31:56 user nova-compute[74898]:   <devices>
Nov 17 03:31:56 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:31:56 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:31:56 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5/disk"/>
Nov 17 03:31:56 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:31:56 user nova-compute[74898]:     </disk>
Nov 17 03:31:56 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:31:56 user nova-compute[74898]:       <mac address="fa:16:3e:d3:3c:3c"/>
Nov 17 03:31:56 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:31:56 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:31:56 user nova-compute[74898]:       <target dev="tap182a94b3-1f"/>
Nov 17 03:31:56 user nova-compute[74898]:     </interface>
Nov 17 03:31:56 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:31:56 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5/console.log" append="off"/>
Nov 17 03:31:56 user nova-compute[74898]:     </serial>
Nov 17 03:31:56 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:31:56 user nova-compute[74898]:     <video>
Nov 17 03:31:56 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:31:56 user nova-compute[74898]:     </video>
Nov 17 03:31:56 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:31:56 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:31:56 user nova-compute[74898]:     </rng>
Nov 17 03:31:56 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:31:56 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:31:56 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:31:56 user nova-compute[74898]:     </memballoon>
Nov 17 03:31:56 user nova-compute[74898]:   </devices>
Nov 17 03:31:56 user nova-compute[74898]: </domain>
Nov 17 03:31:56 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:31:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-682903395',display_name='tempest-VolumesSnapshotTestJSON-instance-682903395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-682903395',id=45,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2foVnlAbfw6vEG8OK5AE+3JkpZbJFApHX1WJ3fxZH4PCQ8LIvPzvJlRtoBugbm5cJ4YnJlTXZMiqB3lznIiHQ1FBjQ3ozxN1IChZ24x/ZgeHfijcntMbYZTo4b5g3++Q==',key_name='tempest-keypair-308840350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e4596366f424fa7937aaf97828a7c65',ramdisk_id='',reservation_id='r-hgf0yhbo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1365341029',owner_user_name='tempest-VolumesSnapshotTestJSON-1365341029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:31:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f3d630e4ece4c6c87da71cedcf3a839',uuid=6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "182a94b3-1f52-47cf-95b7-900b82afd9ab", "address": "fa:16:3e:d3:3c:3c", "network": {"id": "7ab9395e-a6a0-4b93-990e-d7d064bba5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-894693551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4596366f424fa7937aaf97828a7c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182a94b3-1f", "ovs_interfaceid": "182a94b3-1f52-47cf-95b7-900b82afd9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Converting VIF {"id": "182a94b3-1f52-47cf-95b7-900b82afd9ab", "address": "fa:16:3e:d3:3c:3c", "network": {"id": "7ab9395e-a6a0-4b93-990e-d7d064bba5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-894693551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4596366f424fa7937aaf97828a7c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182a94b3-1f", "ovs_interfaceid": "182a94b3-1f52-47cf-95b7-900b82afd9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:3c:3c,bridge_name='br-int',has_traffic_filtering=True,id=182a94b3-1f52-47cf-95b7-900b82afd9ab,network=Network(7ab9395e-a6a0-4b93-990e-d7d064bba5c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap182a94b3-1f') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG os_vif [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:3c:3c,bridge_name='br-int',has_traffic_filtering=True,id=182a94b3-1f52-47cf-95b7-900b82afd9ab,network=Network(7ab9395e-a6a0-4b93-990e-d7d064bba5c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap182a94b3-1f') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '20dfe295-4489-5b2f-84d1-8ec0f53da67e', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap182a94b3-1f, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap182a94b3-1f, col_values=(('qos', UUID('b9694fe1-4c84-42e0-a7ee-d5efe15bfc6e')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap182a94b3-1f, col_values=(('external_ids', {'iface-id': '182a94b3-1f52-47cf-95b7-900b82afd9ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:3c:3c', 'vm-uuid': '6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:56 user nova-compute[74898]: INFO os_vif [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:3c:3c,bridge_name='br-int',has_traffic_filtering=True,id=182a94b3-1f52-47cf-95b7-900b82afd9ab,network=Network(7ab9395e-a6a0-4b93-990e-d7d064bba5c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap182a94b3-1f')
Nov 17 03:31:56 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] No VIF found with MAC fa:16:3e:d3:3c:3c, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG nova.network.neutron [req-81fc4fd0-b922-41ca-9fde-7ae1379cb64e req-aa6f4c2e-be71-40ba-a1a2-877777f1a704 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Updated VIF entry in instance network info cache for port 182a94b3-1f52-47cf-95b7-900b82afd9ab. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG nova.network.neutron [req-81fc4fd0-b922-41ca-9fde-7ae1379cb64e req-aa6f4c2e-be71-40ba-a1a2-877777f1a704 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Updating instance_info_cache with network_info: [{"id": "182a94b3-1f52-47cf-95b7-900b82afd9ab", "address": "fa:16:3e:d3:3c:3c", "network": {"id": "7ab9395e-a6a0-4b93-990e-d7d064bba5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-894693551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4596366f424fa7937aaf97828a7c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182a94b3-1f", "ovs_interfaceid": "182a94b3-1f52-47cf-95b7-900b82afd9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-81fc4fd0-b922-41ca-9fde-7ae1379cb64e req-aa6f4c2e-be71-40ba-a1a2-877777f1a704 service nova] Releasing lock "refresh_cache-6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:31:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:31:57 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Creating image(s)
Nov 17 03:31:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Did not create local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Ensure instance console log exists: /opt/stack/data/nova/instances/7958c15b-0903-458f-b718-94643d88661b/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Start _get_guest_xml network_info=[{"id": "5b744e4b-04ce-4fde-a250-95246dbcf97b", "address": "fa:16:3e:e6:87:0a", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b744e4b-04", "ovs_interfaceid": "5b744e4b-04ce-4fde-a250-95246dbcf97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vgYtCQkV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7958c15b-0903-458f-b718-94643d88661b', 'attached_at': '', 'detached_at': '', 'volume_id': 'e49e073a-536a-42eb-abce-5683ba197079', 'serial': 'e49e073a-536a-42eb-abce-5683ba197079'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'dcd21767-48ef-4a7a-a55a-73d05256eb12', 'volume_type': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:31:57 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:31:57 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:31:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vgYtCQkV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:31:57 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:31:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:31:57 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:31:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:31:57 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf49dea-ba2b-46aa-8840-de637687f570]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:31:57 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG nova.compute.manager [req-dbdc8501-611d-419a-957b-6795e0aac584 req-821d82eb-f06a-4ade-900b-0fae30a41332 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Received event network-vif-plugged-182a94b3-1f52-47cf-95b7-900b82afd9ab {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-dbdc8501-611d-419a-957b-6795e0aac584 req-821d82eb-f06a-4ade-900b-0fae30a41332 service nova] Acquiring lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-dbdc8501-611d-419a-957b-6795e0aac584 req-821d82eb-f06a-4ade-900b-0fae30a41332 service nova] Lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-dbdc8501-611d-419a-957b-6795e0aac584 req-821d82eb-f06a-4ade-900b-0fae30a41332 service nova] Lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG nova.compute.manager [req-dbdc8501-611d-419a-957b-6795e0aac584 req-821d82eb-f06a-4ade-900b-0fae30a41332 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] No waiting events found dispatching network-vif-plugged-182a94b3-1f52-47cf-95b7-900b82afd9ab {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:31:57 user nova-compute[74898]: WARNING nova.compute.manager [req-dbdc8501-611d-419a-957b-6795e0aac584 req-821d82eb-f06a-4ade-900b-0fae30a41332 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Received unexpected event network-vif-plugged-182a94b3-1f52-47cf-95b7-900b82afd9ab for instance with vm_state building and task_state spawning.
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bccee67-0288-4116-85f0-a75b44e9b039]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079] added
Nov 17 03:31:57 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[334a871a-b046-45a4-b72a-9e0d7d82f0d6]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b820fa52-0fa7-408c-aa9a-e0f02ef6b6bb]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vgYtCQkV {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vgYtCQkV" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8387d3-a3be-4895-b777-fbfeb5ab76cc]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vgYtCQkV'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62b6ace-6eba-48de-b9d9-1d8e31b4973f]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3694f831-6f42-48c2-b02a-59b0b9ae3c2f]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:31:57 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:31:57 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a14dbf6-9122-43d7-956e-9905926aa1df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079, portal: 172.16.0.220,3260]
Nov 17 03:31:57 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079, portal: 172.16.0.220,3260] successful.
Nov 17 03:31:57 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a19d34-2278-4306-8df7-62c0cd7b9042]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fa121a-4121-46bb-a63b-631a784a9888]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:31:57 user nova-compute[74898]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079 (non-flash)
Nov 17 03:31:57 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:31:57 user nova-compute[74898]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079 (non-flash)
Nov 17 03:31:57 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[782b1895-3576-48b5-b623-459d5b5fb3bf]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:31:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vgYtCQkV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:31:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:31:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26566336437326261', 'path': '/dev/sdc'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:31:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566336437326261', 'path': '/dev/sdc'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:31:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:31:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-498741363',display_name='tempest-TestVolumeBootPattern-server-498741363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-498741363',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJInWWavbu/6d6OQJPNghOKND7RIoCzZc2qCUfAkCC2TokwiJfdMvyOxWX8lLSW7Fx1YLwTdFBaDgYlG8DKkEJfoMkAf+B/utXvLWusVeA4Z9dMFCfioGuJoTmK0Ain2zQ==',key_name='tempest-TestVolumeBootPattern-1387915334',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d36087cc8e842c0bfcae89553fb9841',ramdisk_id='',reservation_id='r-i6vhpapa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1382126375',owner_user_name='tempest-TestVolumeBootPattern-1382126375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:31:52Z,user_data=None,user_id='aa779a5f98394629b6b9fa9d04233e7a',uuid=7958c15b-0903-458f-b718-94643d88661b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b744e4b-04ce-4fde-a250-95246dbcf97b", "address": "fa:16:3e:e6:87:0a", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b744e4b-04", "ovs_interfaceid": "5b744e4b-04ce-4fde-a250-95246dbcf97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:31:58 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converting VIF {"id": "5b744e4b-04ce-4fde-a250-95246dbcf97b", "address": "fa:16:3e:e6:87:0a", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b744e4b-04", "ovs_interfaceid": "5b744e4b-04ce-4fde-a250-95246dbcf97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:31:58 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:87:0a,bridge_name='br-int',has_traffic_filtering=True,id=5b744e4b-04ce-4fde-a250-95246dbcf97b,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b744e4b-04') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:31:58 user nova-compute[74898]: DEBUG nova.objects.instance [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lazy-loading 'pci_devices' on Instance uuid 7958c15b-0903-458f-b718-94643d88661b {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:31:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:31:58 user nova-compute[74898]:   <uuid>7958c15b-0903-458f-b718-94643d88661b</uuid>
Nov 17 03:31:58 user nova-compute[74898]:   <name>instance-0000002c</name>
Nov 17 03:31:58 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:31:58 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:31:58 user nova-compute[74898]:   <metadata>
Nov 17 03:31:58 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:31:58 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:31:58 user nova-compute[74898]:       <nova:name>tempest-TestVolumeBootPattern-server-498741363</nova:name>
Nov 17 03:31:58 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:31:57</nova:creationTime>
Nov 17 03:31:58 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:31:58 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:31:58 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:31:58 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:31:58 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:31:58 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:31:58 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:31:58 user nova-compute[74898]:       <nova:owner>
Nov 17 03:31:58 user nova-compute[74898]:         <nova:user uuid="aa779a5f98394629b6b9fa9d04233e7a">tempest-TestVolumeBootPattern-1382126375-project-member</nova:user>
Nov 17 03:31:58 user nova-compute[74898]:         <nova:project uuid="5d36087cc8e842c0bfcae89553fb9841">tempest-TestVolumeBootPattern-1382126375</nova:project>
Nov 17 03:31:58 user nova-compute[74898]:       </nova:owner>
Nov 17 03:31:58 user nova-compute[74898]:       <nova:ports>
Nov 17 03:31:58 user nova-compute[74898]:         <nova:port uuid="5b744e4b-04ce-4fde-a250-95246dbcf97b">
Nov 17 03:31:58 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 17 03:31:58 user nova-compute[74898]:         </nova:port>
Nov 17 03:31:58 user nova-compute[74898]:       </nova:ports>
Nov 17 03:31:58 user nova-compute[74898]:     </nova:instance>
Nov 17 03:31:58 user nova-compute[74898]:   </metadata>
Nov 17 03:31:58 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:31:58 user nova-compute[74898]:     <system>
Nov 17 03:31:58 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:31:58 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:31:58 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:31:58 user nova-compute[74898]:       <entry name="serial">7958c15b-0903-458f-b718-94643d88661b</entry>
Nov 17 03:31:58 user nova-compute[74898]:       <entry name="uuid">7958c15b-0903-458f-b718-94643d88661b</entry>
Nov 17 03:31:58 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:31:58 user nova-compute[74898]:     </system>
Nov 17 03:31:58 user nova-compute[74898]:   </sysinfo>
Nov 17 03:31:58 user nova-compute[74898]:   <os>
Nov 17 03:31:58 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:31:58 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:31:58 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:31:58 user nova-compute[74898]:   </os>
Nov 17 03:31:58 user nova-compute[74898]:   <features>
Nov 17 03:31:58 user nova-compute[74898]:     <acpi/>
Nov 17 03:31:58 user nova-compute[74898]:     <apic/>
Nov 17 03:31:58 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:31:58 user nova-compute[74898]:   </features>
Nov 17 03:31:58 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:31:58 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:31:58 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:31:58 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:31:58 user nova-compute[74898]:   </clock>
Nov 17 03:31:58 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:31:58 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:31:58 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:31:58 user nova-compute[74898]:   </cpu>
Nov 17 03:31:58 user nova-compute[74898]:   <devices>
Nov 17 03:31:58 user nova-compute[74898]:     <disk type="block" device="disk">
Nov 17 03:31:58 user nova-compute[74898]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:31:58 user nova-compute[74898]:       <source dev="/dev/sdc"/>
Nov 17 03:31:58 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:31:58 user nova-compute[74898]:       <serial>e49e073a-536a-42eb-abce-5683ba197079</serial>
Nov 17 03:31:58 user nova-compute[74898]:     </disk>
Nov 17 03:31:58 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:31:58 user nova-compute[74898]:       <mac address="fa:16:3e:e6:87:0a"/>
Nov 17 03:31:58 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:31:58 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:31:58 user nova-compute[74898]:       <target dev="tap5b744e4b-04"/>
Nov 17 03:31:58 user nova-compute[74898]:     </interface>
Nov 17 03:31:58 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:31:58 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/7958c15b-0903-458f-b718-94643d88661b/console.log" append="off"/>
Nov 17 03:31:58 user nova-compute[74898]:     </serial>
Nov 17 03:31:58 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:31:58 user nova-compute[74898]:     <video>
Nov 17 03:31:58 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:31:58 user nova-compute[74898]:     </video>
Nov 17 03:31:58 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:31:58 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:31:58 user nova-compute[74898]:     </rng>
Nov 17 03:31:58 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:31:58 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:31:58 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:31:58 user nova-compute[74898]:     </memballoon>
Nov 17 03:31:58 user nova-compute[74898]:   </devices>
Nov 17 03:31:58 user nova-compute[74898]: </domain>
Nov 17 03:31:58 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:31:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:31:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-498741363',display_name='tempest-TestVolumeBootPattern-server-498741363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-498741363',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJInWWavbu/6d6OQJPNghOKND7RIoCzZc2qCUfAkCC2TokwiJfdMvyOxWX8lLSW7Fx1YLwTdFBaDgYlG8DKkEJfoMkAf+B/utXvLWusVeA4Z9dMFCfioGuJoTmK0Ain2zQ==',key_name='tempest-TestVolumeBootPattern-1387915334',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d36087cc8e842c0bfcae89553fb9841',ramdisk_id='',reservation_id='r-i6vhpapa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1382126375',owner_user_name='tempest-TestVolumeBootPattern-1382126375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:31:52Z,user_data=None,user_id='aa779a5f98394629b6b9fa9d04233e7a',uuid=7958c15b-0903-458f-b718-94643d88661b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b744e4b-04ce-4fde-a250-95246dbcf97b", "address": "fa:16:3e:e6:87:0a", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b744e4b-04", "ovs_interfaceid": "5b744e4b-04ce-4fde-a250-95246dbcf97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:31:58 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converting VIF {"id": "5b744e4b-04ce-4fde-a250-95246dbcf97b", "address": "fa:16:3e:e6:87:0a", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b744e4b-04", "ovs_interfaceid": "5b744e4b-04ce-4fde-a250-95246dbcf97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:31:58 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:87:0a,bridge_name='br-int',has_traffic_filtering=True,id=5b744e4b-04ce-4fde-a250-95246dbcf97b,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b744e4b-04') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:31:58 user nova-compute[74898]: DEBUG os_vif [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:87:0a,bridge_name='br-int',has_traffic_filtering=True,id=5b744e4b-04ce-4fde-a250-95246dbcf97b,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b744e4b-04') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:31:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:31:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:31:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '25b82fff-46e0-50dc-9756-de69a388b9d7', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:31:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:31:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b744e4b-04, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:31:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b744e4b-04, col_values=(('qos', UUID('2e86b989-02cd-494b-ae59-55ec22f55b10')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:31:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b744e4b-04, col_values=(('external_ids', {'iface-id': '5b744e4b-04ce-4fde-a250-95246dbcf97b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:87:0a', 'vm-uuid': '7958c15b-0903-458f-b718-94643d88661b'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:31:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:31:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:31:58 user nova-compute[74898]: INFO os_vif [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:87:0a,bridge_name='br-int',has_traffic_filtering=True,id=5b744e4b-04ce-4fde-a250-95246dbcf97b,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b744e4b-04')
Nov 17 03:31:59 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:31:59 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] No VIF found with MAC fa:16:3e:e6:87:0a, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:31:59 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:31:59 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:31:59 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Instance spawned successfully.
Nov 17 03:31:59 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:31:59 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:31:59 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:31:59 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:31:59 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:31:59 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:31:59 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:31:59 user nova-compute[74898]: INFO nova.compute.manager [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 17 03:31:59 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:31:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-53e292fa-56e9-4fbb-a9ef-f5a836d37be8 req-7e75013c-2052-4e17-b1df-acb1a2fa0492 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Received event network-vif-plugged-182a94b3-1f52-47cf-95b7-900b82afd9ab {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:31:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-53e292fa-56e9-4fbb-a9ef-f5a836d37be8 req-7e75013c-2052-4e17-b1df-acb1a2fa0492 service nova] Acquiring lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:31:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-53e292fa-56e9-4fbb-a9ef-f5a836d37be8 req-7e75013c-2052-4e17-b1df-acb1a2fa0492 service nova] Lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:31:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-53e292fa-56e9-4fbb-a9ef-f5a836d37be8 req-7e75013c-2052-4e17-b1df-acb1a2fa0492 service nova] Lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:31:59 user nova-compute[74898]: DEBUG nova.compute.manager [req-53e292fa-56e9-4fbb-a9ef-f5a836d37be8 req-7e75013c-2052-4e17-b1df-acb1a2fa0492 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] No waiting events found dispatching network-vif-plugged-182a94b3-1f52-47cf-95b7-900b82afd9ab {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:31:59 user nova-compute[74898]: WARNING nova.compute.manager [req-53e292fa-56e9-4fbb-a9ef-f5a836d37be8 req-7e75013c-2052-4e17-b1df-acb1a2fa0492 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Received unexpected event network-vif-plugged-182a94b3-1f52-47cf-95b7-900b82afd9ab for instance with vm_state building and task_state spawning.
Nov 17 03:31:59 user nova-compute[74898]: INFO nova.compute.manager [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Took 5.72 seconds to build instance.
Nov 17 03:31:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c34a2dc5-1fe3-4018-8ecb-ffc34ebd4acf tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.814s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:32:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:01 user nova-compute[74898]: DEBUG nova.compute.manager [req-64b2752d-d470-41a0-9f8a-39ee1e64cdd9 req-9d220279-cf2b-4c3c-a3fa-f230843390fa service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] Received event network-vif-plugged-5b744e4b-04ce-4fde-a250-95246dbcf97b {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:32:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-64b2752d-d470-41a0-9f8a-39ee1e64cdd9 req-9d220279-cf2b-4c3c-a3fa-f230843390fa service nova] Acquiring lock "7958c15b-0903-458f-b718-94643d88661b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:32:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-64b2752d-d470-41a0-9f8a-39ee1e64cdd9 req-9d220279-cf2b-4c3c-a3fa-f230843390fa service nova] Lock "7958c15b-0903-458f-b718-94643d88661b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:32:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-64b2752d-d470-41a0-9f8a-39ee1e64cdd9 req-9d220279-cf2b-4c3c-a3fa-f230843390fa service nova] Lock "7958c15b-0903-458f-b718-94643d88661b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:32:01 user nova-compute[74898]: DEBUG nova.compute.manager [req-64b2752d-d470-41a0-9f8a-39ee1e64cdd9 req-9d220279-cf2b-4c3c-a3fa-f230843390fa service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] No waiting events found dispatching network-vif-plugged-5b744e4b-04ce-4fde-a250-95246dbcf97b {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:32:01 user nova-compute[74898]: WARNING nova.compute.manager [req-64b2752d-d470-41a0-9f8a-39ee1e64cdd9 req-9d220279-cf2b-4c3c-a3fa-f230843390fa service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] Received unexpected event network-vif-plugged-5b744e4b-04ce-4fde-a250-95246dbcf97b for instance with vm_state building and task_state spawning.
Nov 17 03:32:01 user nova-compute[74898]: DEBUG nova.compute.manager [req-64b2752d-d470-41a0-9f8a-39ee1e64cdd9 req-9d220279-cf2b-4c3c-a3fa-f230843390fa service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] Received event network-vif-plugged-5b744e4b-04ce-4fde-a250-95246dbcf97b {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:32:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-64b2752d-d470-41a0-9f8a-39ee1e64cdd9 req-9d220279-cf2b-4c3c-a3fa-f230843390fa service nova] Acquiring lock "7958c15b-0903-458f-b718-94643d88661b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:32:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-64b2752d-d470-41a0-9f8a-39ee1e64cdd9 req-9d220279-cf2b-4c3c-a3fa-f230843390fa service nova] Lock "7958c15b-0903-458f-b718-94643d88661b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:32:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-64b2752d-d470-41a0-9f8a-39ee1e64cdd9 req-9d220279-cf2b-4c3c-a3fa-f230843390fa service nova] Lock "7958c15b-0903-458f-b718-94643d88661b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:32:01 user nova-compute[74898]: DEBUG nova.compute.manager [req-64b2752d-d470-41a0-9f8a-39ee1e64cdd9 req-9d220279-cf2b-4c3c-a3fa-f230843390fa service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] No waiting events found dispatching network-vif-plugged-5b744e4b-04ce-4fde-a250-95246dbcf97b {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:32:01 user nova-compute[74898]: WARNING nova.compute.manager [req-64b2752d-d470-41a0-9f8a-39ee1e64cdd9 req-9d220279-cf2b-4c3c-a3fa-f230843390fa service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] Received unexpected event network-vif-plugged-5b744e4b-04ce-4fde-a250-95246dbcf97b for instance with vm_state building and task_state spawning.
Nov 17 03:32:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:02 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:32:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:32:02 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 7958c15b-0903-458f-b718-94643d88661b] Instance spawned successfully.
Nov 17 03:32:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:32:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:32:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:32:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:32:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:32:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:32:02 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:32:02 user nova-compute[74898]: INFO nova.compute.manager [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 17 03:32:02 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:32:02 user nova-compute[74898]: INFO nova.compute.manager [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Took 11.07 seconds to build instance.
Nov 17 03:32:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e862674c-e738-498d-8d3c-e197789c9d20 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "7958c15b-0903-458f-b718-94643d88661b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.160s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:32:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:32:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:32:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:32:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:32:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:16 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f8d4d4bd-1ab4-43fd-a1fe-a5c146c5be5b tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "21cd1abc-80ab-470b-9f69-19ccfa835f25" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:32:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f8d4d4bd-1ab4-43fd-a1fe-a5c146c5be5b tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "21cd1abc-80ab-470b-9f69-19ccfa835f25" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:32:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f8d4d4bd-1ab4-43fd-a1fe-a5c146c5be5b tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "21cd1abc-80ab-470b-9f69-19ccfa835f25-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:32:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f8d4d4bd-1ab4-43fd-a1fe-a5c146c5be5b tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "21cd1abc-80ab-470b-9f69-19ccfa835f25-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:32:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f8d4d4bd-1ab4-43fd-a1fe-a5c146c5be5b tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "21cd1abc-80ab-470b-9f69-19ccfa835f25-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:32:20 user nova-compute[74898]: INFO nova.compute.manager [None req-f8d4d4bd-1ab4-43fd-a1fe-a5c146c5be5b tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Terminating instance
Nov 17 03:32:20 user nova-compute[74898]: DEBUG nova.compute.manager [None req-f8d4d4bd-1ab4-43fd-a1fe-a5c146c5be5b tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:32:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:20 user nova-compute[74898]: DEBUG nova.compute.manager [req-bcb99ef9-4fc9-40ff-85ea-8a39e5e61fbc req-dea1fda6-b3df-45a9-ae34-c869365e1d21 service nova] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Received event network-vif-unplugged-89bde492-00b9-4912-a5b7-54a57e2c6350 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:32:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-bcb99ef9-4fc9-40ff-85ea-8a39e5e61fbc req-dea1fda6-b3df-45a9-ae34-c869365e1d21 service nova] Acquiring lock "21cd1abc-80ab-470b-9f69-19ccfa835f25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:32:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-bcb99ef9-4fc9-40ff-85ea-8a39e5e61fbc req-dea1fda6-b3df-45a9-ae34-c869365e1d21 service nova] Lock "21cd1abc-80ab-470b-9f69-19ccfa835f25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:32:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-bcb99ef9-4fc9-40ff-85ea-8a39e5e61fbc req-dea1fda6-b3df-45a9-ae34-c869365e1d21 service nova] Lock "21cd1abc-80ab-470b-9f69-19ccfa835f25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:32:20 user nova-compute[74898]: DEBUG nova.compute.manager [req-bcb99ef9-4fc9-40ff-85ea-8a39e5e61fbc req-dea1fda6-b3df-45a9-ae34-c869365e1d21 service nova] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] No waiting events found dispatching network-vif-unplugged-89bde492-00b9-4912-a5b7-54a57e2c6350 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:32:20 user nova-compute[74898]: DEBUG nova.compute.manager [req-bcb99ef9-4fc9-40ff-85ea-8a39e5e61fbc req-dea1fda6-b3df-45a9-ae34-c869365e1d21 service nova] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Received event network-vif-unplugged-89bde492-00b9-4912-a5b7-54a57e2c6350 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:32:20 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Instance destroyed successfully.
Nov 17 03:32:20 user nova-compute[74898]: DEBUG nova.objects.instance [None req-f8d4d4bd-1ab4-43fd-a1fe-a5c146c5be5b tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lazy-loading 'resources' on Instance uuid 21cd1abc-80ab-470b-9f69-19ccfa835f25 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:32:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-f8d4d4bd-1ab4-43fd-a1fe-a5c146c5be5b tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1495709360',display_name='tempest-AttachVolumeNegativeTest-server-1495709360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1495709360',id=42,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1vcerUzfGrP33vHioK84oKFHRJydnC1QBOhoPYxHB54rEwf+omA4vyl3thKR/44zo0TKlIfFRjFLoL43B9i7jjoyf88XL/H7DGliodGbhx/QpN/fiUlkdbAg5G9DV7tQ==',key_name='tempest-keypair-1964879227',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:29:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='498d9d0f6667441791a7175256e4c557',ramdisk_id='',reservation_id='r-oahdlzbv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1401299497',owner_user_name='tempest-AttachVolumeNegativeTest-1401299497-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:29:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7660b84c605b4a459065b10fda42043f',uuid=21cd1abc-80ab-470b-9f69-19ccfa835f25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89bde492-00b9-4912-a5b7-54a57e2c6350", "address": "fa:16:3e:48:24:a3", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bde492-00", "ovs_interfaceid": "89bde492-00b9-4912-a5b7-54a57e2c6350", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:32:20 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-f8d4d4bd-1ab4-43fd-a1fe-a5c146c5be5b tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Converting VIF {"id": "89bde492-00b9-4912-a5b7-54a57e2c6350", "address": "fa:16:3e:48:24:a3", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bde492-00", "ovs_interfaceid": "89bde492-00b9-4912-a5b7-54a57e2c6350", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:32:20 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-f8d4d4bd-1ab4-43fd-a1fe-a5c146c5be5b tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:24:a3,bridge_name='br-int',has_traffic_filtering=True,id=89bde492-00b9-4912-a5b7-54a57e2c6350,network=Network(d02a6f85-70ee-4ed7-ae00-decabd94d542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89bde492-00') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:32:20 user nova-compute[74898]: DEBUG os_vif [None req-f8d4d4bd-1ab4-43fd-a1fe-a5c146c5be5b tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:24:a3,bridge_name='br-int',has_traffic_filtering=True,id=89bde492-00b9-4912-a5b7-54a57e2c6350,network=Network(d02a6f85-70ee-4ed7-ae00-decabd94d542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89bde492-00') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:32:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89bde492-00, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:32:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:32:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70d0cc26-6d56-4a47-9e3d-03a6f15b21b9) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:32:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:32:20 user nova-compute[74898]: INFO os_vif [None req-f8d4d4bd-1ab4-43fd-a1fe-a5c146c5be5b tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:24:a3,bridge_name='br-int',has_traffic_filtering=True,id=89bde492-00b9-4912-a5b7-54a57e2c6350,network=Network(d02a6f85-70ee-4ed7-ae00-decabd94d542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89bde492-00')
Nov 17 03:32:20 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-f8d4d4bd-1ab4-43fd-a1fe-a5c146c5be5b tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Deleting instance files /opt/stack/data/nova/instances/21cd1abc-80ab-470b-9f69-19ccfa835f25_del
Nov 17 03:32:20 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-f8d4d4bd-1ab4-43fd-a1fe-a5c146c5be5b tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Deletion of /opt/stack/data/nova/instances/21cd1abc-80ab-470b-9f69-19ccfa835f25_del complete
Nov 17 03:32:20 user nova-compute[74898]: INFO nova.compute.manager [None req-f8d4d4bd-1ab4-43fd-a1fe-a5c146c5be5b tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 17 03:32:20 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-f8d4d4bd-1ab4-43fd-a1fe-a5c146c5be5b tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:32:20 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:32:20 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:32:21 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:32:21 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Took 0.61 seconds to deallocate network for instance.
Nov 17 03:32:21 user nova-compute[74898]: DEBUG nova.compute.manager [req-e1559253-c832-4b82-a4b8-d18ddc50623f req-e6b08aae-6013-41df-80d1-51a70fdac54b service nova] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Received event network-vif-deleted-89bde492-00b9-4912-a5b7-54a57e2c6350 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:32:21 user nova-compute[74898]: INFO nova.compute.manager [req-e1559253-c832-4b82-a4b8-d18ddc50623f req-e6b08aae-6013-41df-80d1-51a70fdac54b service nova] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Neutron deleted interface 89bde492-00b9-4912-a5b7-54a57e2c6350; detaching it from the instance and deleting it from the info cache
Nov 17 03:32:21 user nova-compute[74898]: DEBUG nova.network.neutron [req-e1559253-c832-4b82-a4b8-d18ddc50623f req-e6b08aae-6013-41df-80d1-51a70fdac54b service nova] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:32:21 user nova-compute[74898]: DEBUG nova.compute.manager [req-e1559253-c832-4b82-a4b8-d18ddc50623f req-e6b08aae-6013-41df-80d1-51a70fdac54b service nova] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Detach interface failed, port_id=89bde492-00b9-4912-a5b7-54a57e2c6350, reason: Instance 21cd1abc-80ab-470b-9f69-19ccfa835f25 could not be found. {{(pid=74898) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 03:32:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f8d4d4bd-1ab4-43fd-a1fe-a5c146c5be5b tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:32:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f8d4d4bd-1ab4-43fd-a1fe-a5c146c5be5b tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:32:21 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-f8d4d4bd-1ab4-43fd-a1fe-a5c146c5be5b tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:32:21 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-f8d4d4bd-1ab4-43fd-a1fe-a5c146c5be5b tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:32:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f8d4d4bd-1ab4-43fd-a1fe-a5c146c5be5b tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:32:21 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-f8d4d4bd-1ab4-43fd-a1fe-a5c146c5be5b tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Deleted allocations for instance 21cd1abc-80ab-470b-9f69-19ccfa835f25
Nov 17 03:32:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-f8d4d4bd-1ab4-43fd-a1fe-a5c146c5be5b tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "21cd1abc-80ab-470b-9f69-19ccfa835f25" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.812s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:32:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:22 user nova-compute[74898]: DEBUG nova.compute.manager [req-5c69fe25-1ab8-4deb-8561-8f4ddd0d16ea req-0e43a413-9ed7-49f2-9c69-d65e6292ee6f service nova] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Received event network-vif-plugged-89bde492-00b9-4912-a5b7-54a57e2c6350 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:32:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5c69fe25-1ab8-4deb-8561-8f4ddd0d16ea req-0e43a413-9ed7-49f2-9c69-d65e6292ee6f service nova] Acquiring lock "21cd1abc-80ab-470b-9f69-19ccfa835f25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:32:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5c69fe25-1ab8-4deb-8561-8f4ddd0d16ea req-0e43a413-9ed7-49f2-9c69-d65e6292ee6f service nova] Lock "21cd1abc-80ab-470b-9f69-19ccfa835f25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:32:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5c69fe25-1ab8-4deb-8561-8f4ddd0d16ea req-0e43a413-9ed7-49f2-9c69-d65e6292ee6f service nova] Lock "21cd1abc-80ab-470b-9f69-19ccfa835f25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:32:22 user nova-compute[74898]: DEBUG nova.compute.manager [req-5c69fe25-1ab8-4deb-8561-8f4ddd0d16ea req-0e43a413-9ed7-49f2-9c69-d65e6292ee6f service nova] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] No waiting events found dispatching network-vif-plugged-89bde492-00b9-4912-a5b7-54a57e2c6350 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:32:22 user nova-compute[74898]: WARNING nova.compute.manager [req-5c69fe25-1ab8-4deb-8561-8f4ddd0d16ea req-0e43a413-9ed7-49f2-9c69-d65e6292ee6f service nova] [instance: 21cd1abc-80ab-470b-9f69-19ccfa835f25] Received unexpected event network-vif-plugged-89bde492-00b9-4912-a5b7-54a57e2c6350 for instance with vm_state deleted and task_state None.
Nov 17 03:32:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:40 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:32:40 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:32:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:32:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:32:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:32:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:32:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:41 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:32:41 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:32:42 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:32:44 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:32:45 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:32:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:32:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:32:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:32:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:32:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:47 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:32:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:32:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:32:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:32:47 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:32:47 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:32:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:32:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:32:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:32:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:32:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:32:48 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:32:48 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:32:48 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=8657MB free_disk=25.31031036376953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:32:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:32:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:32:48 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance f3c85dac-e42c-4b33-842f-3fb681cdc2ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:32:48 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 7958c15b-0903-458f-b718-94643d88661b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:32:48 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:32:48 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:32:48 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:32:48 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:32:48 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:32:48 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:32:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:32:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:32:50 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:32:50 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:32:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-f3c85dac-e42c-4b33-842f-3fb681cdc2ee" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:32:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-f3c85dac-e42c-4b33-842f-3fb681cdc2ee" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:32:51 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:32:51 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Updating instance_info_cache with network_info: [{"id": "4fe8a0b3-a4f4-488d-937b-cdd22978a04e", "address": "fa:16:3e:fc:f8:0f", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe8a0b3-a4", "ovs_interfaceid": "4fe8a0b3-a4f4-488d-937b-cdd22978a04e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:32:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-f3c85dac-e42c-4b33-842f-3fb681cdc2ee" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:32:51 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:32:52 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:32:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:32:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:32:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:32:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:32:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:32:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:33:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:33:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "4927b642-dca5-4599-b45b-efcace11002a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:33:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "4927b642-dca5-4599-b45b-efcace11002a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:33:13 user nova-compute[74898]: DEBUG nova.compute.manager [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:33:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:33:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:33:13 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:33:13 user nova-compute[74898]: INFO nova.compute.claims [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Claim successful on node user
Nov 17 03:33:14 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:33:14 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:33:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.271s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:33:14 user nova-compute[74898]: DEBUG nova.compute.manager [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:33:14 user nova-compute[74898]: DEBUG nova.compute.manager [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:33:14 user nova-compute[74898]: DEBUG nova.network.neutron [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:33:14 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:33:14 user nova-compute[74898]: DEBUG nova.compute.manager [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:33:14 user nova-compute[74898]: DEBUG nova.policy [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7660b84c605b4a459065b10fda42043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498d9d0f6667441791a7175256e4c557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:33:14 user nova-compute[74898]: DEBUG nova.compute.manager [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:33:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:33:14 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Creating image(s)
Nov 17 03:33:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "/opt/stack/data/nova/instances/4927b642-dca5-4599-b45b-efcace11002a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:33:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "/opt/stack/data/nova/instances/4927b642-dca5-4599-b45b-efcace11002a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:33:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "/opt/stack/data/nova/instances/4927b642-dca5-4599-b45b-efcace11002a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:33:14 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:14 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.170s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:33:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:33:14 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:14 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:14 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/4927b642-dca5-4599-b45b-efcace11002a/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:14 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/4927b642-dca5-4599-b45b-efcace11002a/disk 1073741824" returned: 0 in 0.045s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:33:14 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:14 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.178s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:14 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4927b642-dca5-4599-b45b-efcace11002a/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:33:14 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4927b642-dca5-4599-b45b-efcace11002a/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:14 user nova-compute[74898]: DEBUG nova.network.neutron [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Successfully created port: ef217a49-2a6e-44c2-b1d7-66ca523d28fb {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4927b642-dca5-4599-b45b-efcace11002a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Cannot resize image /opt/stack/data/nova/instances/4927b642-dca5-4599-b45b-efcace11002a/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Ensure instance console log exists: /opt/stack/data/nova/instances/4927b642-dca5-4599-b45b-efcace11002a/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.network.neutron [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Successfully updated port: ef217a49-2a6e-44c2-b1d7-66ca523d28fb {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "refresh_cache-4927b642-dca5-4599-b45b-efcace11002a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquired lock "refresh_cache-4927b642-dca5-4599-b45b-efcace11002a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.network.neutron [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.compute.manager [req-9d81a87e-0857-4aa1-977b-60269bded908 req-4ce5cfc8-a9b9-4d07-9bad-27fac218eeaf service nova] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Received event network-changed-ef217a49-2a6e-44c2-b1d7-66ca523d28fb {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.compute.manager [req-9d81a87e-0857-4aa1-977b-60269bded908 req-4ce5cfc8-a9b9-4d07-9bad-27fac218eeaf service nova] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Refreshing instance network info cache due to event network-changed-ef217a49-2a6e-44c2-b1d7-66ca523d28fb. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9d81a87e-0857-4aa1-977b-60269bded908 req-4ce5cfc8-a9b9-4d07-9bad-27fac218eeaf service nova] Acquiring lock "refresh_cache-4927b642-dca5-4599-b45b-efcace11002a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.network.neutron [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.network.neutron [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Updating instance_info_cache with network_info: [{"id": "ef217a49-2a6e-44c2-b1d7-66ca523d28fb", "address": "fa:16:3e:0d:54:94", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef217a49-2a", "ovs_interfaceid": "ef217a49-2a6e-44c2-b1d7-66ca523d28fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Releasing lock "refresh_cache-4927b642-dca5-4599-b45b-efcace11002a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.compute.manager [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Instance network_info: |[{"id": "ef217a49-2a6e-44c2-b1d7-66ca523d28fb", "address": "fa:16:3e:0d:54:94", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef217a49-2a", "ovs_interfaceid": "ef217a49-2a6e-44c2-b1d7-66ca523d28fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9d81a87e-0857-4aa1-977b-60269bded908 req-4ce5cfc8-a9b9-4d07-9bad-27fac218eeaf service nova] Acquired lock "refresh_cache-4927b642-dca5-4599-b45b-efcace11002a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.network.neutron [req-9d81a87e-0857-4aa1-977b-60269bded908 req-4ce5cfc8-a9b9-4d07-9bad-27fac218eeaf service nova] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Refreshing network info cache for port ef217a49-2a6e-44c2-b1d7-66ca523d28fb {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Start _get_guest_xml network_info=[{"id": "ef217a49-2a6e-44c2-b1d7-66ca523d28fb", "address": "fa:16:3e:0d:54:94", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef217a49-2a", "ovs_interfaceid": "ef217a49-2a6e-44c2-b1d7-66ca523d28fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:33:15 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:33:15 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-694291473',display_name='tempest-AttachVolumeNegativeTest-server-694291473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-694291473',id=46,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGTMIN/5pF6ON811rFap+QNR24qAZ7ojvpj7A4JsUitd8savizEOR/++pNvUA9Tm+2JOOmD36LDAcKaQdiDg7cVbO2aA72G8TX+fZW0teZLa+cib0YoVQ1Gisi3aUCM3w==',key_name='tempest-keypair-2129379624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='498d9d0f6667441791a7175256e4c557',ramdisk_id='',reservation_id='r-0q24v008',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1401299497',owner_user_name='tempest-AttachVolumeNegativeTest-1401299497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:33:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7660b84c605b4a459065b10fda42043f',uuid=4927b642-dca5-4599-b45b-efcace11002a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef217a49-2a6e-44c2-b1d7-66ca523d28fb", "address": "fa:16:3e:0d:54:94", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef217a49-2a", "ovs_interfaceid": "ef217a49-2a6e-44c2-b1d7-66ca523d28fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Converting VIF {"id": "ef217a49-2a6e-44c2-b1d7-66ca523d28fb", "address": "fa:16:3e:0d:54:94", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef217a49-2a", "ovs_interfaceid": "ef217a49-2a6e-44c2-b1d7-66ca523d28fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:54:94,bridge_name='br-int',has_traffic_filtering=True,id=ef217a49-2a6e-44c2-b1d7-66ca523d28fb,network=Network(d02a6f85-70ee-4ed7-ae00-decabd94d542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef217a49-2a') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.objects.instance [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lazy-loading 'pci_devices' on Instance uuid 4927b642-dca5-4599-b45b-efcace11002a {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:33:15 user nova-compute[74898]:   <uuid>4927b642-dca5-4599-b45b-efcace11002a</uuid>
Nov 17 03:33:15 user nova-compute[74898]:   <name>instance-0000002e</name>
Nov 17 03:33:15 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:33:15 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:33:15 user nova-compute[74898]:   <metadata>
Nov 17 03:33:15 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:33:15 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:33:15 user nova-compute[74898]:       <nova:name>tempest-AttachVolumeNegativeTest-server-694291473</nova:name>
Nov 17 03:33:15 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:33:15</nova:creationTime>
Nov 17 03:33:15 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:33:15 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:33:15 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:33:15 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:33:15 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:33:15 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:33:15 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:33:15 user nova-compute[74898]:       <nova:owner>
Nov 17 03:33:15 user nova-compute[74898]:         <nova:user uuid="7660b84c605b4a459065b10fda42043f">tempest-AttachVolumeNegativeTest-1401299497-project-member</nova:user>
Nov 17 03:33:15 user nova-compute[74898]:         <nova:project uuid="498d9d0f6667441791a7175256e4c557">tempest-AttachVolumeNegativeTest-1401299497</nova:project>
Nov 17 03:33:15 user nova-compute[74898]:       </nova:owner>
Nov 17 03:33:15 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:33:15 user nova-compute[74898]:       <nova:ports>
Nov 17 03:33:15 user nova-compute[74898]:         <nova:port uuid="ef217a49-2a6e-44c2-b1d7-66ca523d28fb">
Nov 17 03:33:15 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 17 03:33:15 user nova-compute[74898]:         </nova:port>
Nov 17 03:33:15 user nova-compute[74898]:       </nova:ports>
Nov 17 03:33:15 user nova-compute[74898]:     </nova:instance>
Nov 17 03:33:15 user nova-compute[74898]:   </metadata>
Nov 17 03:33:15 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:33:15 user nova-compute[74898]:     <system>
Nov 17 03:33:15 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:33:15 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:33:15 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:33:15 user nova-compute[74898]:       <entry name="serial">4927b642-dca5-4599-b45b-efcace11002a</entry>
Nov 17 03:33:15 user nova-compute[74898]:       <entry name="uuid">4927b642-dca5-4599-b45b-efcace11002a</entry>
Nov 17 03:33:15 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:33:15 user nova-compute[74898]:     </system>
Nov 17 03:33:15 user nova-compute[74898]:   </sysinfo>
Nov 17 03:33:15 user nova-compute[74898]:   <os>
Nov 17 03:33:15 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:33:15 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:33:15 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:33:15 user nova-compute[74898]:   </os>
Nov 17 03:33:15 user nova-compute[74898]:   <features>
Nov 17 03:33:15 user nova-compute[74898]:     <acpi/>
Nov 17 03:33:15 user nova-compute[74898]:     <apic/>
Nov 17 03:33:15 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:33:15 user nova-compute[74898]:   </features>
Nov 17 03:33:15 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:33:15 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:33:15 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:33:15 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:33:15 user nova-compute[74898]:   </clock>
Nov 17 03:33:15 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:33:15 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:33:15 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:33:15 user nova-compute[74898]:   </cpu>
Nov 17 03:33:15 user nova-compute[74898]:   <devices>
Nov 17 03:33:15 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:33:15 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:33:15 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/4927b642-dca5-4599-b45b-efcace11002a/disk"/>
Nov 17 03:33:15 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:33:15 user nova-compute[74898]:     </disk>
Nov 17 03:33:15 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:33:15 user nova-compute[74898]:       <mac address="fa:16:3e:0d:54:94"/>
Nov 17 03:33:15 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:33:15 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:33:15 user nova-compute[74898]:       <target dev="tapef217a49-2a"/>
Nov 17 03:33:15 user nova-compute[74898]:     </interface>
Nov 17 03:33:15 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:33:15 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/4927b642-dca5-4599-b45b-efcace11002a/console.log" append="off"/>
Nov 17 03:33:15 user nova-compute[74898]:     </serial>
Nov 17 03:33:15 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:33:15 user nova-compute[74898]:     <video>
Nov 17 03:33:15 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:33:15 user nova-compute[74898]:     </video>
Nov 17 03:33:15 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:33:15 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:33:15 user nova-compute[74898]:     </rng>
Nov 17 03:33:15 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:33:15 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:33:15 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:33:15 user nova-compute[74898]:     </memballoon>
Nov 17 03:33:15 user nova-compute[74898]:   </devices>
Nov 17 03:33:15 user nova-compute[74898]: </domain>
Nov 17 03:33:15 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-694291473',display_name='tempest-AttachVolumeNegativeTest-server-694291473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-694291473',id=46,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGTMIN/5pF6ON811rFap+QNR24qAZ7ojvpj7A4JsUitd8savizEOR/++pNvUA9Tm+2JOOmD36LDAcKaQdiDg7cVbO2aA72G8TX+fZW0teZLa+cib0YoVQ1Gisi3aUCM3w==',key_name='tempest-keypair-2129379624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='498d9d0f6667441791a7175256e4c557',ramdisk_id='',reservation_id='r-0q24v008',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1401299497',owner_user_name='tempest-AttachVolumeNegativeTest-1401299497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:33:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7660b84c605b4a459065b10fda42043f',uuid=4927b642-dca5-4599-b45b-efcace11002a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef217a49-2a6e-44c2-b1d7-66ca523d28fb", "address": "fa:16:3e:0d:54:94", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef217a49-2a", "ovs_interfaceid": "ef217a49-2a6e-44c2-b1d7-66ca523d28fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Converting VIF {"id": "ef217a49-2a6e-44c2-b1d7-66ca523d28fb", "address": "fa:16:3e:0d:54:94", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef217a49-2a", "ovs_interfaceid": "ef217a49-2a6e-44c2-b1d7-66ca523d28fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:54:94,bridge_name='br-int',has_traffic_filtering=True,id=ef217a49-2a6e-44c2-b1d7-66ca523d28fb,network=Network(d02a6f85-70ee-4ed7-ae00-decabd94d542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef217a49-2a') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG os_vif [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:54:94,bridge_name='br-int',has_traffic_filtering=True,id=ef217a49-2a6e-44c2-b1d7-66ca523d28fb,network=Network(d02a6f85-70ee-4ed7-ae00-decabd94d542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef217a49-2a') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0175cab5-5462-5d6b-94a4-7d7de379c888', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef217a49-2a, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef217a49-2a, col_values=(('qos', UUID('3b033fb8-574b-4d94-bb8e-18354692322a')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef217a49-2a, col_values=(('external_ids', {'iface-id': 'ef217a49-2a6e-44c2-b1d7-66ca523d28fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:54:94', 'vm-uuid': '4927b642-dca5-4599-b45b-efcace11002a'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:33:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:15 user nova-compute[74898]: INFO os_vif [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:54:94,bridge_name='br-int',has_traffic_filtering=True,id=ef217a49-2a6e-44c2-b1d7-66ca523d28fb,network=Network(d02a6f85-70ee-4ed7-ae00-decabd94d542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef217a49-2a')
Nov 17 03:33:16 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:33:16 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] No VIF found with MAC fa:16:3e:0d:54:94, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:33:16 user nova-compute[74898]: DEBUG nova.network.neutron [req-9d81a87e-0857-4aa1-977b-60269bded908 req-4ce5cfc8-a9b9-4d07-9bad-27fac218eeaf service nova] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Updated VIF entry in instance network info cache for port ef217a49-2a6e-44c2-b1d7-66ca523d28fb. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:33:16 user nova-compute[74898]: DEBUG nova.network.neutron [req-9d81a87e-0857-4aa1-977b-60269bded908 req-4ce5cfc8-a9b9-4d07-9bad-27fac218eeaf service nova] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Updating instance_info_cache with network_info: [{"id": "ef217a49-2a6e-44c2-b1d7-66ca523d28fb", "address": "fa:16:3e:0d:54:94", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef217a49-2a", "ovs_interfaceid": "ef217a49-2a6e-44c2-b1d7-66ca523d28fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:33:16 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-9d81a87e-0857-4aa1-977b-60269bded908 req-4ce5cfc8-a9b9-4d07-9bad-27fac218eeaf service nova] Releasing lock "refresh_cache-4927b642-dca5-4599-b45b-efcace11002a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:33:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:17 user nova-compute[74898]: DEBUG nova.compute.manager [req-5913fd71-cfb7-472b-ab7b-09e4ce900f2f req-fe1d76b1-57f6-490f-902e-e7a5e60d253f service nova] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Received event network-vif-plugged-ef217a49-2a6e-44c2-b1d7-66ca523d28fb {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:33:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5913fd71-cfb7-472b-ab7b-09e4ce900f2f req-fe1d76b1-57f6-490f-902e-e7a5e60d253f service nova] Acquiring lock "4927b642-dca5-4599-b45b-efcace11002a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:33:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5913fd71-cfb7-472b-ab7b-09e4ce900f2f req-fe1d76b1-57f6-490f-902e-e7a5e60d253f service nova] Lock "4927b642-dca5-4599-b45b-efcace11002a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:33:17 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5913fd71-cfb7-472b-ab7b-09e4ce900f2f req-fe1d76b1-57f6-490f-902e-e7a5e60d253f service nova] Lock "4927b642-dca5-4599-b45b-efcace11002a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:33:17 user nova-compute[74898]: DEBUG nova.compute.manager [req-5913fd71-cfb7-472b-ab7b-09e4ce900f2f req-fe1d76b1-57f6-490f-902e-e7a5e60d253f service nova] [instance: 4927b642-dca5-4599-b45b-efcace11002a] No waiting events found dispatching network-vif-plugged-ef217a49-2a6e-44c2-b1d7-66ca523d28fb {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:33:17 user nova-compute[74898]: WARNING nova.compute.manager [req-5913fd71-cfb7-472b-ab7b-09e4ce900f2f req-fe1d76b1-57f6-490f-902e-e7a5e60d253f service nova] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Received unexpected event network-vif-plugged-ef217a49-2a6e-44c2-b1d7-66ca523d28fb for instance with vm_state building and task_state spawning.
Nov 17 03:33:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:19 user nova-compute[74898]: DEBUG nova.compute.manager [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:33:19 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:33:19 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Instance spawned successfully.
Nov 17 03:33:19 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:33:19 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:33:19 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:33:19 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:33:19 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:33:19 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:33:19 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:33:19 user nova-compute[74898]: INFO nova.compute.manager [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Took 5.07 seconds to spawn the instance on the hypervisor.
Nov 17 03:33:19 user nova-compute[74898]: DEBUG nova.compute.manager [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:33:19 user nova-compute[74898]: INFO nova.compute.manager [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Took 5.68 seconds to build instance.
Nov 17 03:33:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ed166c67-4086-4f4d-9ab4-9a8c6e491642 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "4927b642-dca5-4599-b45b-efcace11002a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.785s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:33:19 user nova-compute[74898]: DEBUG nova.compute.manager [req-f0d363d9-6e71-407d-afe1-f3251eb0ca34 req-e3a9763d-4c56-497b-9edb-c57b0ac3496e service nova] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Received event network-vif-plugged-ef217a49-2a6e-44c2-b1d7-66ca523d28fb {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:33:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f0d363d9-6e71-407d-afe1-f3251eb0ca34 req-e3a9763d-4c56-497b-9edb-c57b0ac3496e service nova] Acquiring lock "4927b642-dca5-4599-b45b-efcace11002a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:33:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f0d363d9-6e71-407d-afe1-f3251eb0ca34 req-e3a9763d-4c56-497b-9edb-c57b0ac3496e service nova] Lock "4927b642-dca5-4599-b45b-efcace11002a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:33:19 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f0d363d9-6e71-407d-afe1-f3251eb0ca34 req-e3a9763d-4c56-497b-9edb-c57b0ac3496e service nova] Lock "4927b642-dca5-4599-b45b-efcace11002a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:33:19 user nova-compute[74898]: DEBUG nova.compute.manager [req-f0d363d9-6e71-407d-afe1-f3251eb0ca34 req-e3a9763d-4c56-497b-9edb-c57b0ac3496e service nova] [instance: 4927b642-dca5-4599-b45b-efcace11002a] No waiting events found dispatching network-vif-plugged-ef217a49-2a6e-44c2-b1d7-66ca523d28fb {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:33:19 user nova-compute[74898]: WARNING nova.compute.manager [req-f0d363d9-6e71-407d-afe1-f3251eb0ca34 req-e3a9763d-4c56-497b-9edb-c57b0ac3496e service nova] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Received unexpected event network-vif-plugged-ef217a49-2a6e-44c2-b1d7-66ca523d28fb for instance with vm_state active and task_state None.
Nov 17 03:33:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:40 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:33:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:41 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:33:41 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:33:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:42 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:33:43 user nova-compute[74898]: DEBUG nova.compute.manager [req-2328dcae-5d2d-4012-9276-d43cb0473dce req-5c30b670-5238-4bbf-959b-d42b1e6a0dbe service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] Received event network-changed-5b744e4b-04ce-4fde-a250-95246dbcf97b {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:33:43 user nova-compute[74898]: DEBUG nova.compute.manager [req-2328dcae-5d2d-4012-9276-d43cb0473dce req-5c30b670-5238-4bbf-959b-d42b1e6a0dbe service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] Refreshing instance network info cache due to event network-changed-5b744e4b-04ce-4fde-a250-95246dbcf97b. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:33:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-2328dcae-5d2d-4012-9276-d43cb0473dce req-5c30b670-5238-4bbf-959b-d42b1e6a0dbe service nova] Acquiring lock "refresh_cache-7958c15b-0903-458f-b718-94643d88661b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:33:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-2328dcae-5d2d-4012-9276-d43cb0473dce req-5c30b670-5238-4bbf-959b-d42b1e6a0dbe service nova] Acquired lock "refresh_cache-7958c15b-0903-458f-b718-94643d88661b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:33:43 user nova-compute[74898]: DEBUG nova.network.neutron [req-2328dcae-5d2d-4012-9276-d43cb0473dce req-5c30b670-5238-4bbf-959b-d42b1e6a0dbe service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] Refreshing network info cache for port 5b744e4b-04ce-4fde-a250-95246dbcf97b {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:33:43 user nova-compute[74898]: DEBUG nova.network.neutron [req-2328dcae-5d2d-4012-9276-d43cb0473dce req-5c30b670-5238-4bbf-959b-d42b1e6a0dbe service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] Updated VIF entry in instance network info cache for port 5b744e4b-04ce-4fde-a250-95246dbcf97b. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:33:43 user nova-compute[74898]: DEBUG nova.network.neutron [req-2328dcae-5d2d-4012-9276-d43cb0473dce req-5c30b670-5238-4bbf-959b-d42b1e6a0dbe service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] Updating instance_info_cache with network_info: [{"id": "5b744e4b-04ce-4fde-a250-95246dbcf97b", "address": "fa:16:3e:e6:87:0a", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b744e4b-04", "ovs_interfaceid": "5b744e4b-04ce-4fde-a250-95246dbcf97b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:33:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-2328dcae-5d2d-4012-9276-d43cb0473dce req-5c30b670-5238-4bbf-959b-d42b1e6a0dbe service nova] Releasing lock "refresh_cache-7958c15b-0903-458f-b718-94643d88661b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:33:44 user nova-compute[74898]: DEBUG nova.compute.manager [req-5c52948f-9a15-43ad-9626-1c3e5315c2e5 req-be9f3254-5539-4636-ad31-b7b552acfc68 service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] Received event network-changed-5b744e4b-04ce-4fde-a250-95246dbcf97b {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:33:44 user nova-compute[74898]: DEBUG nova.compute.manager [req-5c52948f-9a15-43ad-9626-1c3e5315c2e5 req-be9f3254-5539-4636-ad31-b7b552acfc68 service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] Refreshing instance network info cache due to event network-changed-5b744e4b-04ce-4fde-a250-95246dbcf97b. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:33:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5c52948f-9a15-43ad-9626-1c3e5315c2e5 req-be9f3254-5539-4636-ad31-b7b552acfc68 service nova] Acquiring lock "refresh_cache-7958c15b-0903-458f-b718-94643d88661b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:33:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5c52948f-9a15-43ad-9626-1c3e5315c2e5 req-be9f3254-5539-4636-ad31-b7b552acfc68 service nova] Acquired lock "refresh_cache-7958c15b-0903-458f-b718-94643d88661b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:33:44 user nova-compute[74898]: DEBUG nova.network.neutron [req-5c52948f-9a15-43ad-9626-1c3e5315c2e5 req-be9f3254-5539-4636-ad31-b7b552acfc68 service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] Refreshing network info cache for port 5b744e4b-04ce-4fde-a250-95246dbcf97b {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:33:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "7958c15b-0903-458f-b718-94643d88661b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:33:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "7958c15b-0903-458f-b718-94643d88661b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:33:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "7958c15b-0903-458f-b718-94643d88661b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:33:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "7958c15b-0903-458f-b718-94643d88661b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:33:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "7958c15b-0903-458f-b718-94643d88661b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:33:44 user nova-compute[74898]: INFO nova.compute.manager [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Terminating instance
Nov 17 03:33:44 user nova-compute[74898]: DEBUG nova.compute.manager [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:33:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:44 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:33:44 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:33:44 user nova-compute[74898]: DEBUG nova.network.neutron [req-5c52948f-9a15-43ad-9626-1c3e5315c2e5 req-be9f3254-5539-4636-ad31-b7b552acfc68 service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] Updated VIF entry in instance network info cache for port 5b744e4b-04ce-4fde-a250-95246dbcf97b. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:33:44 user nova-compute[74898]: DEBUG nova.network.neutron [req-5c52948f-9a15-43ad-9626-1c3e5315c2e5 req-be9f3254-5539-4636-ad31-b7b552acfc68 service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] Updating instance_info_cache with network_info: [{"id": "5b744e4b-04ce-4fde-a250-95246dbcf97b", "address": "fa:16:3e:e6:87:0a", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b744e4b-04", "ovs_interfaceid": "5b744e4b-04ce-4fde-a250-95246dbcf97b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:33:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5c52948f-9a15-43ad-9626-1c3e5315c2e5 req-be9f3254-5539-4636-ad31-b7b552acfc68 service nova] Releasing lock "refresh_cache-7958c15b-0903-458f-b718-94643d88661b" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG nova.compute.manager [req-161e08f8-c246-42c9-9165-5d016fa11ff6 req-86467d22-7f42-4d61-8b18-84961db772f5 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Received event network-changed-182a94b3-1f52-47cf-95b7-900b82afd9ab {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG nova.compute.manager [req-161e08f8-c246-42c9-9165-5d016fa11ff6 req-86467d22-7f42-4d61-8b18-84961db772f5 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Refreshing instance network info cache due to event network-changed-182a94b3-1f52-47cf-95b7-900b82afd9ab. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-161e08f8-c246-42c9-9165-5d016fa11ff6 req-86467d22-7f42-4d61-8b18-84961db772f5 service nova] Acquiring lock "refresh_cache-6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-161e08f8-c246-42c9-9165-5d016fa11ff6 req-86467d22-7f42-4d61-8b18-84961db772f5 service nova] Acquired lock "refresh_cache-6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG nova.network.neutron [req-161e08f8-c246-42c9-9165-5d016fa11ff6 req-86467d22-7f42-4d61-8b18-84961db772f5 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Refreshing network info cache for port 182a94b3-1f52-47cf-95b7-900b82afd9ab {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:33:45 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 7958c15b-0903-458f-b718-94643d88661b] Instance destroyed successfully.
Nov 17 03:33:45 user nova-compute[74898]: DEBUG nova.objects.instance [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lazy-loading 'resources' on Instance uuid 7958c15b-0903-458f-b718-94643d88661b {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:31:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-498741363',display_name='tempest-TestVolumeBootPattern-server-498741363',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-498741363',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJInWWavbu/6d6OQJPNghOKND7RIoCzZc2qCUfAkCC2TokwiJfdMvyOxWX8lLSW7Fx1YLwTdFBaDgYlG8DKkEJfoMkAf+B/utXvLWusVeA4Z9dMFCfioGuJoTmK0Ain2zQ==',key_name='tempest-TestVolumeBootPattern-1387915334',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:32:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d36087cc8e842c0bfcae89553fb9841',ramdisk_id='',reservation_id='r-i6vhpapa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1382126375',owner_user_name='tempest-TestVolumeBootPattern-1382126375-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:32:02Z,user_data=None,user_id='aa779a5f98394629b6b9fa9d04233e7a',uuid=7958c15b-0903-458f-b718-94643d88661b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b744e4b-04ce-4fde-a250-95246dbcf97b", "address": "fa:16:3e:e6:87:0a", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b744e4b-04", "ovs_interfaceid": "5b744e4b-04ce-4fde-a250-95246dbcf97b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converting VIF {"id": "5b744e4b-04ce-4fde-a250-95246dbcf97b", "address": "fa:16:3e:e6:87:0a", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b744e4b-04", "ovs_interfaceid": "5b744e4b-04ce-4fde-a250-95246dbcf97b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:87:0a,bridge_name='br-int',has_traffic_filtering=True,id=5b744e4b-04ce-4fde-a250-95246dbcf97b,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b744e4b-04') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG os_vif [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:87:0a,bridge_name='br-int',has_traffic_filtering=True,id=5b744e4b-04ce-4fde-a250-95246dbcf97b,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b744e4b-04') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b744e4b-04, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e86b989-02cd-494b-ae59-55ec22f55b10) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:33:45 user nova-compute[74898]: INFO os_vif [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:87:0a,bridge_name='br-int',has_traffic_filtering=True,id=5b744e4b-04ce-4fde-a250-95246dbcf97b,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b744e4b-04')
Nov 17 03:33:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vgYtCQkV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:33:45 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:33:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89f08df-9d5c-4da0-975c-002eab13a3a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:33:45 user nova-compute[74898]: No targets found.
Nov 17 03:33:45 user nova-compute[74898]: iSNS:
Nov 17 03:33:45 user nova-compute[74898]: No targets found.
Nov 17 03:33:45 user nova-compute[74898]: STATIC:
Nov 17 03:33:45 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079
Nov 17 03:33:45 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:33:45 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:33:45 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f
Nov 17 03:33:45 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:33:45 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:33:45 user nova-compute[74898]: FIRMWARE:
Nov 17 03:33:45 user nova-compute[74898]: No targets found.
Nov 17 03:33:45 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:33:45 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:33:45 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7aba0d-c1e3-49bc-bd07-744cdf6b99be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b90c9a-5bec-4483-b065-5e45e2d02f63]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:33:45 user nova-compute[74898]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079 (non-flash)
Nov 17 03:33:45 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:33:45 user nova-compute[74898]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079 (non-flash)
Nov 17 03:33:45 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9c1865b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079'): ({'sdc'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Removing single pathed devices sdc {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG nova.objects.instance [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lazy-loading 'flavor' on Instance uuid 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42c8f1f-9dec-41c3-9878-4c1ce1f74ce6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:45 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Ignoring supplied device name: /dev/vdb
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[09aa94e2-4a7f-48fd-b90d-dda62f0acf0a]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Flushing IO for device /dev/sdc {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebcfaf8-5267-4c50-9dd3-41057817bf1b]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0734d2ea-674b-4c78-afac-045c9f3653f0]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] SCSI volumes sdc have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26566336437326261', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_121eb76a', '/dev/disk/by-id/scsi-1SCST_BIO121eb76a-ef3d72ba720e32c9') {{(pid=86021) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c166f86b-d417-46f7-9ae2-fb333f99f2b2]: (4, None) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[93eb0b2f-c008-47e0-b692-e560cd3f638a]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG nova.network.neutron [req-161e08f8-c246-42c9-9165-5d016fa11ff6 req-86467d22-7f42-4d61-8b18-84961db772f5 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Updated VIF entry in instance network info cache for port 182a94b3-1f52-47cf-95b7-900b82afd9ab. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG nova.network.neutron [req-161e08f8-c246-42c9-9165-5d016fa11ff6 req-86467d22-7f42-4d61-8b18-84961db772f5 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Updating instance_info_cache with network_info: [{"id": "182a94b3-1f52-47cf-95b7-900b82afd9ab", "address": "fa:16:3e:d3:3c:3c", "network": {"id": "7ab9395e-a6a0-4b93-990e-d7d064bba5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-894693551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4596366f424fa7937aaf97828a7c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182a94b3-1f", "ovs_interfaceid": "182a94b3-1f52-47cf-95b7-900b82afd9ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-161e08f8-c246-42c9-9165-5d016fa11ff6 req-86467d22-7f42-4d61-8b18-84961db772f5 service nova] Releasing lock "refresh_cache-6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cca22b8-f780-4f2b-8b7a-ad9a2861c8cc]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079, portal: 172.16.0.220,3260]
Nov 17 03:33:45 user nova-compute[74898]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079, portal: 172.16.0.220,3260] successful.
Nov 17 03:33:45 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49e073a-536a-42eb-abce-5683ba197079 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8760aa67-6f8a-454d-ad32-e086d6b475d3]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] <== disconnect_volume: return (332ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:33:45 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Deleting instance files /opt/stack/data/nova/instances/7958c15b-0903-458f-b718-94643d88661b_del
Nov 17 03:33:45 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Deletion of /opt/stack/data/nova/instances/7958c15b-0903-458f-b718-94643d88661b_del complete
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:33:45 user nova-compute[74898]: INFO nova.compute.manager [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Attaching volume ca56e061-e6c0-45c4-8de4-260235e45ca3 to /dev/vdb
Nov 17 03:33:45 user nova-compute[74898]: INFO nova.compute.manager [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: 7958c15b-0903-458f-b718-94643d88661b] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 7958c15b-0903-458f-b718-94643d88661b] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG os_brick.utils [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cec8a51-681a-42e4-869b-5007ba7a373a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[26027a72-152b-4b8e-9db7-af8da7cc1b14]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6eefc2-2b83-4ba8-8ab4-f96b5dd834a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3208ae7d-d798-4e8f-a952-03ba5b84bce4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:33:45 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:33:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dc4dde-f3e9-4d24-b715-d442a2afb913]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG os_brick.utils [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:33:45 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Updating existing volume attachment record: da470004-be4b-4cdb-afe7-f32dd74f7404 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:33:46 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 7958c15b-0903-458f-b718-94643d88661b] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:33:46 user nova-compute[74898]: DEBUG nova.compute.manager [req-4e6ac16b-824e-45cf-afba-0f080cc1e17f req-1b8b3419-8148-4c94-8a20-eae0bf7a9232 service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] Received event network-vif-deleted-5b744e4b-04ce-4fde-a250-95246dbcf97b {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:33:46 user nova-compute[74898]: INFO nova.compute.manager [req-4e6ac16b-824e-45cf-afba-0f080cc1e17f req-1b8b3419-8148-4c94-8a20-eae0bf7a9232 service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] Neutron deleted interface 5b744e4b-04ce-4fde-a250-95246dbcf97b; detaching it from the instance and deleting it from the info cache
Nov 17 03:33:46 user nova-compute[74898]: DEBUG nova.network.neutron [req-4e6ac16b-824e-45cf-afba-0f080cc1e17f req-1b8b3419-8148-4c94-8a20-eae0bf7a9232 service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:33:46 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: 7958c15b-0903-458f-b718-94643d88661b] Took 0.41 seconds to deallocate network for instance.
Nov 17 03:33:46 user nova-compute[74898]: DEBUG nova.compute.manager [req-4e6ac16b-824e-45cf-afba-0f080cc1e17f req-1b8b3419-8148-4c94-8a20-eae0bf7a9232 service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] Detach interface failed, port_id=5b744e4b-04ce-4fde-a250-95246dbcf97b, reason: Instance 7958c15b-0903-458f-b718-94643d88661b could not be found. {{(pid=74898) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 03:33:46 user nova-compute[74898]: DEBUG nova.compute.manager [req-f1057619-9524-432e-8678-316119945d33 req-83594ee2-12ef-441a-b013-a48e323c718a service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] Received event network-vif-unplugged-5b744e4b-04ce-4fde-a250-95246dbcf97b {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:33:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f1057619-9524-432e-8678-316119945d33 req-83594ee2-12ef-441a-b013-a48e323c718a service nova] Acquiring lock "7958c15b-0903-458f-b718-94643d88661b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:33:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f1057619-9524-432e-8678-316119945d33 req-83594ee2-12ef-441a-b013-a48e323c718a service nova] Lock "7958c15b-0903-458f-b718-94643d88661b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:33:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f1057619-9524-432e-8678-316119945d33 req-83594ee2-12ef-441a-b013-a48e323c718a service nova] Lock "7958c15b-0903-458f-b718-94643d88661b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:33:46 user nova-compute[74898]: DEBUG nova.compute.manager [req-f1057619-9524-432e-8678-316119945d33 req-83594ee2-12ef-441a-b013-a48e323c718a service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] No waiting events found dispatching network-vif-unplugged-5b744e4b-04ce-4fde-a250-95246dbcf97b {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:33:46 user nova-compute[74898]: DEBUG nova.compute.manager [req-f1057619-9524-432e-8678-316119945d33 req-83594ee2-12ef-441a-b013-a48e323c718a service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] Received event network-vif-unplugged-5b744e4b-04ce-4fde-a250-95246dbcf97b for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:33:46 user nova-compute[74898]: DEBUG nova.compute.manager [req-f1057619-9524-432e-8678-316119945d33 req-83594ee2-12ef-441a-b013-a48e323c718a service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] Received event network-vif-plugged-5b744e4b-04ce-4fde-a250-95246dbcf97b {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:33:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f1057619-9524-432e-8678-316119945d33 req-83594ee2-12ef-441a-b013-a48e323c718a service nova] Acquiring lock "7958c15b-0903-458f-b718-94643d88661b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:33:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f1057619-9524-432e-8678-316119945d33 req-83594ee2-12ef-441a-b013-a48e323c718a service nova] Lock "7958c15b-0903-458f-b718-94643d88661b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:33:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f1057619-9524-432e-8678-316119945d33 req-83594ee2-12ef-441a-b013-a48e323c718a service nova] Lock "7958c15b-0903-458f-b718-94643d88661b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:33:46 user nova-compute[74898]: DEBUG nova.compute.manager [req-f1057619-9524-432e-8678-316119945d33 req-83594ee2-12ef-441a-b013-a48e323c718a service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] No waiting events found dispatching network-vif-plugged-5b744e4b-04ce-4fde-a250-95246dbcf97b {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:33:46 user nova-compute[74898]: WARNING nova.compute.manager [req-f1057619-9524-432e-8678-316119945d33 req-83594ee2-12ef-441a-b013-a48e323c718a service nova] [instance: 7958c15b-0903-458f-b718-94643d88661b] Received unexpected event network-vif-plugged-5b744e4b-04ce-4fde-a250-95246dbcf97b for instance with vm_state active and task_state deleting.
Nov 17 03:33:46 user nova-compute[74898]: INFO nova.compute.manager [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: 7958c15b-0903-458f-b718-94643d88661b] Took 0.72 seconds to detach 1 volumes for instance.
Nov 17 03:33:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:33:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:33:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:47 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:33:47 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:33:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:33:47 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Deleted allocations for instance 7958c15b-0903-458f-b718-94643d88661b
Nov 17 03:33:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-561b9bd8-9fbb-43fd-8282-05e400938901 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "7958c15b-0903-458f-b718-94643d88661b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.803s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:33:47 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:33:48 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:33:48 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:33:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:33:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:33:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:33:48 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:33:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4927b642-dca5-4599-b45b-efcace11002a/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4927b642-dca5-4599-b45b-efcace11002a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4927b642-dca5-4599-b45b-efcace11002a/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4927b642-dca5-4599-b45b-efcace11002a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74898) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 03:33:50 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:33:50 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:33:50 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=8617MB free_disk=25.280162811279297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:33:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:33:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:33:50 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance f3c85dac-e42c-4b33-842f-3fb681cdc2ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:33:50 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:33:50 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 4927b642-dca5-4599-b45b-efcace11002a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:33:50 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:33:50 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:33:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:50 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:33:50 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:33:50 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:33:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hlpbotQM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:33:51 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:33:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:33:51 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:33:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:33:51 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[745b8855-6fff-4f40-bb27-26b93d6c52f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:33:51 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69dd0f6-4554-4316-843e-56293c6db12d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3] added
Nov 17 03:33:51 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ec4566-b80c-4659-9512-ef273f6251ea]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14a0318-9c9b-4559-8050-3b667cbc9bd8]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hlpbotQM {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hlpbotQM" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64d24fe-a96d-479c-8bcd-2c75adee46bd]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hlpbotQM'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e0f8d1-0bbf-40a4-a259-34b1a5234778]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[af08d73e-12bd-441c-9bfd-5386f3cdffe4]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:33:51 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:33:51 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb671b1-9da0-481a-b653-3e9d38b48de2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3, portal: 172.16.0.220,3260]
Nov 17 03:33:51 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3, portal: 172.16.0.220,3260] successful.
Nov 17 03:33:51 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed650ba-297b-40e4-b4b2-64d599e94ffc]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[711eb706-6b3f-4381-8da3-98eae26d44bb]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:33:51 user nova-compute[74898]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3 (non-flash)
Nov 17 03:33:51 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:33:51 user nova-compute[74898]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3 (non-flash)
Nov 17 03:33:51 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8516aa16-ece5-4e11-9572-e01d40e875b4]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: None {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:33:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:33:52 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:33:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hlpbotQM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:33:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:33:52 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23566323564343831', 'path': '/dev/sdc'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:33:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566323564343831', 'path': '/dev/sdc'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:33:52 user nova-compute[74898]: DEBUG nova.objects.instance [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lazy-loading 'flavor' on Instance uuid 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:33:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 03:33:52 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:33:52 user nova-compute[74898]:   <source dev="/dev/sdc"/>
Nov 17 03:33:52 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:33:52 user nova-compute[74898]:   <serial>ca56e061-e6c0-45c4-8de4-260235e45ca3</serial>
Nov 17 03:33:52 user nova-compute[74898]: </disk>
Nov 17 03:33:52 user nova-compute[74898]:  {{(pid=74898) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 03:33:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:33:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:33:52 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] No VIF found with MAC fa:16:3e:d3:3c:3c, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:33:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-aa9ce139-a4e5-4f76-a446-2e2354e357f3 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.306s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:33:53 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:33:53 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:33:53 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Rebuilding the list of instances to heal {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 03:33:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-f3c85dac-e42c-4b33-842f-3fb681cdc2ee" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:33:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-f3c85dac-e42c-4b33-842f-3fb681cdc2ee" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:33:53 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:33:53 user nova-compute[74898]: DEBUG nova.objects.instance [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lazy-loading 'info_cache' on Instance uuid f3c85dac-e42c-4b33-842f-3fb681cdc2ee {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:33:53 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Updating instance_info_cache with network_info: [{"id": "4fe8a0b3-a4f4-488d-937b-cdd22978a04e", "address": "fa:16:3e:fc:f8:0f", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe8a0b3-a4", "ovs_interfaceid": "4fe8a0b3-a4f4-488d-937b-cdd22978a04e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:33:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-f3c85dac-e42c-4b33-842f-3fb681cdc2ee" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:33:54 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:33:54 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:33:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:34:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:34:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:34:04 user nova-compute[74898]: INFO nova.compute.manager [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Detaching volume ca56e061-e6c0-45c4-8de4-260235e45ca3
Nov 17 03:34:04 user nova-compute[74898]: INFO nova.virt.block_device [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Attempting to driver detach volume ca56e061-e6c0-45c4-8de4-260235e45ca3 from mountpoint /dev/vdb
Nov 17 03:34:04 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Attempting to detach device vdb from instance 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5 from the persistent domain config. {{(pid=74898) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 03:34:04 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:34:04 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:34:04 user nova-compute[74898]:   <source dev="/dev/sdc"/>
Nov 17 03:34:04 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:34:04 user nova-compute[74898]:   <serial>ca56e061-e6c0-45c4-8de4-260235e45ca3</serial>
Nov 17 03:34:04 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:34:04 user nova-compute[74898]: </disk>
Nov 17 03:34:04 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:34:04 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Successfully detached device vdb from instance 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5 from the persistent domain config.
Nov 17 03:34:04 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5 from the live domain config. {{(pid=74898) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 03:34:04 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:34:04 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:34:04 user nova-compute[74898]:   <source dev="/dev/sdc"/>
Nov 17 03:34:04 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:34:04 user nova-compute[74898]:   <serial>ca56e061-e6c0-45c4-8de4-260235e45ca3</serial>
Nov 17 03:34:04 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:34:04 user nova-compute[74898]: </disk>
Nov 17 03:34:04 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:34:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:34:04 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5 {{(pid=74898) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 03:34:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:34:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:34:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:34:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:34:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:16 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:24 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5 is timed out.
Nov 17 03:34:24 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Successfully detached device vdb from instance 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5 from the live domain config.
Nov 17 03:34:24 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:34:24 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hlpbotQM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:34:24 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:34:24 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:34:24 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:34:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:34:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:34:24 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aed0c99-415f-4c9e-b729-3b3d0e6de5a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:34:24 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:34:24 user nova-compute[74898]: No targets found.
Nov 17 03:34:24 user nova-compute[74898]: iSNS:
Nov 17 03:34:24 user nova-compute[74898]: No targets found.
Nov 17 03:34:24 user nova-compute[74898]: STATIC:
Nov 17 03:34:24 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3
Nov 17 03:34:24 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:34:24 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:34:24 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f
Nov 17 03:34:24 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:34:24 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:34:24 user nova-compute[74898]: FIRMWARE:
Nov 17 03:34:24 user nova-compute[74898]: No targets found.
Nov 17 03:34:24 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:34:24 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:34:24 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:34:24 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:34:24 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:34:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:34:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:34:24 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad4ad80-3abc-4507-a4ee-c8a4b6537a0a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:34:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:34:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:34:24 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffd9124-ae83-4876-aac0-969f0436159f]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:34:24 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:34:24 user nova-compute[74898]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3 (non-flash)
Nov 17 03:34:24 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:34:24 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:34:24 user nova-compute[74898]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3 (non-flash)
Nov 17 03:34:24 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:34:24 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf873d1b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3'): ({'sdc'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:34:24 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Removing single pathed devices sdc {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:34:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:34:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:34:24 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f53146b-2f4d-4bee-80d8-44d851d6ae0d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:34:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:34:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:34:24 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23e21bf-3c81-4eff-8621-057374a4696a]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:34:24 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Flushing IO for device /dev/sdc {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:34:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:34:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:34:24 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd84548e-858d-4fe9-9355-a8cfc9a0734c]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:34:24 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:34:24 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:34:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:34:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[34df2be4-6246-4742-86da-1fe086387e3f]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:34:25 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:34:25 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] SCSI volumes sdc have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:34:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:34:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:34:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:34:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37a5424-7586-4a3d-a973-4c386637a6b3]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:34:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:34:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:34:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:34:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b218bfd3-6538-48f3-87ba-4c3705eeb3a4]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:34:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3, portal: 172.16.0.220,3260]
Nov 17 03:34:25 user nova-compute[74898]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3, portal: 172.16.0.220,3260] successful.
Nov 17 03:34:25 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:34:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:34:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:34:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[682a66c1-e348-43a6-b2e1-0d9c61624870]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:34:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:34:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:34:25 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] <== disconnect_volume: return (297ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:34:25 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:34:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:34:25 user nova-compute[74898]: DEBUG nova.objects.instance [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lazy-loading 'flavor' on Instance uuid 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:34:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-eb6f1b8c-62a7-40fa-90a8-7a89475ea8ea tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.642s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:34:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.517s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:34:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:34:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:34:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:34:25 user nova-compute[74898]: INFO nova.compute.manager [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Terminating instance
Nov 17 03:34:25 user nova-compute[74898]: DEBUG nova.compute.manager [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG nova.compute.manager [req-03f997e9-3cf6-4083-a69d-c2601a5d3cf6 req-80de8e35-23dd-4824-8582-b2ec3aeebcb6 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Received event network-vif-unplugged-182a94b3-1f52-47cf-95b7-900b82afd9ab {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-03f997e9-3cf6-4083-a69d-c2601a5d3cf6 req-80de8e35-23dd-4824-8582-b2ec3aeebcb6 service nova] Acquiring lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-03f997e9-3cf6-4083-a69d-c2601a5d3cf6 req-80de8e35-23dd-4824-8582-b2ec3aeebcb6 service nova] Lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-03f997e9-3cf6-4083-a69d-c2601a5d3cf6 req-80de8e35-23dd-4824-8582-b2ec3aeebcb6 service nova] Lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG nova.compute.manager [req-03f997e9-3cf6-4083-a69d-c2601a5d3cf6 req-80de8e35-23dd-4824-8582-b2ec3aeebcb6 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] No waiting events found dispatching network-vif-unplugged-182a94b3-1f52-47cf-95b7-900b82afd9ab {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG nova.compute.manager [req-03f997e9-3cf6-4083-a69d-c2601a5d3cf6 req-80de8e35-23dd-4824-8582-b2ec3aeebcb6 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Received event network-vif-unplugged-182a94b3-1f52-47cf-95b7-900b82afd9ab for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:26 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Instance destroyed successfully.
Nov 17 03:34:26 user nova-compute[74898]: DEBUG nova.objects.instance [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lazy-loading 'resources' on Instance uuid 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:31:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-682903395',display_name='tempest-VolumesSnapshotTestJSON-instance-682903395',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-682903395',id=45,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2foVnlAbfw6vEG8OK5AE+3JkpZbJFApHX1WJ3fxZH4PCQ8LIvPzvJlRtoBugbm5cJ4YnJlTXZMiqB3lznIiHQ1FBjQ3ozxN1IChZ24x/ZgeHfijcntMbYZTo4b5g3++Q==',key_name='tempest-keypair-308840350',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:31:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e4596366f424fa7937aaf97828a7c65',ramdisk_id='',reservation_id='r-hgf0yhbo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1365341029',owner_user_name='tempest-VolumesSnapshotTestJSON-1365341029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:32:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f3d630e4ece4c6c87da71cedcf3a839',uuid=6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "182a94b3-1f52-47cf-95b7-900b82afd9ab", "address": "fa:16:3e:d3:3c:3c", "network": {"id": "7ab9395e-a6a0-4b93-990e-d7d064bba5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-894693551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4596366f424fa7937aaf97828a7c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182a94b3-1f", "ovs_interfaceid": "182a94b3-1f52-47cf-95b7-900b82afd9ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Converting VIF {"id": "182a94b3-1f52-47cf-95b7-900b82afd9ab", "address": "fa:16:3e:d3:3c:3c", "network": {"id": "7ab9395e-a6a0-4b93-990e-d7d064bba5c0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-894693551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4596366f424fa7937aaf97828a7c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap182a94b3-1f", "ovs_interfaceid": "182a94b3-1f52-47cf-95b7-900b82afd9ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:3c:3c,bridge_name='br-int',has_traffic_filtering=True,id=182a94b3-1f52-47cf-95b7-900b82afd9ab,network=Network(7ab9395e-a6a0-4b93-990e-d7d064bba5c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap182a94b3-1f') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG os_vif [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:3c:3c,bridge_name='br-int',has_traffic_filtering=True,id=182a94b3-1f52-47cf-95b7-900b82afd9ab,network=Network(7ab9395e-a6a0-4b93-990e-d7d064bba5c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap182a94b3-1f') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap182a94b3-1f, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9694fe1-4c84-42e0-a7ee-d5efe15bfc6e) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:34:26 user nova-compute[74898]: INFO os_vif [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:3c:3c,bridge_name='br-int',has_traffic_filtering=True,id=182a94b3-1f52-47cf-95b7-900b82afd9ab,network=Network(7ab9395e-a6a0-4b93-990e-d7d064bba5c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap182a94b3-1f')
Nov 17 03:34:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hlpbotQM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:34:26 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:34:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf90a2d-b327-41be-a17f-cd0145c91c55]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:34:26 user nova-compute[74898]: No targets found.
Nov 17 03:34:26 user nova-compute[74898]: iSNS:
Nov 17 03:34:26 user nova-compute[74898]: No targets found.
Nov 17 03:34:26 user nova-compute[74898]: STATIC:
Nov 17 03:34:26 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f
Nov 17 03:34:26 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:34:26 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:34:26 user nova-compute[74898]: FIRMWARE:
Nov 17 03:34:26 user nova-compute[74898]: No targets found.
Nov 17 03:34:26 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:34:26 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:34:26 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca56e061-e6c0-45c4-8de4-260235e45ca3', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d51636-071c-47da-bb5d-de7f6a78717e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2687e94-d2e6-4d53-bff5-7efd10b4d15a]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:34:26 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:34:26 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf859e290>, {}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Disconnecting from: [] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.084s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] <== disconnect_volume: return (85ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:34:26 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Deleting instance files /opt/stack/data/nova/instances/6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5_del
Nov 17 03:34:26 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Deletion of /opt/stack/data/nova/instances/6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5_del complete
Nov 17 03:34:26 user nova-compute[74898]: INFO nova.compute.manager [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 17 03:34:26 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:34:26 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:34:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:27 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:34:27 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Took 0.73 seconds to deallocate network for instance.
Nov 17 03:34:27 user nova-compute[74898]: DEBUG nova.compute.manager [req-6032127d-c516-461f-886e-01c6ec5ef54e req-f142f60c-8904-417a-8d47-dfae6aba933b service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Received event network-vif-deleted-182a94b3-1f52-47cf-95b7-900b82afd9ab {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:34:27 user nova-compute[74898]: WARNING nova.volume.cinder [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Attachment da470004-be4b-4cdb-afe7-f32dd74f7404 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = da470004-be4b-4cdb-afe7-f32dd74f7404. (HTTP 404) (Request-ID: req-8fba37a0-4f71-465d-b6ab-964a025a5cb6)
Nov 17 03:34:27 user nova-compute[74898]: INFO nova.compute.manager [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Took 0.02 seconds to detach 1 volumes for instance.
Nov 17 03:34:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:34:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:34:27 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:34:27 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:34:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:34:27 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Deleted allocations for instance 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5
Nov 17 03:34:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-624d3ce3-e5d3-42ac-bdc9-9fb810225374 tempest-VolumesSnapshotTestJSON-1365341029 tempest-VolumesSnapshotTestJSON-1365341029-project-member] Lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.051s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:34:28 user nova-compute[74898]: DEBUG nova.compute.manager [req-a413a017-535b-4246-80cd-5ee6a2047cdc req-17e90ab3-cd53-4ffa-8e8b-9261fcb77872 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Received event network-vif-plugged-182a94b3-1f52-47cf-95b7-900b82afd9ab {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:34:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a413a017-535b-4246-80cd-5ee6a2047cdc req-17e90ab3-cd53-4ffa-8e8b-9261fcb77872 service nova] Acquiring lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:34:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a413a017-535b-4246-80cd-5ee6a2047cdc req-17e90ab3-cd53-4ffa-8e8b-9261fcb77872 service nova] Lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:34:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a413a017-535b-4246-80cd-5ee6a2047cdc req-17e90ab3-cd53-4ffa-8e8b-9261fcb77872 service nova] Lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:34:28 user nova-compute[74898]: DEBUG nova.compute.manager [req-a413a017-535b-4246-80cd-5ee6a2047cdc req-17e90ab3-cd53-4ffa-8e8b-9261fcb77872 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] No waiting events found dispatching network-vif-plugged-182a94b3-1f52-47cf-95b7-900b82afd9ab {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:34:28 user nova-compute[74898]: WARNING nova.compute.manager [req-a413a017-535b-4246-80cd-5ee6a2047cdc req-17e90ab3-cd53-4ffa-8e8b-9261fcb77872 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Received unexpected event network-vif-plugged-182a94b3-1f52-47cf-95b7-900b82afd9ab for instance with vm_state deleted and task_state None.
Nov 17 03:34:28 user nova-compute[74898]: DEBUG nova.compute.manager [req-a413a017-535b-4246-80cd-5ee6a2047cdc req-17e90ab3-cd53-4ffa-8e8b-9261fcb77872 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Received event network-vif-plugged-182a94b3-1f52-47cf-95b7-900b82afd9ab {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:34:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a413a017-535b-4246-80cd-5ee6a2047cdc req-17e90ab3-cd53-4ffa-8e8b-9261fcb77872 service nova] Acquiring lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:34:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a413a017-535b-4246-80cd-5ee6a2047cdc req-17e90ab3-cd53-4ffa-8e8b-9261fcb77872 service nova] Lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:34:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a413a017-535b-4246-80cd-5ee6a2047cdc req-17e90ab3-cd53-4ffa-8e8b-9261fcb77872 service nova] Lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:34:28 user nova-compute[74898]: DEBUG nova.compute.manager [req-a413a017-535b-4246-80cd-5ee6a2047cdc req-17e90ab3-cd53-4ffa-8e8b-9261fcb77872 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] No waiting events found dispatching network-vif-plugged-182a94b3-1f52-47cf-95b7-900b82afd9ab {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:34:28 user nova-compute[74898]: WARNING nova.compute.manager [req-a413a017-535b-4246-80cd-5ee6a2047cdc req-17e90ab3-cd53-4ffa-8e8b-9261fcb77872 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Received unexpected event network-vif-plugged-182a94b3-1f52-47cf-95b7-900b82afd9ab for instance with vm_state deleted and task_state None.
Nov 17 03:34:28 user nova-compute[74898]: DEBUG nova.compute.manager [req-a413a017-535b-4246-80cd-5ee6a2047cdc req-17e90ab3-cd53-4ffa-8e8b-9261fcb77872 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Received event network-vif-plugged-182a94b3-1f52-47cf-95b7-900b82afd9ab {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:34:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a413a017-535b-4246-80cd-5ee6a2047cdc req-17e90ab3-cd53-4ffa-8e8b-9261fcb77872 service nova] Acquiring lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:34:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a413a017-535b-4246-80cd-5ee6a2047cdc req-17e90ab3-cd53-4ffa-8e8b-9261fcb77872 service nova] Lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:34:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a413a017-535b-4246-80cd-5ee6a2047cdc req-17e90ab3-cd53-4ffa-8e8b-9261fcb77872 service nova] Lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:34:28 user nova-compute[74898]: DEBUG nova.compute.manager [req-a413a017-535b-4246-80cd-5ee6a2047cdc req-17e90ab3-cd53-4ffa-8e8b-9261fcb77872 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] No waiting events found dispatching network-vif-plugged-182a94b3-1f52-47cf-95b7-900b82afd9ab {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:34:28 user nova-compute[74898]: WARNING nova.compute.manager [req-a413a017-535b-4246-80cd-5ee6a2047cdc req-17e90ab3-cd53-4ffa-8e8b-9261fcb77872 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Received unexpected event network-vif-plugged-182a94b3-1f52-47cf-95b7-900b82afd9ab for instance with vm_state deleted and task_state None.
Nov 17 03:34:28 user nova-compute[74898]: DEBUG nova.compute.manager [req-a413a017-535b-4246-80cd-5ee6a2047cdc req-17e90ab3-cd53-4ffa-8e8b-9261fcb77872 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Received event network-vif-unplugged-182a94b3-1f52-47cf-95b7-900b82afd9ab {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:34:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a413a017-535b-4246-80cd-5ee6a2047cdc req-17e90ab3-cd53-4ffa-8e8b-9261fcb77872 service nova] Acquiring lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:34:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a413a017-535b-4246-80cd-5ee6a2047cdc req-17e90ab3-cd53-4ffa-8e8b-9261fcb77872 service nova] Lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:34:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a413a017-535b-4246-80cd-5ee6a2047cdc req-17e90ab3-cd53-4ffa-8e8b-9261fcb77872 service nova] Lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:34:28 user nova-compute[74898]: DEBUG nova.compute.manager [req-a413a017-535b-4246-80cd-5ee6a2047cdc req-17e90ab3-cd53-4ffa-8e8b-9261fcb77872 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] No waiting events found dispatching network-vif-unplugged-182a94b3-1f52-47cf-95b7-900b82afd9ab {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:34:28 user nova-compute[74898]: WARNING nova.compute.manager [req-a413a017-535b-4246-80cd-5ee6a2047cdc req-17e90ab3-cd53-4ffa-8e8b-9261fcb77872 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Received unexpected event network-vif-unplugged-182a94b3-1f52-47cf-95b7-900b82afd9ab for instance with vm_state deleted and task_state None.
Nov 17 03:34:28 user nova-compute[74898]: DEBUG nova.compute.manager [req-a413a017-535b-4246-80cd-5ee6a2047cdc req-17e90ab3-cd53-4ffa-8e8b-9261fcb77872 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Received event network-vif-plugged-182a94b3-1f52-47cf-95b7-900b82afd9ab {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:34:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a413a017-535b-4246-80cd-5ee6a2047cdc req-17e90ab3-cd53-4ffa-8e8b-9261fcb77872 service nova] Acquiring lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:34:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a413a017-535b-4246-80cd-5ee6a2047cdc req-17e90ab3-cd53-4ffa-8e8b-9261fcb77872 service nova] Lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:34:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a413a017-535b-4246-80cd-5ee6a2047cdc req-17e90ab3-cd53-4ffa-8e8b-9261fcb77872 service nova] Lock "6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:34:28 user nova-compute[74898]: DEBUG nova.compute.manager [req-a413a017-535b-4246-80cd-5ee6a2047cdc req-17e90ab3-cd53-4ffa-8e8b-9261fcb77872 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] No waiting events found dispatching network-vif-plugged-182a94b3-1f52-47cf-95b7-900b82afd9ab {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:34:28 user nova-compute[74898]: WARNING nova.compute.manager [req-a413a017-535b-4246-80cd-5ee6a2047cdc req-17e90ab3-cd53-4ffa-8e8b-9261fcb77872 service nova] [instance: 6fdbfe1f-f189-41ca-97ba-ec6db6d9b4c5] Received unexpected event network-vif-plugged-182a94b3-1f52-47cf-95b7-900b82afd9ab for instance with vm_state deleted and task_state None.
Nov 17 03:34:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:34:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-3ddfa631-66e2-4094-b986-62a5fd98ec04 req-1180a93d-e32f-4a8b-94c5-e3d0e78b1033 service nova] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Received event network-changed-4fe8a0b3-a4f4-488d-937b-cdd22978a04e {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:34:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-3ddfa631-66e2-4094-b986-62a5fd98ec04 req-1180a93d-e32f-4a8b-94c5-e3d0e78b1033 service nova] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Refreshing instance network info cache due to event network-changed-4fe8a0b3-a4f4-488d-937b-cdd22978a04e. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:34:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3ddfa631-66e2-4094-b986-62a5fd98ec04 req-1180a93d-e32f-4a8b-94c5-e3d0e78b1033 service nova] Acquiring lock "refresh_cache-f3c85dac-e42c-4b33-842f-3fb681cdc2ee" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:34:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3ddfa631-66e2-4094-b986-62a5fd98ec04 req-1180a93d-e32f-4a8b-94c5-e3d0e78b1033 service nova] Acquired lock "refresh_cache-f3c85dac-e42c-4b33-842f-3fb681cdc2ee" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:34:39 user nova-compute[74898]: DEBUG nova.network.neutron [req-3ddfa631-66e2-4094-b986-62a5fd98ec04 req-1180a93d-e32f-4a8b-94c5-e3d0e78b1033 service nova] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Refreshing network info cache for port 4fe8a0b3-a4f4-488d-937b-cdd22978a04e {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:34:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "f3c85dac-e42c-4b33-842f-3fb681cdc2ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:34:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "f3c85dac-e42c-4b33-842f-3fb681cdc2ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:34:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "f3c85dac-e42c-4b33-842f-3fb681cdc2ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:34:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "f3c85dac-e42c-4b33-842f-3fb681cdc2ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:34:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "f3c85dac-e42c-4b33-842f-3fb681cdc2ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:34:39 user nova-compute[74898]: INFO nova.compute.manager [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Terminating instance
Nov 17 03:34:39 user nova-compute[74898]: DEBUG nova.compute.manager [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:34:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG nova.compute.manager [req-5849af98-b65a-49fe-8481-aef8e3a9eb61 req-ec93a02c-da43-4de1-a021-76e7fc4decc8 service nova] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Received event network-vif-unplugged-4fe8a0b3-a4f4-488d-937b-cdd22978a04e {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5849af98-b65a-49fe-8481-aef8e3a9eb61 req-ec93a02c-da43-4de1-a021-76e7fc4decc8 service nova] Acquiring lock "f3c85dac-e42c-4b33-842f-3fb681cdc2ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5849af98-b65a-49fe-8481-aef8e3a9eb61 req-ec93a02c-da43-4de1-a021-76e7fc4decc8 service nova] Lock "f3c85dac-e42c-4b33-842f-3fb681cdc2ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5849af98-b65a-49fe-8481-aef8e3a9eb61 req-ec93a02c-da43-4de1-a021-76e7fc4decc8 service nova] Lock "f3c85dac-e42c-4b33-842f-3fb681cdc2ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG nova.compute.manager [req-5849af98-b65a-49fe-8481-aef8e3a9eb61 req-ec93a02c-da43-4de1-a021-76e7fc4decc8 service nova] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] No waiting events found dispatching network-vif-unplugged-4fe8a0b3-a4f4-488d-937b-cdd22978a04e {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG nova.compute.manager [req-5849af98-b65a-49fe-8481-aef8e3a9eb61 req-ec93a02c-da43-4de1-a021-76e7fc4decc8 service nova] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Received event network-vif-unplugged-4fe8a0b3-a4f4-488d-937b-cdd22978a04e for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG nova.network.neutron [req-3ddfa631-66e2-4094-b986-62a5fd98ec04 req-1180a93d-e32f-4a8b-94c5-e3d0e78b1033 service nova] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Updated VIF entry in instance network info cache for port 4fe8a0b3-a4f4-488d-937b-cdd22978a04e. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG nova.network.neutron [req-3ddfa631-66e2-4094-b986-62a5fd98ec04 req-1180a93d-e32f-4a8b-94c5-e3d0e78b1033 service nova] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Updating instance_info_cache with network_info: [{"id": "4fe8a0b3-a4f4-488d-937b-cdd22978a04e", "address": "fa:16:3e:fc:f8:0f", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe8a0b3-a4", "ovs_interfaceid": "4fe8a0b3-a4f4-488d-937b-cdd22978a04e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3ddfa631-66e2-4094-b986-62a5fd98ec04 req-1180a93d-e32f-4a8b-94c5-e3d0e78b1033 service nova] Releasing lock "refresh_cache-f3c85dac-e42c-4b33-842f-3fb681cdc2ee" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:34:40 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Instance destroyed successfully.
Nov 17 03:34:40 user nova-compute[74898]: DEBUG nova.objects.instance [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lazy-loading 'resources' on Instance uuid f3c85dac-e42c-4b33-842f-3fb681cdc2ee {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:29:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-914343371',display_name='tempest-TestVolumeBootPattern-server-914343371',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-914343371',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJInWWavbu/6d6OQJPNghOKND7RIoCzZc2qCUfAkCC2TokwiJfdMvyOxWX8lLSW7Fx1YLwTdFBaDgYlG8DKkEJfoMkAf+B/utXvLWusVeA4Z9dMFCfioGuJoTmK0Ain2zQ==',key_name='tempest-TestVolumeBootPattern-1387915334',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:30:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d36087cc8e842c0bfcae89553fb9841',ramdisk_id='',reservation_id='r-sf277u2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1382126375',owner_user_name='tempest-TestVolumeBootPattern-1382126375-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:30:07Z,user_data=None,user_id='aa779a5f98394629b6b9fa9d04233e7a',uuid=f3c85dac-e42c-4b33-842f-3fb681cdc2ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fe8a0b3-a4f4-488d-937b-cdd22978a04e", "address": "fa:16:3e:fc:f8:0f", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe8a0b3-a4", "ovs_interfaceid": "4fe8a0b3-a4f4-488d-937b-cdd22978a04e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converting VIF {"id": "4fe8a0b3-a4f4-488d-937b-cdd22978a04e", "address": "fa:16:3e:fc:f8:0f", "network": {"id": "179456a5-ae28-4bdf-a8b6-5e7e079bdc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-726926116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d36087cc8e842c0bfcae89553fb9841", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe8a0b3-a4", "ovs_interfaceid": "4fe8a0b3-a4f4-488d-937b-cdd22978a04e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:f8:0f,bridge_name='br-int',has_traffic_filtering=True,id=4fe8a0b3-a4f4-488d-937b-cdd22978a04e,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fe8a0b3-a4') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG os_vif [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:f8:0f,bridge_name='br-int',has_traffic_filtering=True,id=4fe8a0b3-a4f4-488d-937b-cdd22978a04e,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fe8a0b3-a4') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fe8a0b3-a4, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac4ec899-b2bb-412c-a74e-8adf87793236) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:34:40 user nova-compute[74898]: INFO os_vif [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:f8:0f,bridge_name='br-int',has_traffic_filtering=True,id=4fe8a0b3-a4f4-488d-937b-cdd22978a04e,network=Network(179456a5-ae28-4bdf-a8b6-5e7e079bdc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fe8a0b3-a4')
Nov 17 03:34:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxlbaNWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:34:40 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:34:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[86196ec6-10c5-4818-a54f-acd92452f1af]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:34:40 user nova-compute[74898]: No targets found.
Nov 17 03:34:40 user nova-compute[74898]: iSNS:
Nov 17 03:34:40 user nova-compute[74898]: No targets found.
Nov 17 03:34:40 user nova-compute[74898]: STATIC:
Nov 17 03:34:40 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f
Nov 17 03:34:40 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:34:40 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:34:40 user nova-compute[74898]: FIRMWARE:
Nov 17 03:34:40 user nova-compute[74898]: No targets found.
Nov 17 03:34:40 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:34:40 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:34:40 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb9548d-b523-4794-be0f-86a3ce405c44]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[542a607c-fad5-4a26-8463-fe27d84b14da]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:34:40 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f (non-flash)
Nov 17 03:34:40 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf84e3d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f'): ({'sdb'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Removing single pathed devices sdb {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf86225d-0557-4f53-8fc8-378589b435d6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4c1ddc-9b7c-4458-9656-16b6d38cfb7f]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Flushing IO for device /dev/sdb {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[12415676-3db6-41f9-a278-a2ddb280b9d8]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fd6e53-970e-4d9e-879c-9c3d6550c0ca]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23035313539643335', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9d1897e7', '/dev/disk/by-id/scsi-1SCST_BIO9d1897e7-05159d35a4048cc6') {{(pid=86021) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7002bfd-8eee-459c-9d4c-2e96de801c44]: (4, None) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[78765e69-fe5a-4610-9dc6-9775551aa016]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf59841a-74ab-41d7-816c-cc32bd69550b]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f, portal: 172.16.0.220,3260]
Nov 17 03:34:40 user nova-compute[74898]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f, portal: 172.16.0.220,3260] successful.
Nov 17 03:34:40 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:137dde58-30b0-4893-8678-f1fb9a2c4e6f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc6f368-8706-4033-85ae-542ddff60407]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] <== disconnect_volume: return (292ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:34:40 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Deleting instance files /opt/stack/data/nova/instances/f3c85dac-e42c-4b33-842f-3fb681cdc2ee_del
Nov 17 03:34:40 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Deletion of /opt/stack/data/nova/instances/f3c85dac-e42c-4b33-842f-3fb681cdc2ee_del complete
Nov 17 03:34:40 user nova-compute[74898]: INFO nova.compute.manager [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 17 03:34:40 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:34:40 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:34:41 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:34:41 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Took 0.42 seconds to deallocate network for instance.
Nov 17 03:34:41 user nova-compute[74898]: DEBUG nova.compute.manager [req-038cb7b7-c4f3-49f2-bb22-6ee337826759 req-c7980425-70a0-459b-8deb-67dfa2f743ea service nova] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Received event network-vif-deleted-4fe8a0b3-a4f4-488d-937b-cdd22978a04e {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:34:41 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:34:41 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:34:42 user nova-compute[74898]: INFO nova.compute.manager [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Took 0.71 seconds to detach 1 volumes for instance.
Nov 17 03:34:42 user nova-compute[74898]: DEBUG nova.compute.manager [req-52638ea3-fde6-43ba-9a77-46aa59f84895 req-dd28d97f-69d2-482d-a0c0-209e0efdf2c6 service nova] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Received event network-vif-plugged-4fe8a0b3-a4f4-488d-937b-cdd22978a04e {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:34:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-52638ea3-fde6-43ba-9a77-46aa59f84895 req-dd28d97f-69d2-482d-a0c0-209e0efdf2c6 service nova] Acquiring lock "f3c85dac-e42c-4b33-842f-3fb681cdc2ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:34:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-52638ea3-fde6-43ba-9a77-46aa59f84895 req-dd28d97f-69d2-482d-a0c0-209e0efdf2c6 service nova] Lock "f3c85dac-e42c-4b33-842f-3fb681cdc2ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:34:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-52638ea3-fde6-43ba-9a77-46aa59f84895 req-dd28d97f-69d2-482d-a0c0-209e0efdf2c6 service nova] Lock "f3c85dac-e42c-4b33-842f-3fb681cdc2ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:34:42 user nova-compute[74898]: DEBUG nova.compute.manager [req-52638ea3-fde6-43ba-9a77-46aa59f84895 req-dd28d97f-69d2-482d-a0c0-209e0efdf2c6 service nova] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] No waiting events found dispatching network-vif-plugged-4fe8a0b3-a4f4-488d-937b-cdd22978a04e {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:34:42 user nova-compute[74898]: WARNING nova.compute.manager [req-52638ea3-fde6-43ba-9a77-46aa59f84895 req-dd28d97f-69d2-482d-a0c0-209e0efdf2c6 service nova] [instance: f3c85dac-e42c-4b33-842f-3fb681cdc2ee] Received unexpected event network-vif-plugged-4fe8a0b3-a4f4-488d-937b-cdd22978a04e for instance with vm_state active and task_state deleting.
Nov 17 03:34:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:34:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:34:42 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:34:42 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:34:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:34:42 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Deleted allocations for instance f3c85dac-e42c-4b33-842f-3fb681cdc2ee
Nov 17 03:34:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-7d142c2b-2ab4-44d3-9170-8cf255b42078 tempest-TestVolumeBootPattern-1382126375 tempest-TestVolumeBootPattern-1382126375-project-member] Lock "f3c85dac-e42c-4b33-842f-3fb681cdc2ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.574s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:34:44 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:34:44 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:34:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:34:45 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:34:48 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:34:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:34:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:34:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:34:48 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:34:48 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4927b642-dca5-4599-b45b-efcace11002a/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:34:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4927b642-dca5-4599-b45b-efcace11002a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:34:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4927b642-dca5-4599-b45b-efcace11002a/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:34:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4927b642-dca5-4599-b45b-efcace11002a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:34:49 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:34:49 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:34:49 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=8888MB free_disk=25.30638885498047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:34:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:34:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:34:49 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 4927b642-dca5-4599-b45b-efcace11002a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:34:49 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:34:49 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:34:49 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:34:49 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:34:49 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:34:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:34:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:34:50 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:34:52 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:34:52 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:34:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-4927b642-dca5-4599-b45b-efcace11002a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:34:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-4927b642-dca5-4599-b45b-efcace11002a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:34:52 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:34:53 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Updating instance_info_cache with network_info: [{"id": "ef217a49-2a6e-44c2-b1d7-66ca523d28fb", "address": "fa:16:3e:0d:54:94", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef217a49-2a", "ovs_interfaceid": "ef217a49-2a6e-44c2-b1d7-66ca523d28fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:34:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-4927b642-dca5-4599-b45b-efcace11002a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:34:53 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:34:53 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:34:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:35:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:04 user nova-compute[74898]: DEBUG nova.compute.manager [req-d6709cc7-2a6f-4255-b42f-300511f82c10 req-1848b207-4e8b-4e24-a5ad-dabd8e2b7d94 service nova] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Received event network-changed-ef217a49-2a6e-44c2-b1d7-66ca523d28fb {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:35:04 user nova-compute[74898]: DEBUG nova.compute.manager [req-d6709cc7-2a6f-4255-b42f-300511f82c10 req-1848b207-4e8b-4e24-a5ad-dabd8e2b7d94 service nova] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Refreshing instance network info cache due to event network-changed-ef217a49-2a6e-44c2-b1d7-66ca523d28fb. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:35:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d6709cc7-2a6f-4255-b42f-300511f82c10 req-1848b207-4e8b-4e24-a5ad-dabd8e2b7d94 service nova] Acquiring lock "refresh_cache-4927b642-dca5-4599-b45b-efcace11002a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:35:04 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d6709cc7-2a6f-4255-b42f-300511f82c10 req-1848b207-4e8b-4e24-a5ad-dabd8e2b7d94 service nova] Acquired lock "refresh_cache-4927b642-dca5-4599-b45b-efcace11002a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:35:04 user nova-compute[74898]: DEBUG nova.network.neutron [req-d6709cc7-2a6f-4255-b42f-300511f82c10 req-1848b207-4e8b-4e24-a5ad-dabd8e2b7d94 service nova] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Refreshing network info cache for port ef217a49-2a6e-44c2-b1d7-66ca523d28fb {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:35:05 user nova-compute[74898]: DEBUG nova.network.neutron [req-d6709cc7-2a6f-4255-b42f-300511f82c10 req-1848b207-4e8b-4e24-a5ad-dabd8e2b7d94 service nova] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Updated VIF entry in instance network info cache for port ef217a49-2a6e-44c2-b1d7-66ca523d28fb. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:35:05 user nova-compute[74898]: DEBUG nova.network.neutron [req-d6709cc7-2a6f-4255-b42f-300511f82c10 req-1848b207-4e8b-4e24-a5ad-dabd8e2b7d94 service nova] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Updating instance_info_cache with network_info: [{"id": "ef217a49-2a6e-44c2-b1d7-66ca523d28fb", "address": "fa:16:3e:0d:54:94", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef217a49-2a", "ovs_interfaceid": "ef217a49-2a6e-44c2-b1d7-66ca523d28fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:35:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d6709cc7-2a6f-4255-b42f-300511f82c10 req-1848b207-4e8b-4e24-a5ad-dabd8e2b7d94 service nova] Releasing lock "refresh_cache-4927b642-dca5-4599-b45b-efcace11002a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:35:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:35:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "4927b642-dca5-4599-b45b-efcace11002a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:35:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "4927b642-dca5-4599-b45b-efcace11002a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:35:07 user nova-compute[74898]: DEBUG nova.objects.instance [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lazy-loading 'flavor' on Instance uuid 4927b642-dca5-4599-b45b-efcace11002a {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:35:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "4927b642-dca5-4599-b45b-efcace11002a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:35:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "4927b642-dca5-4599-b45b-efcace11002a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:35:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "4927b642-dca5-4599-b45b-efcace11002a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:35:07 user nova-compute[74898]: INFO nova.compute.manager [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Attaching volume 980c548a-adee-44e2-802e-417e15138e64 to /dev/vdb
Nov 17 03:35:07 user nova-compute[74898]: DEBUG os_brick.utils [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:35:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:07 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca11f2e9-caf5-4d1b-a185-3137844ba018]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:35:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:07 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3791d95-9170-4d8d-a90b-42a33f6b77fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:35:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:07 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aba3660-6a3c-486f-8979-884b356479e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:35:07 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[739e94d5-298c-4ae2-8505-7320763599d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:35:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:35:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:35:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:07 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:35:07 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:35:07 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ab99e8-1abd-46ce-8e27-c776b93aa3d9]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:35:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:35:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:35:07 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:35:07 user nova-compute[74898]: DEBUG os_brick.utils [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:35:07 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Updating existing volume attachment record: d97d73be-5ddd-43de-9914-45a7b3f10b16 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:35:09 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:35:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:35:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:35:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:35:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:35:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:35:09 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:35:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.imagecache [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Verify base images {{(pid=74898) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 17 03:35:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.imagecache [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Image id 50e5d43b-62d6-4f28-a52e-a1c6b84eb51f yields fingerprint b58a60adfb36e496a80975fe5f9e33ecd94e9372 {{(pid=74898) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 17 03:35:09 user nova-compute[74898]: INFO nova.virt.libvirt.imagecache [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] image 50e5d43b-62d6-4f28-a52e-a1c6b84eb51f at (/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372): checking
Nov 17 03:35:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.imagecache [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] image 50e5d43b-62d6-4f28-a52e-a1c6b84eb51f at (/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372): image is in use {{(pid=74898) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 17 03:35:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.imagecache [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74898) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 17 03:35:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.imagecache [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] 4927b642-dca5-4599-b45b-efcace11002a is a valid instance name {{(pid=74898) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 17 03:35:09 user nova-compute[74898]: DEBUG nova.virt.libvirt.imagecache [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] 4927b642-dca5-4599-b45b-efcace11002a has a disk file {{(pid=74898) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 17 03:35:09 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4927b642-dca5-4599-b45b-efcace11002a/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4927b642-dca5-4599-b45b-efcace11002a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.imagecache [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 4927b642-dca5-4599-b45b-efcace11002a is backed by b58a60adfb36e496a80975fe5f9e33ecd94e9372 {{(pid=74898) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 17 03:35:10 user nova-compute[74898]: WARNING nova.virt.libvirt.imagecache [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Unknown base file: /opt/stack/data/nova/instances/_base/0d26be1178031a8201ee5e12c522d9728e450cac
Nov 17 03:35:10 user nova-compute[74898]: WARNING nova.virt.libvirt.imagecache [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Unknown base file: /opt/stack/data/nova/instances/_base/e75e682c70f529fb4ed39e49672c43af79c04455
Nov 17 03:35:10 user nova-compute[74898]: WARNING nova.virt.libvirt.imagecache [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Unknown base file: /opt/stack/data/nova/instances/_base/d4f8cd6277b8159174836ea2f871652b993a6b93
Nov 17 03:35:10 user nova-compute[74898]: WARNING nova.virt.libvirt.imagecache [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Unknown base file: /opt/stack/data/nova/instances/_base/19ae0e720cea3918b90ae5ab4b7807321716fede
Nov 17 03:35:10 user nova-compute[74898]: WARNING nova.virt.libvirt.imagecache [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Unknown base file: /opt/stack/data/nova/instances/_base/40315d6ce94519c12a1481c805e1ff1a40e6f475
Nov 17 03:35:10 user nova-compute[74898]: WARNING nova.virt.libvirt.imagecache [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Unknown base file: /opt/stack/data/nova/instances/_base/0929fa02f5f33c5127bc0bd838685689c5957988
Nov 17 03:35:10 user nova-compute[74898]: WARNING nova.virt.libvirt.imagecache [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Unknown base file: /opt/stack/data/nova/instances/_base/7786aeb91018441e8158bc202cf7d57a84a51dff
Nov 17 03:35:10 user nova-compute[74898]: WARNING nova.virt.libvirt.imagecache [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Unknown base file: /opt/stack/data/nova/instances/_base/81d2df432862b964f2d6ccbefb2e669d37512525
Nov 17 03:35:10 user nova-compute[74898]: INFO nova.virt.libvirt.imagecache [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Active base files: /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372
Nov 17 03:35:10 user nova-compute[74898]: INFO nova.virt.libvirt.imagecache [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Removable base files: /opt/stack/data/nova/instances/_base/0d26be1178031a8201ee5e12c522d9728e450cac /opt/stack/data/nova/instances/_base/e75e682c70f529fb4ed39e49672c43af79c04455 /opt/stack/data/nova/instances/_base/d4f8cd6277b8159174836ea2f871652b993a6b93 /opt/stack/data/nova/instances/_base/19ae0e720cea3918b90ae5ab4b7807321716fede /opt/stack/data/nova/instances/_base/40315d6ce94519c12a1481c805e1ff1a40e6f475 /opt/stack/data/nova/instances/_base/0929fa02f5f33c5127bc0bd838685689c5957988 /opt/stack/data/nova/instances/_base/7786aeb91018441e8158bc202cf7d57a84a51dff /opt/stack/data/nova/instances/_base/81d2df432862b964f2d6ccbefb2e669d37512525
Nov 17 03:35:10 user nova-compute[74898]: INFO nova.virt.libvirt.imagecache [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0d26be1178031a8201ee5e12c522d9728e450cac
Nov 17 03:35:10 user nova-compute[74898]: INFO nova.virt.libvirt.imagecache [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e75e682c70f529fb4ed39e49672c43af79c04455
Nov 17 03:35:10 user nova-compute[74898]: INFO nova.virt.libvirt.imagecache [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d4f8cd6277b8159174836ea2f871652b993a6b93
Nov 17 03:35:10 user nova-compute[74898]: INFO nova.virt.libvirt.imagecache [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/19ae0e720cea3918b90ae5ab4b7807321716fede
Nov 17 03:35:10 user nova-compute[74898]: INFO nova.virt.libvirt.imagecache [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/40315d6ce94519c12a1481c805e1ff1a40e6f475
Nov 17 03:35:10 user nova-compute[74898]: INFO nova.virt.libvirt.imagecache [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0929fa02f5f33c5127bc0bd838685689c5957988
Nov 17 03:35:10 user nova-compute[74898]: INFO nova.virt.libvirt.imagecache [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7786aeb91018441e8158bc202cf7d57a84a51dff
Nov 17 03:35:10 user nova-compute[74898]: INFO nova.virt.libvirt.imagecache [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/81d2df432862b964f2d6ccbefb2e669d37512525
Nov 17 03:35:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.imagecache [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Verification complete {{(pid=74898) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 17 03:35:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.imagecache [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Verify swap images {{(pid=74898) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 17 03:35:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.imagecache [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Verify ephemeral images {{(pid=74898) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 17 03:35:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwgObhrm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:35:12 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:35:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:35:12 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:35:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:35:12 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cc5099-e716-4338-9a05-975f45309a61]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:35:12 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e2c4b4-8766-4c50-89f1-64c17e983531]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64] added
Nov 17 03:35:12 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c32ff37-4603-4620-a089-1a81765073f2]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c90f0a-faca-4a15-9d8e-d92478161f2b]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jwgObhrm {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jwgObhrm" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c7a56c-24b3-43e4-b8c5-f11e0f31ec04]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jwgObhrm'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2d59f8-2a53-443d-93c4-0105df0092f1]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[002447c7-60b7-4797-9459-a2197332fa9b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 17 03:35:12 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 17 03:35:12 user nova-compute[74898]:  {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:35:12 user nova-compute[74898]: WARNING os_brick.initiator.connectors.iscsi [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 17 03:35:12 user nova-compute[74898]: 
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[414abdf8-adee-4202-86e7-56f8031f3b5b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64, portal: 172.16.0.220,3260]
Nov 17 03:35:12 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64, portal: 172.16.0.220,3260] successful.
Nov 17 03:35:12 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d36b64-6b39-4d46-8824-186ce1d4c445]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[08abac3b-36e0-4a35-8c4d-b5e9ebbaa3dc]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64 (non-flash)
Nov 17 03:35:12 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64 (non-flash)
Nov 17 03:35:12 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcbc772-cee7-43dc-9e5f-2f3ffc8b6ddf]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:35:12 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:35:13 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:35:13 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwgObhrm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:35:13 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:35:13 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '23035373730666662', 'path': '/dev/sdb'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:35:13 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035373730666662', 'path': '/dev/sdb'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:35:13 user nova-compute[74898]: DEBUG nova.objects.instance [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lazy-loading 'flavor' on Instance uuid 4927b642-dca5-4599-b45b-efcace11002a {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:35:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 03:35:14 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:35:14 user nova-compute[74898]:   <source dev="/dev/sdb"/>
Nov 17 03:35:14 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:35:14 user nova-compute[74898]:   <serial>980c548a-adee-44e2-802e-417e15138e64</serial>
Nov 17 03:35:14 user nova-compute[74898]: </disk>
Nov 17 03:35:14 user nova-compute[74898]:  {{(pid=74898) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 03:35:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:35:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:35:14 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] No VIF found with MAC fa:16:3e:0d:54:94, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:35:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-b7f0f645-0f96-4a11-9cde-219bc48b756a tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "4927b642-dca5-4599-b45b-efcace11002a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.230s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:35:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "4927b642-dca5-4599-b45b-efcace11002a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:35:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "4927b642-dca5-4599-b45b-efcace11002a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:35:15 user nova-compute[74898]: INFO nova.compute.manager [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Detaching volume 980c548a-adee-44e2-802e-417e15138e64
Nov 17 03:35:15 user nova-compute[74898]: INFO nova.virt.block_device [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Attempting to driver detach volume 980c548a-adee-44e2-802e-417e15138e64 from mountpoint /dev/vdb
Nov 17 03:35:15 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Attempting to detach device vdb from instance 4927b642-dca5-4599-b45b-efcace11002a from the persistent domain config. {{(pid=74898) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 03:35:15 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:35:15 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:35:15 user nova-compute[74898]:   <source dev="/dev/sdb"/>
Nov 17 03:35:15 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:35:15 user nova-compute[74898]:   <serial>980c548a-adee-44e2-802e-417e15138e64</serial>
Nov 17 03:35:15 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:35:15 user nova-compute[74898]: </disk>
Nov 17 03:35:15 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:35:15 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Successfully detached device vdb from instance 4927b642-dca5-4599-b45b-efcace11002a from the persistent domain config.
Nov 17 03:35:15 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4927b642-dca5-4599-b45b-efcace11002a from the live domain config. {{(pid=74898) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 03:35:15 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:35:15 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:35:15 user nova-compute[74898]:   <source dev="/dev/sdb"/>
Nov 17 03:35:15 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:35:15 user nova-compute[74898]:   <serial>980c548a-adee-44e2-802e-417e15138e64</serial>
Nov 17 03:35:15 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:35:15 user nova-compute[74898]: </disk>
Nov 17 03:35:15 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:35:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:15 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4927b642-dca5-4599-b45b-efcace11002a {{(pid=74898) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 03:35:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:30 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:35 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4927b642-dca5-4599-b45b-efcace11002a is timed out.
Nov 17 03:35:35 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Successfully detached device vdb from instance 4927b642-dca5-4599-b45b-efcace11002a from the live domain config.
Nov 17 03:35:35 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwgObhrm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:35:35 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:35:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9605a808-23a1-42f8-ae64-9329ba6c4bb4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:35:35 user nova-compute[74898]: No targets found.
Nov 17 03:35:35 user nova-compute[74898]: iSNS:
Nov 17 03:35:35 user nova-compute[74898]: No targets found.
Nov 17 03:35:35 user nova-compute[74898]: STATIC:
Nov 17 03:35:35 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64
Nov 17 03:35:35 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:35:35 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:35:35 user nova-compute[74898]: FIRMWARE:
Nov 17 03:35:35 user nova-compute[74898]: No targets found.
Nov 17 03:35:35 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:35:35 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:35:35 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f35f7ab-fbd5-48ff-8e35-6e766f180ba3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57c0e2c-38af-41ab-9846-1a0e73c07e1c]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64 (non-flash)
Nov 17 03:35:35 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64 (non-flash)
Nov 17 03:35:35 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf85064d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64'): ({'sdb'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Removing single pathed devices sdb {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e0c72e-0494-42d7-be26-4020473f7161]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d609c282-32d7-4933-a7bf-9e5a15f0333a]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Flushing IO for device /dev/sdb {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5657c0c-89d4-4ead-b243-c5fee466a8ba]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bf3c37-0b39-422e-b160-e7be8f546d2a]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:35 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b88185-3695-4a65-a732-c512812ddd59]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:35:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:35:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f112f88d-b5b3-4966-a8aa-63c0d78ca57a]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:35:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64, portal: 172.16.0.220,3260]
Nov 17 03:35:36 user nova-compute[74898]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64, portal: 172.16.0.220,3260] successful.
Nov 17 03:35:36 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:35:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980c548a-adee-44e2-802e-417e15138e64 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e3e969-e7a4-4059-8086-7e8a67b63b8e]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:35:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:35:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:35:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] <== disconnect_volume: return (331ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:35:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:35:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:36 user nova-compute[74898]: DEBUG nova.objects.instance [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lazy-loading 'flavor' on Instance uuid 4927b642-dca5-4599-b45b-efcace11002a {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:35:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-5233e6cf-dd72-4944-9c37-f61ffec45af6 tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "4927b642-dca5-4599-b45b-efcace11002a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.751s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:35:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:41 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:35:41 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:35:41 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:35:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:35:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:35:42 user nova-compute[74898]: DEBUG nova.compute.manager [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:35:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:35:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:35:42 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:35:42 user nova-compute[74898]: INFO nova.compute.claims [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Claim successful on node user
Nov 17 03:35:42 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:35:42 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:35:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.216s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:35:42 user nova-compute[74898]: DEBUG nova.compute.manager [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:35:42 user nova-compute[74898]: DEBUG nova.compute.manager [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:35:42 user nova-compute[74898]: DEBUG nova.network.neutron [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:35:43 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:35:43 user nova-compute[74898]: DEBUG nova.compute.manager [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:35:43 user nova-compute[74898]: DEBUG nova.policy [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '70d8f2bbd9f4448096b0991222a32994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeadb4c131e45d5a2756825338e5a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:35:43 user nova-compute[74898]: DEBUG nova.compute.manager [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:35:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:35:43 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Creating image(s)
Nov 17 03:35:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "/opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:35:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "/opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:35:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "/opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:35:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.179s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:35:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:35:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.195s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk 1073741824" returned: 0 in 0.111s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:35:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:43 user nova-compute[74898]: DEBUG nova.network.neutron [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Successfully created port: b5248d6e-e587-409e-9b44-ed1a576ff20f {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:35:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.185s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:43 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:35:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Cannot resize image /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Ensure instance console log exists: /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.network.neutron [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Successfully updated port: b5248d6e-e587-409e-9b44-ed1a576ff20f {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "refresh_cache-25ab4a8b-372b-42ab-8929-1d8c3262e3ca" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquired lock "refresh_cache-25ab4a8b-372b-42ab-8929-1d8c3262e3ca" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.network.neutron [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.compute.manager [req-8dcec867-ce8a-4fff-869a-2f767e1d1f54 req-2c5fbe3f-469c-4c94-8c62-ec45ddb6bb74 service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Received event network-changed-b5248d6e-e587-409e-9b44-ed1a576ff20f {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.compute.manager [req-8dcec867-ce8a-4fff-869a-2f767e1d1f54 req-2c5fbe3f-469c-4c94-8c62-ec45ddb6bb74 service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Refreshing instance network info cache due to event network-changed-b5248d6e-e587-409e-9b44-ed1a576ff20f. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8dcec867-ce8a-4fff-869a-2f767e1d1f54 req-2c5fbe3f-469c-4c94-8c62-ec45ddb6bb74 service nova] Acquiring lock "refresh_cache-25ab4a8b-372b-42ab-8929-1d8c3262e3ca" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.network.neutron [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.network.neutron [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Updating instance_info_cache with network_info: [{"id": "b5248d6e-e587-409e-9b44-ed1a576ff20f", "address": "fa:16:3e:72:96:4e", "network": {"id": "11050b0f-b7a6-40b1-83ed-f177fe8ff374", "bridge": "br-int", "label": "tempest-TestStampPattern-1875435424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eeadb4c131e45d5a2756825338e5a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5248d6e-e5", "ovs_interfaceid": "b5248d6e-e587-409e-9b44-ed1a576ff20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Releasing lock "refresh_cache-25ab4a8b-372b-42ab-8929-1d8c3262e3ca" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.compute.manager [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Instance network_info: |[{"id": "b5248d6e-e587-409e-9b44-ed1a576ff20f", "address": "fa:16:3e:72:96:4e", "network": {"id": "11050b0f-b7a6-40b1-83ed-f177fe8ff374", "bridge": "br-int", "label": "tempest-TestStampPattern-1875435424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eeadb4c131e45d5a2756825338e5a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5248d6e-e5", "ovs_interfaceid": "b5248d6e-e587-409e-9b44-ed1a576ff20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8dcec867-ce8a-4fff-869a-2f767e1d1f54 req-2c5fbe3f-469c-4c94-8c62-ec45ddb6bb74 service nova] Acquired lock "refresh_cache-25ab4a8b-372b-42ab-8929-1d8c3262e3ca" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.network.neutron [req-8dcec867-ce8a-4fff-869a-2f767e1d1f54 req-2c5fbe3f-469c-4c94-8c62-ec45ddb6bb74 service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Refreshing network info cache for port b5248d6e-e587-409e-9b44-ed1a576ff20f {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Start _get_guest_xml network_info=[{"id": "b5248d6e-e587-409e-9b44-ed1a576ff20f", "address": "fa:16:3e:72:96:4e", "network": {"id": "11050b0f-b7a6-40b1-83ed-f177fe8ff374", "bridge": "br-int", "label": "tempest-TestStampPattern-1875435424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eeadb4c131e45d5a2756825338e5a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5248d6e-e5", "ovs_interfaceid": "b5248d6e-e587-409e-9b44-ed1a576ff20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:35:44 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:35:44 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-453898625',display_name='tempest-TestStampPattern-server-453898625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-453898625',id=47,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNa/gTkhJ7iIlZtCXnubc5rXETxMR2xUqH0IcU5ToxMKsPxgETVhY1EbVW15n7a6qWBKm8+HQ/+QUHZOadI1pzdW0upx9o5IqHzfYPIJA/hjdkH9FBegXsZhGz2BAci2Q==',key_name='tempest-TestStampPattern-825908881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eeadb4c131e45d5a2756825338e5a5d',ramdisk_id='',reservation_id='r-885m1iop',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1480169250',owner_user_name='tempest-TestStampPattern-1480169250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:35:43Z,user_data=None,user_id='70d8f2bbd9f4448096b0991222a32994',uuid=25ab4a8b-372b-42ab-8929-1d8c3262e3ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5248d6e-e587-409e-9b44-ed1a576ff20f", "address": "fa:16:3e:72:96:4e", "network": {"id": "11050b0f-b7a6-40b1-83ed-f177fe8ff374", "bridge": "br-int", "label": "tempest-TestStampPattern-1875435424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eeadb4c131e45d5a2756825338e5a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5248d6e-e5", "ovs_interfaceid": "b5248d6e-e587-409e-9b44-ed1a576ff20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Converting VIF {"id": "b5248d6e-e587-409e-9b44-ed1a576ff20f", "address": "fa:16:3e:72:96:4e", "network": {"id": "11050b0f-b7a6-40b1-83ed-f177fe8ff374", "bridge": "br-int", "label": "tempest-TestStampPattern-1875435424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eeadb4c131e45d5a2756825338e5a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5248d6e-e5", "ovs_interfaceid": "b5248d6e-e587-409e-9b44-ed1a576ff20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:96:4e,bridge_name='br-int',has_traffic_filtering=True,id=b5248d6e-e587-409e-9b44-ed1a576ff20f,network=Network(11050b0f-b7a6-40b1-83ed-f177fe8ff374),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5248d6e-e5') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:35:44 user nova-compute[74898]: DEBUG nova.objects.instance [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lazy-loading 'pci_devices' on Instance uuid 25ab4a8b-372b-42ab-8929-1d8c3262e3ca {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:35:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:35:45 user nova-compute[74898]:   <uuid>25ab4a8b-372b-42ab-8929-1d8c3262e3ca</uuid>
Nov 17 03:35:45 user nova-compute[74898]:   <name>instance-0000002f</name>
Nov 17 03:35:45 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:35:45 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:35:45 user nova-compute[74898]:   <metadata>
Nov 17 03:35:45 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:35:45 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:35:45 user nova-compute[74898]:       <nova:name>tempest-TestStampPattern-server-453898625</nova:name>
Nov 17 03:35:45 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:35:44</nova:creationTime>
Nov 17 03:35:45 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:35:45 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:35:45 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:35:45 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:35:45 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:35:45 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:35:45 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:35:45 user nova-compute[74898]:       <nova:owner>
Nov 17 03:35:45 user nova-compute[74898]:         <nova:user uuid="70d8f2bbd9f4448096b0991222a32994">tempest-TestStampPattern-1480169250-project-member</nova:user>
Nov 17 03:35:45 user nova-compute[74898]:         <nova:project uuid="0eeadb4c131e45d5a2756825338e5a5d">tempest-TestStampPattern-1480169250</nova:project>
Nov 17 03:35:45 user nova-compute[74898]:       </nova:owner>
Nov 17 03:35:45 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:35:45 user nova-compute[74898]:       <nova:ports>
Nov 17 03:35:45 user nova-compute[74898]:         <nova:port uuid="b5248d6e-e587-409e-9b44-ed1a576ff20f">
Nov 17 03:35:45 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 17 03:35:45 user nova-compute[74898]:         </nova:port>
Nov 17 03:35:45 user nova-compute[74898]:       </nova:ports>
Nov 17 03:35:45 user nova-compute[74898]:     </nova:instance>
Nov 17 03:35:45 user nova-compute[74898]:   </metadata>
Nov 17 03:35:45 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:35:45 user nova-compute[74898]:     <system>
Nov 17 03:35:45 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:35:45 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:35:45 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:35:45 user nova-compute[74898]:       <entry name="serial">25ab4a8b-372b-42ab-8929-1d8c3262e3ca</entry>
Nov 17 03:35:45 user nova-compute[74898]:       <entry name="uuid">25ab4a8b-372b-42ab-8929-1d8c3262e3ca</entry>
Nov 17 03:35:45 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:35:45 user nova-compute[74898]:     </system>
Nov 17 03:35:45 user nova-compute[74898]:   </sysinfo>
Nov 17 03:35:45 user nova-compute[74898]:   <os>
Nov 17 03:35:45 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:35:45 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:35:45 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:35:45 user nova-compute[74898]:   </os>
Nov 17 03:35:45 user nova-compute[74898]:   <features>
Nov 17 03:35:45 user nova-compute[74898]:     <acpi/>
Nov 17 03:35:45 user nova-compute[74898]:     <apic/>
Nov 17 03:35:45 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:35:45 user nova-compute[74898]:   </features>
Nov 17 03:35:45 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:35:45 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:35:45 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:35:45 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:35:45 user nova-compute[74898]:   </clock>
Nov 17 03:35:45 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:35:45 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:35:45 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:35:45 user nova-compute[74898]:   </cpu>
Nov 17 03:35:45 user nova-compute[74898]:   <devices>
Nov 17 03:35:45 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:35:45 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:35:45 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk"/>
Nov 17 03:35:45 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:35:45 user nova-compute[74898]:     </disk>
Nov 17 03:35:45 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:35:45 user nova-compute[74898]:       <mac address="fa:16:3e:72:96:4e"/>
Nov 17 03:35:45 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:35:45 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:35:45 user nova-compute[74898]:       <target dev="tapb5248d6e-e5"/>
Nov 17 03:35:45 user nova-compute[74898]:     </interface>
Nov 17 03:35:45 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:35:45 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/console.log" append="off"/>
Nov 17 03:35:45 user nova-compute[74898]:     </serial>
Nov 17 03:35:45 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:35:45 user nova-compute[74898]:     <video>
Nov 17 03:35:45 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:35:45 user nova-compute[74898]:     </video>
Nov 17 03:35:45 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:35:45 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:35:45 user nova-compute[74898]:     </rng>
Nov 17 03:35:45 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:35:45 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:35:45 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:35:45 user nova-compute[74898]:     </memballoon>
Nov 17 03:35:45 user nova-compute[74898]:   </devices>
Nov 17 03:35:45 user nova-compute[74898]: </domain>
Nov 17 03:35:45 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:35:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-453898625',display_name='tempest-TestStampPattern-server-453898625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-453898625',id=47,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNa/gTkhJ7iIlZtCXnubc5rXETxMR2xUqH0IcU5ToxMKsPxgETVhY1EbVW15n7a6qWBKm8+HQ/+QUHZOadI1pzdW0upx9o5IqHzfYPIJA/hjdkH9FBegXsZhGz2BAci2Q==',key_name='tempest-TestStampPattern-825908881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eeadb4c131e45d5a2756825338e5a5d',ramdisk_id='',reservation_id='r-885m1iop',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1480169250',owner_user_name='tempest-TestStampPattern-1480169250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:35:43Z,user_data=None,user_id='70d8f2bbd9f4448096b0991222a32994',uuid=25ab4a8b-372b-42ab-8929-1d8c3262e3ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5248d6e-e587-409e-9b44-ed1a576ff20f", "address": "fa:16:3e:72:96:4e", "network": {"id": "11050b0f-b7a6-40b1-83ed-f177fe8ff374", "bridge": "br-int", "label": "tempest-TestStampPattern-1875435424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eeadb4c131e45d5a2756825338e5a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5248d6e-e5", "ovs_interfaceid": "b5248d6e-e587-409e-9b44-ed1a576ff20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:35:45 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Converting VIF {"id": "b5248d6e-e587-409e-9b44-ed1a576ff20f", "address": "fa:16:3e:72:96:4e", "network": {"id": "11050b0f-b7a6-40b1-83ed-f177fe8ff374", "bridge": "br-int", "label": "tempest-TestStampPattern-1875435424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eeadb4c131e45d5a2756825338e5a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5248d6e-e5", "ovs_interfaceid": "b5248d6e-e587-409e-9b44-ed1a576ff20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:35:45 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:96:4e,bridge_name='br-int',has_traffic_filtering=True,id=b5248d6e-e587-409e-9b44-ed1a576ff20f,network=Network(11050b0f-b7a6-40b1-83ed-f177fe8ff374),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5248d6e-e5') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:35:45 user nova-compute[74898]: DEBUG os_vif [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:96:4e,bridge_name='br-int',has_traffic_filtering=True,id=b5248d6e-e587-409e-9b44-ed1a576ff20f,network=Network(11050b0f-b7a6-40b1-83ed-f177fe8ff374),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5248d6e-e5') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:35:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:35:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:35:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '23a36b05-4777-5969-83e9-2042d9fb64b9', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:35:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:35:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5248d6e-e5, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:35:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb5248d6e-e5, col_values=(('qos', UUID('18404af9-2e8e-4705-923c-3e03ee5f1863')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:35:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb5248d6e-e5, col_values=(('external_ids', {'iface-id': 'b5248d6e-e587-409e-9b44-ed1a576ff20f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:96:4e', 'vm-uuid': '25ab4a8b-372b-42ab-8929-1d8c3262e3ca'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:35:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:35:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:45 user nova-compute[74898]: INFO os_vif [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:96:4e,bridge_name='br-int',has_traffic_filtering=True,id=b5248d6e-e587-409e-9b44-ed1a576ff20f,network=Network(11050b0f-b7a6-40b1-83ed-f177fe8ff374),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5248d6e-e5')
Nov 17 03:35:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:35:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] No VIF found with MAC fa:16:3e:72:96:4e, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:35:45 user nova-compute[74898]: DEBUG nova.network.neutron [req-8dcec867-ce8a-4fff-869a-2f767e1d1f54 req-2c5fbe3f-469c-4c94-8c62-ec45ddb6bb74 service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Updated VIF entry in instance network info cache for port b5248d6e-e587-409e-9b44-ed1a576ff20f. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:35:45 user nova-compute[74898]: DEBUG nova.network.neutron [req-8dcec867-ce8a-4fff-869a-2f767e1d1f54 req-2c5fbe3f-469c-4c94-8c62-ec45ddb6bb74 service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Updating instance_info_cache with network_info: [{"id": "b5248d6e-e587-409e-9b44-ed1a576ff20f", "address": "fa:16:3e:72:96:4e", "network": {"id": "11050b0f-b7a6-40b1-83ed-f177fe8ff374", "bridge": "br-int", "label": "tempest-TestStampPattern-1875435424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eeadb4c131e45d5a2756825338e5a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5248d6e-e5", "ovs_interfaceid": "b5248d6e-e587-409e-9b44-ed1a576ff20f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:35:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-8dcec867-ce8a-4fff-869a-2f767e1d1f54 req-2c5fbe3f-469c-4c94-8c62-ec45ddb6bb74 service nova] Releasing lock "refresh_cache-25ab4a8b-372b-42ab-8929-1d8c3262e3ca" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:35:45 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:35:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:46 user nova-compute[74898]: DEBUG nova.compute.manager [req-18e7aee1-d7a7-4d74-8aba-ff78b4a0a11c req-7a1c5c28-7ea2-41b9-9a21-1537c6dd2f70 service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Received event network-vif-plugged-b5248d6e-e587-409e-9b44-ed1a576ff20f {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:35:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-18e7aee1-d7a7-4d74-8aba-ff78b4a0a11c req-7a1c5c28-7ea2-41b9-9a21-1537c6dd2f70 service nova] Acquiring lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:35:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-18e7aee1-d7a7-4d74-8aba-ff78b4a0a11c req-7a1c5c28-7ea2-41b9-9a21-1537c6dd2f70 service nova] Lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:35:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-18e7aee1-d7a7-4d74-8aba-ff78b4a0a11c req-7a1c5c28-7ea2-41b9-9a21-1537c6dd2f70 service nova] Lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:35:46 user nova-compute[74898]: DEBUG nova.compute.manager [req-18e7aee1-d7a7-4d74-8aba-ff78b4a0a11c req-7a1c5c28-7ea2-41b9-9a21-1537c6dd2f70 service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] No waiting events found dispatching network-vif-plugged-b5248d6e-e587-409e-9b44-ed1a576ff20f {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:35:46 user nova-compute[74898]: WARNING nova.compute.manager [req-18e7aee1-d7a7-4d74-8aba-ff78b4a0a11c req-7a1c5c28-7ea2-41b9-9a21-1537c6dd2f70 service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Received unexpected event network-vif-plugged-b5248d6e-e587-409e-9b44-ed1a576ff20f for instance with vm_state building and task_state spawning.
Nov 17 03:35:46 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:35:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:47 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:35:48 user nova-compute[74898]: DEBUG nova.compute.manager [req-bda989bd-7a75-4382-bf63-84e0bfff13a4 req-af657f29-b6ba-4e65-97ae-0a53a604c2de service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Received event network-vif-plugged-b5248d6e-e587-409e-9b44-ed1a576ff20f {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:35:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-bda989bd-7a75-4382-bf63-84e0bfff13a4 req-af657f29-b6ba-4e65-97ae-0a53a604c2de service nova] Acquiring lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:35:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-bda989bd-7a75-4382-bf63-84e0bfff13a4 req-af657f29-b6ba-4e65-97ae-0a53a604c2de service nova] Lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:35:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-bda989bd-7a75-4382-bf63-84e0bfff13a4 req-af657f29-b6ba-4e65-97ae-0a53a604c2de service nova] Lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:35:48 user nova-compute[74898]: DEBUG nova.compute.manager [req-bda989bd-7a75-4382-bf63-84e0bfff13a4 req-af657f29-b6ba-4e65-97ae-0a53a604c2de service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] No waiting events found dispatching network-vif-plugged-b5248d6e-e587-409e-9b44-ed1a576ff20f {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:35:48 user nova-compute[74898]: WARNING nova.compute.manager [req-bda989bd-7a75-4382-bf63-84e0bfff13a4 req-af657f29-b6ba-4e65-97ae-0a53a604c2de service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Received unexpected event network-vif-plugged-b5248d6e-e587-409e-9b44-ed1a576ff20f for instance with vm_state building and task_state spawning.
Nov 17 03:35:48 user nova-compute[74898]: DEBUG nova.compute.manager [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:35:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:35:48 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Instance spawned successfully.
Nov 17 03:35:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:35:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:35:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:35:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:35:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:35:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:35:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:35:48 user nova-compute[74898]: INFO nova.compute.manager [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Took 5.59 seconds to spawn the instance on the hypervisor.
Nov 17 03:35:48 user nova-compute[74898]: DEBUG nova.compute.manager [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:35:48 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:35:48 user nova-compute[74898]: INFO nova.compute.manager [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Took 6.13 seconds to build instance.
Nov 17 03:35:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4e4098e6-c452-4d3a-90a7-6883b2fa21a7 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.241s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:35:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:50 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:35:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:35:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:35:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:35:50 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:35:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4927b642-dca5-4599-b45b-efcace11002a/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4927b642-dca5-4599-b45b-efcace11002a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4927b642-dca5-4599-b45b-efcace11002a/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:35:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4927b642-dca5-4599-b45b-efcace11002a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:35:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:52 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:35:52 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:35:52 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=8793MB free_disk=25.293262481689453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:35:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:35:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:35:52 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 4927b642-dca5-4599-b45b-efcace11002a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:35:52 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 25ab4a8b-372b-42ab-8929-1d8c3262e3ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:35:52 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:35:52 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:35:52 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Refreshing inventories for resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 17 03:35:52 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Updating ProviderTree inventory for provider b743bdc9-a8bb-467c-98c8-06f1954f87df from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 17 03:35:52 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Updating inventory in ProviderTree for provider b743bdc9-a8bb-467c-98c8-06f1954f87df with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 17 03:35:52 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Refreshing aggregate associations for resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df, aggregates: None {{(pid=74898) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 17 03:35:52 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Refreshing trait associations for resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=74898) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 17 03:35:52 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:35:52 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:35:52 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:35:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.537s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:35:53 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:35:53 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:35:53 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:35:53 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:35:53 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Rebuilding the list of instances to heal {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 03:35:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-4927b642-dca5-4599-b45b-efcace11002a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:35:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-4927b642-dca5-4599-b45b-efcace11002a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:35:54 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:35:54 user nova-compute[74898]: DEBUG nova.objects.instance [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lazy-loading 'info_cache' on Instance uuid 4927b642-dca5-4599-b45b-efcace11002a {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:35:54 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Updating instance_info_cache with network_info: [{"id": "ef217a49-2a6e-44c2-b1d7-66ca523d28fb", "address": "fa:16:3e:0d:54:94", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef217a49-2a", "ovs_interfaceid": "ef217a49-2a6e-44c2-b1d7-66ca523d28fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:35:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-4927b642-dca5-4599-b45b-efcace11002a" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:35:54 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:35:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:35:58 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:35:58 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Cleaning up deleted instances {{(pid=74898) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 17 03:35:58 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] There are 0 instances to clean {{(pid=74898) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 17 03:35:58 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:35:58 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Cleaning up deleted instances with incomplete migration  {{(pid=74898) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 17 03:36:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:36:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-73acf329-9868-4e70-8e38-80d16b04e4be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "4927b642-dca5-4599-b45b-efcace11002a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:36:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-73acf329-9868-4e70-8e38-80d16b04e4be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "4927b642-dca5-4599-b45b-efcace11002a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:36:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-73acf329-9868-4e70-8e38-80d16b04e4be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "4927b642-dca5-4599-b45b-efcace11002a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:36:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-73acf329-9868-4e70-8e38-80d16b04e4be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "4927b642-dca5-4599-b45b-efcace11002a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:36:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-73acf329-9868-4e70-8e38-80d16b04e4be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "4927b642-dca5-4599-b45b-efcace11002a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:36:05 user nova-compute[74898]: INFO nova.compute.manager [None req-73acf329-9868-4e70-8e38-80d16b04e4be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Terminating instance
Nov 17 03:36:05 user nova-compute[74898]: DEBUG nova.compute.manager [None req-73acf329-9868-4e70-8e38-80d16b04e4be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:36:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:05 user nova-compute[74898]: DEBUG nova.compute.manager [req-35421776-a4d6-4858-94d4-47b63f6db981 req-1aefd18d-cde5-4578-b4f5-91bf9e83dbfa service nova] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Received event network-vif-unplugged-ef217a49-2a6e-44c2-b1d7-66ca523d28fb {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:36:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-35421776-a4d6-4858-94d4-47b63f6db981 req-1aefd18d-cde5-4578-b4f5-91bf9e83dbfa service nova] Acquiring lock "4927b642-dca5-4599-b45b-efcace11002a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:36:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-35421776-a4d6-4858-94d4-47b63f6db981 req-1aefd18d-cde5-4578-b4f5-91bf9e83dbfa service nova] Lock "4927b642-dca5-4599-b45b-efcace11002a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:36:05 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-35421776-a4d6-4858-94d4-47b63f6db981 req-1aefd18d-cde5-4578-b4f5-91bf9e83dbfa service nova] Lock "4927b642-dca5-4599-b45b-efcace11002a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:36:05 user nova-compute[74898]: DEBUG nova.compute.manager [req-35421776-a4d6-4858-94d4-47b63f6db981 req-1aefd18d-cde5-4578-b4f5-91bf9e83dbfa service nova] [instance: 4927b642-dca5-4599-b45b-efcace11002a] No waiting events found dispatching network-vif-unplugged-ef217a49-2a6e-44c2-b1d7-66ca523d28fb {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:36:05 user nova-compute[74898]: DEBUG nova.compute.manager [req-35421776-a4d6-4858-94d4-47b63f6db981 req-1aefd18d-cde5-4578-b4f5-91bf9e83dbfa service nova] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Received event network-vif-unplugged-ef217a49-2a6e-44c2-b1d7-66ca523d28fb for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:36:06 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Instance destroyed successfully.
Nov 17 03:36:06 user nova-compute[74898]: DEBUG nova.objects.instance [None req-73acf329-9868-4e70-8e38-80d16b04e4be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lazy-loading 'resources' on Instance uuid 4927b642-dca5-4599-b45b-efcace11002a {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:36:06 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-73acf329-9868-4e70-8e38-80d16b04e4be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-694291473',display_name='tempest-AttachVolumeNegativeTest-server-694291473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-694291473',id=46,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGTMIN/5pF6ON811rFap+QNR24qAZ7ojvpj7A4JsUitd8savizEOR/++pNvUA9Tm+2JOOmD36LDAcKaQdiDg7cVbO2aA72G8TX+fZW0teZLa+cib0YoVQ1Gisi3aUCM3w==',key_name='tempest-keypair-2129379624',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:33:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='498d9d0f6667441791a7175256e4c557',ramdisk_id='',reservation_id='r-0q24v008',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1401299497',owner_user_name='tempest-AttachVolumeNegativeTest-1401299497-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:33:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7660b84c605b4a459065b10fda42043f',uuid=4927b642-dca5-4599-b45b-efcace11002a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef217a49-2a6e-44c2-b1d7-66ca523d28fb", "address": "fa:16:3e:0d:54:94", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef217a49-2a", "ovs_interfaceid": "ef217a49-2a6e-44c2-b1d7-66ca523d28fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:36:06 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-73acf329-9868-4e70-8e38-80d16b04e4be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Converting VIF {"id": "ef217a49-2a6e-44c2-b1d7-66ca523d28fb", "address": "fa:16:3e:0d:54:94", "network": {"id": "d02a6f85-70ee-4ed7-ae00-decabd94d542", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1382885210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "498d9d0f6667441791a7175256e4c557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef217a49-2a", "ovs_interfaceid": "ef217a49-2a6e-44c2-b1d7-66ca523d28fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:36:06 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-73acf329-9868-4e70-8e38-80d16b04e4be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:54:94,bridge_name='br-int',has_traffic_filtering=True,id=ef217a49-2a6e-44c2-b1d7-66ca523d28fb,network=Network(d02a6f85-70ee-4ed7-ae00-decabd94d542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef217a49-2a') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:36:06 user nova-compute[74898]: DEBUG os_vif [None req-73acf329-9868-4e70-8e38-80d16b04e4be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:54:94,bridge_name='br-int',has_traffic_filtering=True,id=ef217a49-2a6e-44c2-b1d7-66ca523d28fb,network=Network(d02a6f85-70ee-4ed7-ae00-decabd94d542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef217a49-2a') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:36:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef217a49-2a, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:36:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:36:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b033fb8-574b-4d94-bb8e-18354692322a) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:36:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:06 user nova-compute[74898]: INFO os_vif [None req-73acf329-9868-4e70-8e38-80d16b04e4be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:54:94,bridge_name='br-int',has_traffic_filtering=True,id=ef217a49-2a6e-44c2-b1d7-66ca523d28fb,network=Network(d02a6f85-70ee-4ed7-ae00-decabd94d542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef217a49-2a')
Nov 17 03:36:06 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-73acf329-9868-4e70-8e38-80d16b04e4be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Deleting instance files /opt/stack/data/nova/instances/4927b642-dca5-4599-b45b-efcace11002a_del
Nov 17 03:36:06 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-73acf329-9868-4e70-8e38-80d16b04e4be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Deletion of /opt/stack/data/nova/instances/4927b642-dca5-4599-b45b-efcace11002a_del complete
Nov 17 03:36:06 user nova-compute[74898]: INFO nova.compute.manager [None req-73acf329-9868-4e70-8e38-80d16b04e4be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 17 03:36:06 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-73acf329-9868-4e70-8e38-80d16b04e4be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:36:06 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:36:06 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 4927b642-dca5-4599-b45b-efcace11002a] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:36:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:07 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:36:07 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Took 0.63 seconds to deallocate network for instance.
Nov 17 03:36:07 user nova-compute[74898]: DEBUG nova.compute.manager [req-356473ea-1dca-4300-b59a-a6c8b68261fe req-bd2b62b8-f334-4c50-836c-2bc99a627d1f service nova] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Received event network-vif-deleted-ef217a49-2a6e-44c2-b1d7-66ca523d28fb {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:36:07 user nova-compute[74898]: INFO nova.compute.manager [req-356473ea-1dca-4300-b59a-a6c8b68261fe req-bd2b62b8-f334-4c50-836c-2bc99a627d1f service nova] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Neutron deleted interface ef217a49-2a6e-44c2-b1d7-66ca523d28fb; detaching it from the instance and deleting it from the info cache
Nov 17 03:36:07 user nova-compute[74898]: DEBUG nova.network.neutron [req-356473ea-1dca-4300-b59a-a6c8b68261fe req-bd2b62b8-f334-4c50-836c-2bc99a627d1f service nova] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:36:07 user nova-compute[74898]: DEBUG nova.compute.manager [req-356473ea-1dca-4300-b59a-a6c8b68261fe req-bd2b62b8-f334-4c50-836c-2bc99a627d1f service nova] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Detach interface failed, port_id=ef217a49-2a6e-44c2-b1d7-66ca523d28fb, reason: Instance 4927b642-dca5-4599-b45b-efcace11002a could not be found. {{(pid=74898) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 03:36:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-73acf329-9868-4e70-8e38-80d16b04e4be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:36:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-73acf329-9868-4e70-8e38-80d16b04e4be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:36:07 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-73acf329-9868-4e70-8e38-80d16b04e4be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:36:07 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-73acf329-9868-4e70-8e38-80d16b04e4be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:36:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-73acf329-9868-4e70-8e38-80d16b04e4be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:36:07 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-73acf329-9868-4e70-8e38-80d16b04e4be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Deleted allocations for instance 4927b642-dca5-4599-b45b-efcace11002a
Nov 17 03:36:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-73acf329-9868-4e70-8e38-80d16b04e4be tempest-AttachVolumeNegativeTest-1401299497 tempest-AttachVolumeNegativeTest-1401299497-project-member] Lock "4927b642-dca5-4599-b45b-efcace11002a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.848s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:36:07 user nova-compute[74898]: DEBUG nova.compute.manager [req-fd0d5acb-04db-4eff-81d1-d1244fbd54d9 req-f56a0944-0643-4bf5-830b-17ff361b2329 service nova] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Received event network-vif-plugged-ef217a49-2a6e-44c2-b1d7-66ca523d28fb {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:36:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fd0d5acb-04db-4eff-81d1-d1244fbd54d9 req-f56a0944-0643-4bf5-830b-17ff361b2329 service nova] Acquiring lock "4927b642-dca5-4599-b45b-efcace11002a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:36:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fd0d5acb-04db-4eff-81d1-d1244fbd54d9 req-f56a0944-0643-4bf5-830b-17ff361b2329 service nova] Lock "4927b642-dca5-4599-b45b-efcace11002a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:36:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fd0d5acb-04db-4eff-81d1-d1244fbd54d9 req-f56a0944-0643-4bf5-830b-17ff361b2329 service nova] Lock "4927b642-dca5-4599-b45b-efcace11002a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:36:07 user nova-compute[74898]: DEBUG nova.compute.manager [req-fd0d5acb-04db-4eff-81d1-d1244fbd54d9 req-f56a0944-0643-4bf5-830b-17ff361b2329 service nova] [instance: 4927b642-dca5-4599-b45b-efcace11002a] No waiting events found dispatching network-vif-plugged-ef217a49-2a6e-44c2-b1d7-66ca523d28fb {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:36:07 user nova-compute[74898]: WARNING nova.compute.manager [req-fd0d5acb-04db-4eff-81d1-d1244fbd54d9 req-f56a0944-0643-4bf5-830b-17ff361b2329 service nova] [instance: 4927b642-dca5-4599-b45b-efcace11002a] Received unexpected event network-vif-plugged-ef217a49-2a6e-44c2-b1d7-66ca523d28fb for instance with vm_state deleted and task_state None.
Nov 17 03:36:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:13 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:36:14 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:16 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:16 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "98ced818-ad9a-4020-9f2b-2520934530ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:36:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "98ced818-ad9a-4020-9f2b-2520934530ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:36:20 user nova-compute[74898]: DEBUG nova.compute.manager [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:36:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:36:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:36:20 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:36:20 user nova-compute[74898]: INFO nova.compute.claims [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Claim successful on node user
Nov 17 03:36:20 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:36:20 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:36:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.210s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:36:20 user nova-compute[74898]: DEBUG nova.compute.manager [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:36:20 user nova-compute[74898]: DEBUG nova.compute.manager [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:36:20 user nova-compute[74898]: DEBUG nova.network.neutron [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:36:20 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:36:20 user nova-compute[74898]: DEBUG nova.compute.manager [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:36:20 user nova-compute[74898]: DEBUG nova.policy [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f5ff5df400134e05ba0df6989298b04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de3683d8d2c4bafbd516c6d80c8486d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:36:20 user nova-compute[74898]: DEBUG nova.compute.manager [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:36:20 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:36:20 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Creating image(s)
Nov 17 03:36:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "/opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:36:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "/opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:36:20 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "/opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:36:20 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:36:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.180s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:36:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:36:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:36:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:36:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:36:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:36:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk 1073741824" returned: 0 in 0.049s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:36:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:36:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:36:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:21 user nova-compute[74898]: DEBUG nova.network.neutron [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Successfully created port: 0ee25c23-7b34-488e-97b1-db66f921a502 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:36:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.181s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:36:21 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Checking if we can resize image /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:36:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:36:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:36:21 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Cannot resize image /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:36:21 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:36:21 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Ensure instance console log exists: /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:36:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:36:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:36:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:36:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:21 user nova-compute[74898]: DEBUG nova.network.neutron [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Successfully updated port: 0ee25c23-7b34-488e-97b1-db66f921a502 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "refresh_cache-98ced818-ad9a-4020-9f2b-2520934530ba" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquired lock "refresh_cache-98ced818-ad9a-4020-9f2b-2520934530ba" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.network.neutron [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.compute.manager [req-a4105209-a8ba-44b3-9bf7-e95ba682a6f1 req-c3025015-4fd6-416c-9840-ac64e76b623e service nova] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Received event network-changed-0ee25c23-7b34-488e-97b1-db66f921a502 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.compute.manager [req-a4105209-a8ba-44b3-9bf7-e95ba682a6f1 req-c3025015-4fd6-416c-9840-ac64e76b623e service nova] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Refreshing instance network info cache due to event network-changed-0ee25c23-7b34-488e-97b1-db66f921a502. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a4105209-a8ba-44b3-9bf7-e95ba682a6f1 req-c3025015-4fd6-416c-9840-ac64e76b623e service nova] Acquiring lock "refresh_cache-98ced818-ad9a-4020-9f2b-2520934530ba" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.network.neutron [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.network.neutron [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Updating instance_info_cache with network_info: [{"id": "0ee25c23-7b34-488e-97b1-db66f921a502", "address": "fa:16:3e:82:10:be", "network": {"id": "9efcfeea-8c01-45a8-8a77-3d6a18c71729", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-925876126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8de3683d8d2c4bafbd516c6d80c8486d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee25c23-7b", "ovs_interfaceid": "0ee25c23-7b34-488e-97b1-db66f921a502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Releasing lock "refresh_cache-98ced818-ad9a-4020-9f2b-2520934530ba" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.compute.manager [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Instance network_info: |[{"id": "0ee25c23-7b34-488e-97b1-db66f921a502", "address": "fa:16:3e:82:10:be", "network": {"id": "9efcfeea-8c01-45a8-8a77-3d6a18c71729", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-925876126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8de3683d8d2c4bafbd516c6d80c8486d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee25c23-7b", "ovs_interfaceid": "0ee25c23-7b34-488e-97b1-db66f921a502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a4105209-a8ba-44b3-9bf7-e95ba682a6f1 req-c3025015-4fd6-416c-9840-ac64e76b623e service nova] Acquired lock "refresh_cache-98ced818-ad9a-4020-9f2b-2520934530ba" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.network.neutron [req-a4105209-a8ba-44b3-9bf7-e95ba682a6f1 req-c3025015-4fd6-416c-9840-ac64e76b623e service nova] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Refreshing network info cache for port 0ee25c23-7b34-488e-97b1-db66f921a502 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Start _get_guest_xml network_info=[{"id": "0ee25c23-7b34-488e-97b1-db66f921a502", "address": "fa:16:3e:82:10:be", "network": {"id": "9efcfeea-8c01-45a8-8a77-3d6a18c71729", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-925876126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8de3683d8d2c4bafbd516c6d80c8486d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee25c23-7b", "ovs_interfaceid": "0ee25c23-7b34-488e-97b1-db66f921a502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:36:22 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:36:22 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:36:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-891970474',display_name='tempest-SnapshotDataIntegrityTests-server-891970474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-891970474',id=48,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5N5kv1/X6BvvVIpVMY3J3yGM4LlsolUTF4o+ogvuEtBoysNuYB772Whjwi0FLOBAeii9gytyn8vgTnEd9kanM4223OFgoZ18MTVKtPi5gC1h0CW6mlGU7s8dNtMasxJQ==',key_name='tempest-keypair-1286091422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8de3683d8d2c4bafbd516c6d80c8486d',ramdisk_id='',reservation_id='r-e1hxt5g6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1758564164',owner_user_name='tempest-SnapshotDataIntegrityTests-1758564164-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:36:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5ff5df400134e05ba0df6989298b04a',uuid=98ced818-ad9a-4020-9f2b-2520934530ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ee25c23-7b34-488e-97b1-db66f921a502", "address": "fa:16:3e:82:10:be", "network": {"id": "9efcfeea-8c01-45a8-8a77-3d6a18c71729", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-925876126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8de3683d8d2c4bafbd516c6d80c8486d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee25c23-7b", "ovs_interfaceid": "0ee25c23-7b34-488e-97b1-db66f921a502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Converting VIF {"id": "0ee25c23-7b34-488e-97b1-db66f921a502", "address": "fa:16:3e:82:10:be", "network": {"id": "9efcfeea-8c01-45a8-8a77-3d6a18c71729", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-925876126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8de3683d8d2c4bafbd516c6d80c8486d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee25c23-7b", "ovs_interfaceid": "0ee25c23-7b34-488e-97b1-db66f921a502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:10:be,bridge_name='br-int',has_traffic_filtering=True,id=0ee25c23-7b34-488e-97b1-db66f921a502,network=Network(9efcfeea-8c01-45a8-8a77-3d6a18c71729),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee25c23-7b') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.objects.instance [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lazy-loading 'pci_devices' on Instance uuid 98ced818-ad9a-4020-9f2b-2520934530ba {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:36:22 user nova-compute[74898]:   <uuid>98ced818-ad9a-4020-9f2b-2520934530ba</uuid>
Nov 17 03:36:22 user nova-compute[74898]:   <name>instance-00000030</name>
Nov 17 03:36:22 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:36:22 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:36:22 user nova-compute[74898]:   <metadata>
Nov 17 03:36:22 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:36:22 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:36:22 user nova-compute[74898]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-891970474</nova:name>
Nov 17 03:36:22 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:36:22</nova:creationTime>
Nov 17 03:36:22 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:36:22 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:36:22 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:36:22 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:36:22 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:36:22 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:36:22 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:36:22 user nova-compute[74898]:       <nova:owner>
Nov 17 03:36:22 user nova-compute[74898]:         <nova:user uuid="f5ff5df400134e05ba0df6989298b04a">tempest-SnapshotDataIntegrityTests-1758564164-project-member</nova:user>
Nov 17 03:36:22 user nova-compute[74898]:         <nova:project uuid="8de3683d8d2c4bafbd516c6d80c8486d">tempest-SnapshotDataIntegrityTests-1758564164</nova:project>
Nov 17 03:36:22 user nova-compute[74898]:       </nova:owner>
Nov 17 03:36:22 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:36:22 user nova-compute[74898]:       <nova:ports>
Nov 17 03:36:22 user nova-compute[74898]:         <nova:port uuid="0ee25c23-7b34-488e-97b1-db66f921a502">
Nov 17 03:36:22 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 17 03:36:22 user nova-compute[74898]:         </nova:port>
Nov 17 03:36:22 user nova-compute[74898]:       </nova:ports>
Nov 17 03:36:22 user nova-compute[74898]:     </nova:instance>
Nov 17 03:36:22 user nova-compute[74898]:   </metadata>
Nov 17 03:36:22 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:36:22 user nova-compute[74898]:     <system>
Nov 17 03:36:22 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:36:22 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:36:22 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:36:22 user nova-compute[74898]:       <entry name="serial">98ced818-ad9a-4020-9f2b-2520934530ba</entry>
Nov 17 03:36:22 user nova-compute[74898]:       <entry name="uuid">98ced818-ad9a-4020-9f2b-2520934530ba</entry>
Nov 17 03:36:22 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:36:22 user nova-compute[74898]:     </system>
Nov 17 03:36:22 user nova-compute[74898]:   </sysinfo>
Nov 17 03:36:22 user nova-compute[74898]:   <os>
Nov 17 03:36:22 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:36:22 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:36:22 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:36:22 user nova-compute[74898]:   </os>
Nov 17 03:36:22 user nova-compute[74898]:   <features>
Nov 17 03:36:22 user nova-compute[74898]:     <acpi/>
Nov 17 03:36:22 user nova-compute[74898]:     <apic/>
Nov 17 03:36:22 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:36:22 user nova-compute[74898]:   </features>
Nov 17 03:36:22 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:36:22 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:36:22 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:36:22 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:36:22 user nova-compute[74898]:   </clock>
Nov 17 03:36:22 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:36:22 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:36:22 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:36:22 user nova-compute[74898]:   </cpu>
Nov 17 03:36:22 user nova-compute[74898]:   <devices>
Nov 17 03:36:22 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:36:22 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:36:22 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk"/>
Nov 17 03:36:22 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:36:22 user nova-compute[74898]:     </disk>
Nov 17 03:36:22 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:36:22 user nova-compute[74898]:       <mac address="fa:16:3e:82:10:be"/>
Nov 17 03:36:22 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:36:22 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:36:22 user nova-compute[74898]:       <target dev="tap0ee25c23-7b"/>
Nov 17 03:36:22 user nova-compute[74898]:     </interface>
Nov 17 03:36:22 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:36:22 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/console.log" append="off"/>
Nov 17 03:36:22 user nova-compute[74898]:     </serial>
Nov 17 03:36:22 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:36:22 user nova-compute[74898]:     <video>
Nov 17 03:36:22 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:36:22 user nova-compute[74898]:     </video>
Nov 17 03:36:22 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:36:22 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:36:22 user nova-compute[74898]:     </rng>
Nov 17 03:36:22 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:36:22 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:36:22 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:36:22 user nova-compute[74898]:     </memballoon>
Nov 17 03:36:22 user nova-compute[74898]:   </devices>
Nov 17 03:36:22 user nova-compute[74898]: </domain>
Nov 17 03:36:22 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:36:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-891970474',display_name='tempest-SnapshotDataIntegrityTests-server-891970474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-891970474',id=48,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5N5kv1/X6BvvVIpVMY3J3yGM4LlsolUTF4o+ogvuEtBoysNuYB772Whjwi0FLOBAeii9gytyn8vgTnEd9kanM4223OFgoZ18MTVKtPi5gC1h0CW6mlGU7s8dNtMasxJQ==',key_name='tempest-keypair-1286091422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8de3683d8d2c4bafbd516c6d80c8486d',ramdisk_id='',reservation_id='r-e1hxt5g6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1758564164',owner_user_name='tempest-SnapshotDataIntegrityTests-1758564164-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:36:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5ff5df400134e05ba0df6989298b04a',uuid=98ced818-ad9a-4020-9f2b-2520934530ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ee25c23-7b34-488e-97b1-db66f921a502", "address": "fa:16:3e:82:10:be", "network": {"id": "9efcfeea-8c01-45a8-8a77-3d6a18c71729", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-925876126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8de3683d8d2c4bafbd516c6d80c8486d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee25c23-7b", "ovs_interfaceid": "0ee25c23-7b34-488e-97b1-db66f921a502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Converting VIF {"id": "0ee25c23-7b34-488e-97b1-db66f921a502", "address": "fa:16:3e:82:10:be", "network": {"id": "9efcfeea-8c01-45a8-8a77-3d6a18c71729", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-925876126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8de3683d8d2c4bafbd516c6d80c8486d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee25c23-7b", "ovs_interfaceid": "0ee25c23-7b34-488e-97b1-db66f921a502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:10:be,bridge_name='br-int',has_traffic_filtering=True,id=0ee25c23-7b34-488e-97b1-db66f921a502,network=Network(9efcfeea-8c01-45a8-8a77-3d6a18c71729),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee25c23-7b') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG os_vif [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:10:be,bridge_name='br-int',has_traffic_filtering=True,id=0ee25c23-7b34-488e-97b1-db66f921a502,network=Network(9efcfeea-8c01-45a8-8a77-3d6a18c71729),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee25c23-7b') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5335f4b-7ffc-504b-bfa7-0a1cb6783876', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ee25c23-7b, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ee25c23-7b, col_values=(('qos', UUID('fe2b958f-bac7-46bd-b080-0395d7332fa9')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ee25c23-7b, col_values=(('external_ids', {'iface-id': '0ee25c23-7b34-488e-97b1-db66f921a502', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:10:be', 'vm-uuid': '98ced818-ad9a-4020-9f2b-2520934530ba'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:22 user nova-compute[74898]: INFO os_vif [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:10:be,bridge_name='br-int',has_traffic_filtering=True,id=0ee25c23-7b34-488e-97b1-db66f921a502,network=Network(9efcfeea-8c01-45a8-8a77-3d6a18c71729),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee25c23-7b')
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] No VIF found with MAC fa:16:3e:82:10:be, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.network.neutron [req-a4105209-a8ba-44b3-9bf7-e95ba682a6f1 req-c3025015-4fd6-416c-9840-ac64e76b623e service nova] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Updated VIF entry in instance network info cache for port 0ee25c23-7b34-488e-97b1-db66f921a502. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG nova.network.neutron [req-a4105209-a8ba-44b3-9bf7-e95ba682a6f1 req-c3025015-4fd6-416c-9840-ac64e76b623e service nova] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Updating instance_info_cache with network_info: [{"id": "0ee25c23-7b34-488e-97b1-db66f921a502", "address": "fa:16:3e:82:10:be", "network": {"id": "9efcfeea-8c01-45a8-8a77-3d6a18c71729", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-925876126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8de3683d8d2c4bafbd516c6d80c8486d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee25c23-7b", "ovs_interfaceid": "0ee25c23-7b34-488e-97b1-db66f921a502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:36:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a4105209-a8ba-44b3-9bf7-e95ba682a6f1 req-c3025015-4fd6-416c-9840-ac64e76b623e service nova] Releasing lock "refresh_cache-98ced818-ad9a-4020-9f2b-2520934530ba" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:36:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:24 user nova-compute[74898]: DEBUG nova.compute.manager [req-0dcc662f-187a-4c0a-9373-bc4e60feea04 req-4ffdea33-4782-407c-9d79-792c58dbee12 service nova] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Received event network-vif-plugged-0ee25c23-7b34-488e-97b1-db66f921a502 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:36:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0dcc662f-187a-4c0a-9373-bc4e60feea04 req-4ffdea33-4782-407c-9d79-792c58dbee12 service nova] Acquiring lock "98ced818-ad9a-4020-9f2b-2520934530ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:36:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0dcc662f-187a-4c0a-9373-bc4e60feea04 req-4ffdea33-4782-407c-9d79-792c58dbee12 service nova] Lock "98ced818-ad9a-4020-9f2b-2520934530ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:36:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-0dcc662f-187a-4c0a-9373-bc4e60feea04 req-4ffdea33-4782-407c-9d79-792c58dbee12 service nova] Lock "98ced818-ad9a-4020-9f2b-2520934530ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:36:24 user nova-compute[74898]: DEBUG nova.compute.manager [req-0dcc662f-187a-4c0a-9373-bc4e60feea04 req-4ffdea33-4782-407c-9d79-792c58dbee12 service nova] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] No waiting events found dispatching network-vif-plugged-0ee25c23-7b34-488e-97b1-db66f921a502 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:36:24 user nova-compute[74898]: WARNING nova.compute.manager [req-0dcc662f-187a-4c0a-9373-bc4e60feea04 req-4ffdea33-4782-407c-9d79-792c58dbee12 service nova] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Received unexpected event network-vif-plugged-0ee25c23-7b34-488e-97b1-db66f921a502 for instance with vm_state building and task_state spawning.
Nov 17 03:36:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:25 user nova-compute[74898]: DEBUG nova.compute.manager [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:36:25 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:36:26 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Instance spawned successfully.
Nov 17 03:36:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:36:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:36:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:36:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:36:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:36:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:36:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:36:26 user nova-compute[74898]: INFO nova.compute.manager [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Took 5.25 seconds to spawn the instance on the hypervisor.
Nov 17 03:36:26 user nova-compute[74898]: DEBUG nova.compute.manager [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:36:26 user nova-compute[74898]: DEBUG nova.compute.manager [req-011b3b8a-0e16-4116-b244-fcd4139922b5 req-308ce362-8108-46f1-83af-57f36c4d6a55 service nova] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Received event network-vif-plugged-0ee25c23-7b34-488e-97b1-db66f921a502 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:36:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-011b3b8a-0e16-4116-b244-fcd4139922b5 req-308ce362-8108-46f1-83af-57f36c4d6a55 service nova] Acquiring lock "98ced818-ad9a-4020-9f2b-2520934530ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:36:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-011b3b8a-0e16-4116-b244-fcd4139922b5 req-308ce362-8108-46f1-83af-57f36c4d6a55 service nova] Lock "98ced818-ad9a-4020-9f2b-2520934530ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:36:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-011b3b8a-0e16-4116-b244-fcd4139922b5 req-308ce362-8108-46f1-83af-57f36c4d6a55 service nova] Lock "98ced818-ad9a-4020-9f2b-2520934530ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:36:26 user nova-compute[74898]: DEBUG nova.compute.manager [req-011b3b8a-0e16-4116-b244-fcd4139922b5 req-308ce362-8108-46f1-83af-57f36c4d6a55 service nova] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] No waiting events found dispatching network-vif-plugged-0ee25c23-7b34-488e-97b1-db66f921a502 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:36:26 user nova-compute[74898]: WARNING nova.compute.manager [req-011b3b8a-0e16-4116-b244-fcd4139922b5 req-308ce362-8108-46f1-83af-57f36c4d6a55 service nova] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Received unexpected event network-vif-plugged-0ee25c23-7b34-488e-97b1-db66f921a502 for instance with vm_state building and task_state spawning.
Nov 17 03:36:26 user nova-compute[74898]: INFO nova.compute.manager [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Took 5.80 seconds to build instance.
Nov 17 03:36:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-411b9a21-4895-4c13-8259-8fc5e7a5198f tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "98ced818-ad9a-4020-9f2b-2520934530ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.925s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:36:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:42 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:36:43 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:36:43 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:36:45 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:36:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:47 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:36:49 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:36:51 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:36:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:36:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:36:51 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:36:51 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:36:51 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:36:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:36:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:36:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:36:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:36:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:36:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:36:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:36:53 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:36:53 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:36:53 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=8740MB free_disk=25.262592315673828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:36:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:36:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:36:53 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 25ab4a8b-372b-42ab-8929-1d8c3262e3ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:36:53 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 98ced818-ad9a-4020-9f2b-2520934530ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:36:53 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:36:53 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:36:53 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:36:53 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:36:53 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:36:53 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:36:54 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:36:54 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:36:54 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:36:54 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:36:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-25ab4a8b-372b-42ab-8929-1d8c3262e3ca" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:36:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-25ab4a8b-372b-42ab-8929-1d8c3262e3ca" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:36:54 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:36:55 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Updating instance_info_cache with network_info: [{"id": "b5248d6e-e587-409e-9b44-ed1a576ff20f", "address": "fa:16:3e:72:96:4e", "network": {"id": "11050b0f-b7a6-40b1-83ed-f177fe8ff374", "bridge": "br-int", "label": "tempest-TestStampPattern-1875435424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eeadb4c131e45d5a2756825338e5a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5248d6e-e5", "ovs_interfaceid": "b5248d6e-e587-409e-9b44-ed1a576ff20f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:36:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-25ab4a8b-372b-42ab-8929-1d8c3262e3ca" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:36:55 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:36:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:36:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:37:00 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._sync_power_states {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:37:00 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Triggering sync for uuid 25ab4a8b-372b-42ab-8929-1d8c3262e3ca {{(pid=74898) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 03:37:00 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Triggering sync for uuid 98ced818-ad9a-4020-9f2b-2520934530ba {{(pid=74898) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 03:37:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:37:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:37:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "98ced818-ad9a-4020-9f2b-2520934530ba" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:37:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "98ced818-ad9a-4020-9f2b-2520934530ba" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:37:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:37:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "98ced818-ad9a-4020-9f2b-2520934530ba" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:37:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:37:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:37:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:37:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:37:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:37:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:37:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:37:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:37:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:37:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:37:35 user nova-compute[74898]: DEBUG nova.compute.manager [req-ec8daa6d-fab4-4cee-ba41-d4da6e6a5685 req-f13e69de-d2e4-45a6-9f4a-83651c0e0f3f service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Received event network-changed-b5248d6e-e587-409e-9b44-ed1a576ff20f {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:37:35 user nova-compute[74898]: DEBUG nova.compute.manager [req-ec8daa6d-fab4-4cee-ba41-d4da6e6a5685 req-f13e69de-d2e4-45a6-9f4a-83651c0e0f3f service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Refreshing instance network info cache due to event network-changed-b5248d6e-e587-409e-9b44-ed1a576ff20f. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:37:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ec8daa6d-fab4-4cee-ba41-d4da6e6a5685 req-f13e69de-d2e4-45a6-9f4a-83651c0e0f3f service nova] Acquiring lock "refresh_cache-25ab4a8b-372b-42ab-8929-1d8c3262e3ca" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:37:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ec8daa6d-fab4-4cee-ba41-d4da6e6a5685 req-f13e69de-d2e4-45a6-9f4a-83651c0e0f3f service nova] Acquired lock "refresh_cache-25ab4a8b-372b-42ab-8929-1d8c3262e3ca" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:37:35 user nova-compute[74898]: DEBUG nova.network.neutron [req-ec8daa6d-fab4-4cee-ba41-d4da6e6a5685 req-f13e69de-d2e4-45a6-9f4a-83651c0e0f3f service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Refreshing network info cache for port b5248d6e-e587-409e-9b44-ed1a576ff20f {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:37:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:37:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:37:36 user nova-compute[74898]: DEBUG nova.objects.instance [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lazy-loading 'flavor' on Instance uuid 25ab4a8b-372b-42ab-8929-1d8c3262e3ca {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:37:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:37:36 user nova-compute[74898]: DEBUG nova.network.neutron [req-ec8daa6d-fab4-4cee-ba41-d4da6e6a5685 req-f13e69de-d2e4-45a6-9f4a-83651c0e0f3f service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Updated VIF entry in instance network info cache for port b5248d6e-e587-409e-9b44-ed1a576ff20f. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:37:36 user nova-compute[74898]: DEBUG nova.network.neutron [req-ec8daa6d-fab4-4cee-ba41-d4da6e6a5685 req-f13e69de-d2e4-45a6-9f4a-83651c0e0f3f service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Updating instance_info_cache with network_info: [{"id": "b5248d6e-e587-409e-9b44-ed1a576ff20f", "address": "fa:16:3e:72:96:4e", "network": {"id": "11050b0f-b7a6-40b1-83ed-f177fe8ff374", "bridge": "br-int", "label": "tempest-TestStampPattern-1875435424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eeadb4c131e45d5a2756825338e5a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5248d6e-e5", "ovs_interfaceid": "b5248d6e-e587-409e-9b44-ed1a576ff20f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:37:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-ec8daa6d-fab4-4cee-ba41-d4da6e6a5685 req-f13e69de-d2e4-45a6-9f4a-83651c0e0f3f service nova] Releasing lock "refresh_cache-25ab4a8b-372b-42ab-8929-1d8c3262e3ca" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:37:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:37:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:37:36 user nova-compute[74898]: INFO nova.compute.manager [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Attaching volume 62a7f05e-109f-4871-9684-adbd25a00719 to /dev/vdb
Nov 17 03:37:36 user nova-compute[74898]: DEBUG os_brick.utils [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:37:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:37:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:37:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9af1c0-4a22-4811-acd0-ae6f80adff56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:37:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:37:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:37:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4873c3df-8dd5-431a-9bb3-7d6658b8f4a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:37:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:37:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:37:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f059db82-628a-40d6-99dd-b782a256fe38]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:37:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[024fadec-6f3b-4c1f-8bd7-3a4ca4520d5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:37:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:37:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:37:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:37:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:37:36 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:37:36 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:37:36 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c473e58c-9dfc-4f00-bb6f-cfae4d77ffbe]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:37:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:37:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:37:36 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:37:36 user nova-compute[74898]: DEBUG os_brick.utils [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:37:36 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Updating existing volume attachment record: 96fc5a16-0dd8-462b-a11f-b10848a4f30c {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:37:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:37:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:37:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Acquiring lock "f8f371ad-3117-4dd7-a08f-e66f83e0ea90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:37:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "f8f371ad-3117-4dd7-a08f-e66f83e0ea90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:37:38 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:37:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:37:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:37:38 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:37:38 user nova-compute[74898]: INFO nova.compute.claims [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Claim successful on node user
Nov 17 03:37:39 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:37:39 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:37:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.249s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:37:39 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:37:39 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:37:39 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:37:39 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:37:39 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:37:39 user nova-compute[74898]: DEBUG nova.policy [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f053a881930440279c298a857df6e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d10fbc9614248b68a632ac20bcc50d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:37:39 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:37:39 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:37:39 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Creating image(s)
Nov 17 03:37:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8f371ad-3117-4dd7-a08f-e66f83e0ea90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:37:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "/opt/stack/data/nova/instances/f8f371ad-3117-4dd7-a08f-e66f83e0ea90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:37:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "/opt/stack/data/nova/instances/f8f371ad-3117-4dd7-a08f-e66f83e0ea90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.014s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:37:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:37:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.200s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:37:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:37:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:37:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:37:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:37:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/f8f371ad-3117-4dd7-a08f-e66f83e0ea90/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:37:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/f8f371ad-3117-4dd7-a08f-e66f83e0ea90/disk 1073741824" returned: 0 in 0.057s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:37:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:37:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:37:39 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Successfully created port: e9aba286-7203-4e63-8a1d-8dd7e13a3292 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:37:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.191s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:37:40 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f8f371ad-3117-4dd7-a08f-e66f83e0ea90/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:37:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f371ad-3117-4dd7-a08f-e66f83e0ea90/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:37:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f371ad-3117-4dd7-a08f-e66f83e0ea90/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:37:40 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Cannot resize image /opt/stack/data/nova/instances/f8f371ad-3117-4dd7-a08f-e66f83e0ea90/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:37:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:37:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Ensure instance console log exists: /opt/stack/data/nova/instances/f8f371ad-3117-4dd7-a08f-e66f83e0ea90/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:37:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:37:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:37:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:37:40 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Successfully updated port: e9aba286-7203-4e63-8a1d-8dd7e13a3292 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:37:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Acquiring lock "refresh_cache-f8f371ad-3117-4dd7-a08f-e66f83e0ea90" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:37:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Acquired lock "refresh_cache-f8f371ad-3117-4dd7-a08f-e66f83e0ea90" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:37:40 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:37:40 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:37:40 user nova-compute[74898]: DEBUG nova.compute.manager [req-3ddf1042-1bf0-48b0-ba49-f7c2136ece60 req-df585a4b-054d-407b-b851-79b902910107 service nova] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Received event network-changed-e9aba286-7203-4e63-8a1d-8dd7e13a3292 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:37:40 user nova-compute[74898]: DEBUG nova.compute.manager [req-3ddf1042-1bf0-48b0-ba49-f7c2136ece60 req-df585a4b-054d-407b-b851-79b902910107 service nova] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Refreshing instance network info cache due to event network-changed-e9aba286-7203-4e63-8a1d-8dd7e13a3292. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:37:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3ddf1042-1bf0-48b0-ba49-f7c2136ece60 req-df585a4b-054d-407b-b851-79b902910107 service nova] Acquiring lock "refresh_cache-f8f371ad-3117-4dd7-a08f-e66f83e0ea90" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:37:40 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Updating instance_info_cache with network_info: [{"id": "e9aba286-7203-4e63-8a1d-8dd7e13a3292", "address": "fa:16:3e:cd:0c:2d", "network": {"id": "b1fbc710-83f1-4388-aca7-a91fd4e9323d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1026031661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d10fbc9614248b68a632ac20bcc50d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9aba286-72", "ovs_interfaceid": "e9aba286-7203-4e63-8a1d-8dd7e13a3292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:37:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Releasing lock "refresh_cache-f8f371ad-3117-4dd7-a08f-e66f83e0ea90" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:37:40 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Instance network_info: |[{"id": "e9aba286-7203-4e63-8a1d-8dd7e13a3292", "address": "fa:16:3e:cd:0c:2d", "network": {"id": "b1fbc710-83f1-4388-aca7-a91fd4e9323d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1026031661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d10fbc9614248b68a632ac20bcc50d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9aba286-72", "ovs_interfaceid": "e9aba286-7203-4e63-8a1d-8dd7e13a3292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:37:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3ddf1042-1bf0-48b0-ba49-f7c2136ece60 req-df585a4b-054d-407b-b851-79b902910107 service nova] Acquired lock "refresh_cache-f8f371ad-3117-4dd7-a08f-e66f83e0ea90" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:37:40 user nova-compute[74898]: DEBUG nova.network.neutron [req-3ddf1042-1bf0-48b0-ba49-f7c2136ece60 req-df585a4b-054d-407b-b851-79b902910107 service nova] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Refreshing network info cache for port e9aba286-7203-4e63-8a1d-8dd7e13a3292 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:37:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Start _get_guest_xml network_info=[{"id": "e9aba286-7203-4e63-8a1d-8dd7e13a3292", "address": "fa:16:3e:cd:0c:2d", "network": {"id": "b1fbc710-83f1-4388-aca7-a91fd4e9323d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1026031661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d10fbc9614248b68a632ac20bcc50d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9aba286-72", "ovs_interfaceid": "e9aba286-7203-4e63-8a1d-8dd7e13a3292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:37:40 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:37:40 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:37:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:37:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-978069785',display_name='tempest-VolumesActionsTest-instance-978069785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-978069785',id=49,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d10fbc9614248b68a632ac20bcc50d9',ramdisk_id='',reservation_id='r-apuzwmka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-449010661',owner_user_name='tempest-VolumesActionsTest-449010661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:37:39Z,user_data=None,user_id='f053a881930440279c298a857df6e1dd',uuid=f8f371ad-3117-4dd7-a08f-e66f83e0ea90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9aba286-7203-4e63-8a1d-8dd7e13a3292", "address": "fa:16:3e:cd:0c:2d", "network": {"id": "b1fbc710-83f1-4388-aca7-a91fd4e9323d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1026031661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d10fbc9614248b68a632ac20bcc50d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9aba286-72", "ovs_interfaceid": "e9aba286-7203-4e63-8a1d-8dd7e13a3292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Converting VIF {"id": "e9aba286-7203-4e63-8a1d-8dd7e13a3292", "address": "fa:16:3e:cd:0c:2d", "network": {"id": "b1fbc710-83f1-4388-aca7-a91fd4e9323d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1026031661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d10fbc9614248b68a632ac20bcc50d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9aba286-72", "ovs_interfaceid": "e9aba286-7203-4e63-8a1d-8dd7e13a3292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:0c:2d,bridge_name='br-int',has_traffic_filtering=True,id=e9aba286-7203-4e63-8a1d-8dd7e13a3292,network=Network(b1fbc710-83f1-4388-aca7-a91fd4e9323d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9aba286-72') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG nova.objects.instance [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lazy-loading 'pci_devices' on Instance uuid f8f371ad-3117-4dd7-a08f-e66f83e0ea90 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:37:41 user nova-compute[74898]:   <uuid>f8f371ad-3117-4dd7-a08f-e66f83e0ea90</uuid>
Nov 17 03:37:41 user nova-compute[74898]:   <name>instance-00000031</name>
Nov 17 03:37:41 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:37:41 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:37:41 user nova-compute[74898]:   <metadata>
Nov 17 03:37:41 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:37:41 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:37:41 user nova-compute[74898]:       <nova:name>tempest-VolumesActionsTest-instance-978069785</nova:name>
Nov 17 03:37:41 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:37:40</nova:creationTime>
Nov 17 03:37:41 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:37:41 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:37:41 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:37:41 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:37:41 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:37:41 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:37:41 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:37:41 user nova-compute[74898]:       <nova:owner>
Nov 17 03:37:41 user nova-compute[74898]:         <nova:user uuid="f053a881930440279c298a857df6e1dd">tempest-VolumesActionsTest-449010661-project-member</nova:user>
Nov 17 03:37:41 user nova-compute[74898]:         <nova:project uuid="9d10fbc9614248b68a632ac20bcc50d9">tempest-VolumesActionsTest-449010661</nova:project>
Nov 17 03:37:41 user nova-compute[74898]:       </nova:owner>
Nov 17 03:37:41 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:37:41 user nova-compute[74898]:       <nova:ports>
Nov 17 03:37:41 user nova-compute[74898]:         <nova:port uuid="e9aba286-7203-4e63-8a1d-8dd7e13a3292">
Nov 17 03:37:41 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 17 03:37:41 user nova-compute[74898]:         </nova:port>
Nov 17 03:37:41 user nova-compute[74898]:       </nova:ports>
Nov 17 03:37:41 user nova-compute[74898]:     </nova:instance>
Nov 17 03:37:41 user nova-compute[74898]:   </metadata>
Nov 17 03:37:41 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:37:41 user nova-compute[74898]:     <system>
Nov 17 03:37:41 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:37:41 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:37:41 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:37:41 user nova-compute[74898]:       <entry name="serial">f8f371ad-3117-4dd7-a08f-e66f83e0ea90</entry>
Nov 17 03:37:41 user nova-compute[74898]:       <entry name="uuid">f8f371ad-3117-4dd7-a08f-e66f83e0ea90</entry>
Nov 17 03:37:41 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:37:41 user nova-compute[74898]:     </system>
Nov 17 03:37:41 user nova-compute[74898]:   </sysinfo>
Nov 17 03:37:41 user nova-compute[74898]:   <os>
Nov 17 03:37:41 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:37:41 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:37:41 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:37:41 user nova-compute[74898]:   </os>
Nov 17 03:37:41 user nova-compute[74898]:   <features>
Nov 17 03:37:41 user nova-compute[74898]:     <acpi/>
Nov 17 03:37:41 user nova-compute[74898]:     <apic/>
Nov 17 03:37:41 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:37:41 user nova-compute[74898]:   </features>
Nov 17 03:37:41 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:37:41 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:37:41 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:37:41 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:37:41 user nova-compute[74898]:   </clock>
Nov 17 03:37:41 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:37:41 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:37:41 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:37:41 user nova-compute[74898]:   </cpu>
Nov 17 03:37:41 user nova-compute[74898]:   <devices>
Nov 17 03:37:41 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:37:41 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:37:41 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/f8f371ad-3117-4dd7-a08f-e66f83e0ea90/disk"/>
Nov 17 03:37:41 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:37:41 user nova-compute[74898]:     </disk>
Nov 17 03:37:41 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:37:41 user nova-compute[74898]:       <mac address="fa:16:3e:cd:0c:2d"/>
Nov 17 03:37:41 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:37:41 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:37:41 user nova-compute[74898]:       <target dev="tape9aba286-72"/>
Nov 17 03:37:41 user nova-compute[74898]:     </interface>
Nov 17 03:37:41 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:37:41 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/f8f371ad-3117-4dd7-a08f-e66f83e0ea90/console.log" append="off"/>
Nov 17 03:37:41 user nova-compute[74898]:     </serial>
Nov 17 03:37:41 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:37:41 user nova-compute[74898]:     <video>
Nov 17 03:37:41 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:37:41 user nova-compute[74898]:     </video>
Nov 17 03:37:41 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:37:41 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:37:41 user nova-compute[74898]:     </rng>
Nov 17 03:37:41 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:37:41 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:37:41 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:37:41 user nova-compute[74898]:     </memballoon>
Nov 17 03:37:41 user nova-compute[74898]:   </devices>
Nov 17 03:37:41 user nova-compute[74898]: </domain>
Nov 17 03:37:41 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:37:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-978069785',display_name='tempest-VolumesActionsTest-instance-978069785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-978069785',id=49,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d10fbc9614248b68a632ac20bcc50d9',ramdisk_id='',reservation_id='r-apuzwmka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-449010661',owner_user_name='tempest-VolumesActionsTest-449010661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:37:39Z,user_data=None,user_id='f053a881930440279c298a857df6e1dd',uuid=f8f371ad-3117-4dd7-a08f-e66f83e0ea90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9aba286-7203-4e63-8a1d-8dd7e13a3292", "address": "fa:16:3e:cd:0c:2d", "network": {"id": "b1fbc710-83f1-4388-aca7-a91fd4e9323d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1026031661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d10fbc9614248b68a632ac20bcc50d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9aba286-72", "ovs_interfaceid": "e9aba286-7203-4e63-8a1d-8dd7e13a3292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Converting VIF {"id": "e9aba286-7203-4e63-8a1d-8dd7e13a3292", "address": "fa:16:3e:cd:0c:2d", "network": {"id": "b1fbc710-83f1-4388-aca7-a91fd4e9323d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1026031661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d10fbc9614248b68a632ac20bcc50d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9aba286-72", "ovs_interfaceid": "e9aba286-7203-4e63-8a1d-8dd7e13a3292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:0c:2d,bridge_name='br-int',has_traffic_filtering=True,id=e9aba286-7203-4e63-8a1d-8dd7e13a3292,network=Network(b1fbc710-83f1-4388-aca7-a91fd4e9323d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9aba286-72') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG os_vif [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:0c:2d,bridge_name='br-int',has_traffic_filtering=True,id=e9aba286-7203-4e63-8a1d-8dd7e13a3292,network=Network(b1fbc710-83f1-4388-aca7-a91fd4e9323d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9aba286-72') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c273469-56ec-5dcb-9657-c86196863605', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9aba286-72, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape9aba286-72, col_values=(('qos', UUID('c11dc37e-4075-44c1-921d-6152daacde4a')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape9aba286-72, col_values=(('external_ids', {'iface-id': 'e9aba286-7203-4e63-8a1d-8dd7e13a3292', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:0c:2d', 'vm-uuid': 'f8f371ad-3117-4dd7-a08f-e66f83e0ea90'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:37:41 user nova-compute[74898]: INFO os_vif [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:0c:2d,bridge_name='br-int',has_traffic_filtering=True,id=e9aba286-7203-4e63-8a1d-8dd7e13a3292,network=Network(b1fbc710-83f1-4388-aca7-a91fd4e9323d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9aba286-72')
Nov 17 03:37:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] No VIF found with MAC fa:16:3e:cd:0c:2d, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG nova.network.neutron [req-3ddf1042-1bf0-48b0-ba49-f7c2136ece60 req-df585a4b-054d-407b-b851-79b902910107 service nova] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Updated VIF entry in instance network info cache for port e9aba286-7203-4e63-8a1d-8dd7e13a3292. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG nova.network.neutron [req-3ddf1042-1bf0-48b0-ba49-f7c2136ece60 req-df585a4b-054d-407b-b851-79b902910107 service nova] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Updating instance_info_cache with network_info: [{"id": "e9aba286-7203-4e63-8a1d-8dd7e13a3292", "address": "fa:16:3e:cd:0c:2d", "network": {"id": "b1fbc710-83f1-4388-aca7-a91fd4e9323d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1026031661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d10fbc9614248b68a632ac20bcc50d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9aba286-72", "ovs_interfaceid": "e9aba286-7203-4e63-8a1d-8dd7e13a3292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3ddf1042-1bf0-48b0-ba49-f7c2136ece60 req-df585a4b-054d-407b-b851-79b902910107 service nova] Releasing lock "refresh_cache-f8f371ad-3117-4dd7-a08f-e66f83e0ea90" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:37:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UpFSwgHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:37:42 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:37:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:37:42 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:37:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:37:42 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73c1ea3-a9f7-4dc2-9b25-4f8eaf7c3a8b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:37:42 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8938912f-b949-4f1c-afa2-ee78facb54eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719] added
Nov 17 03:37:42 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[56482cbc-36fa-4e6d-b245-22e7008674d2]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f52a8f-300d-4a7d-9fef-b4ba327445bb]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UpFSwgHP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UpFSwgHP" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[09558115-0de6-418e-8ddd-ff65f0281a01]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UpFSwgHP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ed1daa-302a-45fa-943c-901906865ed5]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1754ba86-3822-4614-a6a9-95390db7a6b2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 17 03:37:42 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 17 03:37:42 user nova-compute[74898]:  {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:37:42 user nova-compute[74898]: WARNING os_brick.initiator.connectors.iscsi [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 17 03:37:42 user nova-compute[74898]: 
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d93b3c-ef38-43a2-9a28-a186f3a5aede]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719, portal: 172.16.0.220,3260]
Nov 17 03:37:42 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719, portal: 172.16.0.220,3260] successful.
Nov 17 03:37:42 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[be30e756-443a-4a18-8899-28a9c0eb4694]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6afc0a4-5780-46a6-b7c8-814a637781af]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719 (non-flash)
Nov 17 03:37:42 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719 (non-flash)
Nov 17 03:37:42 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.237s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[241ab331-a5a4-42b7-8a58-d5b5ce4ff69a]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UpFSwgHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG nova.compute.manager [req-95bda00a-b0ad-41c7-9cd1-739d39c5685c req-c517fd4a-b3d3-4f81-9583-c389502c433a service nova] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Received event network-vif-plugged-e9aba286-7203-4e63-8a1d-8dd7e13a3292 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-95bda00a-b0ad-41c7-9cd1-739d39c5685c req-c517fd4a-b3d3-4f81-9583-c389502c433a service nova] Acquiring lock "f8f371ad-3117-4dd7-a08f-e66f83e0ea90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-95bda00a-b0ad-41c7-9cd1-739d39c5685c req-c517fd4a-b3d3-4f81-9583-c389502c433a service nova] Lock "f8f371ad-3117-4dd7-a08f-e66f83e0ea90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-95bda00a-b0ad-41c7-9cd1-739d39c5685c req-c517fd4a-b3d3-4f81-9583-c389502c433a service nova] Lock "f8f371ad-3117-4dd7-a08f-e66f83e0ea90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG nova.compute.manager [req-95bda00a-b0ad-41c7-9cd1-739d39c5685c req-c517fd4a-b3d3-4f81-9583-c389502c433a service nova] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] No waiting events found dispatching network-vif-plugged-e9aba286-7203-4e63-8a1d-8dd7e13a3292 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:37:42 user nova-compute[74898]: WARNING nova.compute.manager [req-95bda00a-b0ad-41c7-9cd1-739d39c5685c req-c517fd4a-b3d3-4f81-9583-c389502c433a service nova] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Received unexpected event network-vif-plugged-e9aba286-7203-4e63-8a1d-8dd7e13a3292 for instance with vm_state building and task_state spawning.
Nov 17 03:37:42 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:37:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:37:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:37:43 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:37:43 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '26439386139616532', 'path': '/dev/sdb'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:37:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439386139616532', 'path': '/dev/sdb'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:37:43 user nova-compute[74898]: DEBUG nova.objects.instance [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lazy-loading 'flavor' on Instance uuid 25ab4a8b-372b-42ab-8929-1d8c3262e3ca {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:37:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 03:37:43 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:37:43 user nova-compute[74898]:   <source dev="/dev/sdb"/>
Nov 17 03:37:43 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:37:43 user nova-compute[74898]:   <serial>62a7f05e-109f-4871-9684-adbd25a00719</serial>
Nov 17 03:37:43 user nova-compute[74898]: </disk>
Nov 17 03:37:43 user nova-compute[74898]:  {{(pid=74898) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 03:37:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:37:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:37:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] No VIF found with MAC fa:16:3e:72:96:4e, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:37:43 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:37:43 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:37:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-79ab6248-4fe6-49fe-ab16-8fe5e0260d60 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.233s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:37:44 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:37:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:37:44 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Instance spawned successfully.
Nov 17 03:37:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:37:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:37:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:37:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:37:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:37:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:37:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:37:44 user nova-compute[74898]: INFO nova.compute.manager [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Took 5.24 seconds to spawn the instance on the hypervisor.
Nov 17 03:37:44 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:37:44 user nova-compute[74898]: DEBUG nova.compute.manager [req-24e7f445-b564-4064-a3bf-5d6b1ab1e2e6 req-227e760f-38f1-4fe8-895a-995b9263499a service nova] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Received event network-vif-plugged-e9aba286-7203-4e63-8a1d-8dd7e13a3292 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:37:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-24e7f445-b564-4064-a3bf-5d6b1ab1e2e6 req-227e760f-38f1-4fe8-895a-995b9263499a service nova] Acquiring lock "f8f371ad-3117-4dd7-a08f-e66f83e0ea90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:37:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-24e7f445-b564-4064-a3bf-5d6b1ab1e2e6 req-227e760f-38f1-4fe8-895a-995b9263499a service nova] Lock "f8f371ad-3117-4dd7-a08f-e66f83e0ea90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:37:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-24e7f445-b564-4064-a3bf-5d6b1ab1e2e6 req-227e760f-38f1-4fe8-895a-995b9263499a service nova] Lock "f8f371ad-3117-4dd7-a08f-e66f83e0ea90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:37:44 user nova-compute[74898]: DEBUG nova.compute.manager [req-24e7f445-b564-4064-a3bf-5d6b1ab1e2e6 req-227e760f-38f1-4fe8-895a-995b9263499a service nova] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] No waiting events found dispatching network-vif-plugged-e9aba286-7203-4e63-8a1d-8dd7e13a3292 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:37:44 user nova-compute[74898]: WARNING nova.compute.manager [req-24e7f445-b564-4064-a3bf-5d6b1ab1e2e6 req-227e760f-38f1-4fe8-895a-995b9263499a service nova] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Received unexpected event network-vif-plugged-e9aba286-7203-4e63-8a1d-8dd7e13a3292 for instance with vm_state building and task_state spawning.
Nov 17 03:37:44 user nova-compute[74898]: INFO nova.compute.manager [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Took 5.79 seconds to build instance.
Nov 17 03:37:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e6d1a861-3c01-4993-ad9e-11dc27b7cc88 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "f8f371ad-3117-4dd7-a08f-e66f83e0ea90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.882s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:37:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:37:45 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:37:45 user nova-compute[74898]: INFO nova.compute.manager [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Detaching volume 62a7f05e-109f-4871-9684-adbd25a00719
Nov 17 03:37:45 user nova-compute[74898]: INFO nova.virt.block_device [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Attempting to driver detach volume 62a7f05e-109f-4871-9684-adbd25a00719 from mountpoint /dev/vdb
Nov 17 03:37:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Attempting to detach device vdb from instance 25ab4a8b-372b-42ab-8929-1d8c3262e3ca from the persistent domain config. {{(pid=74898) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 03:37:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:37:45 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:37:45 user nova-compute[74898]:   <source dev="/dev/sdb"/>
Nov 17 03:37:45 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:37:45 user nova-compute[74898]:   <serial>62a7f05e-109f-4871-9684-adbd25a00719</serial>
Nov 17 03:37:45 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:37:45 user nova-compute[74898]: </disk>
Nov 17 03:37:45 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:37:45 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Successfully detached device vdb from instance 25ab4a8b-372b-42ab-8929-1d8c3262e3ca from the persistent domain config.
Nov 17 03:37:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 25ab4a8b-372b-42ab-8929-1d8c3262e3ca from the live domain config. {{(pid=74898) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 03:37:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:37:45 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:37:45 user nova-compute[74898]:   <source dev="/dev/sdb"/>
Nov 17 03:37:45 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:37:45 user nova-compute[74898]:   <serial>62a7f05e-109f-4871-9684-adbd25a00719</serial>
Nov 17 03:37:45 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:37:45 user nova-compute[74898]: </disk>
Nov 17 03:37:45 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:37:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:37:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 25ab4a8b-372b-42ab-8929-1d8c3262e3ca {{(pid=74898) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 03:37:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:37:47 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:37:48 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:37:48 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:37:50 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:37:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:37:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:37:52 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:37:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:37:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:37:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:37:52 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:37:52 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:37:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:37:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:37:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:37:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f371ad-3117-4dd7-a08f-e66f83e0ea90/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:37:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f371ad-3117-4dd7-a08f-e66f83e0ea90/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:37:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f371ad-3117-4dd7-a08f-e66f83e0ea90/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:37:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f371ad-3117-4dd7-a08f-e66f83e0ea90/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:37:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:37:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:37:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:37:53 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:37:54 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:37:54 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:37:54 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=8607MB free_disk=25.25005340576172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:37:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:37:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:37:54 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 25ab4a8b-372b-42ab-8929-1d8c3262e3ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:37:54 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 98ced818-ad9a-4020-9f2b-2520934530ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:37:54 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance f8f371ad-3117-4dd7-a08f-e66f83e0ea90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:37:54 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:37:54 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:37:54 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:37:54 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:37:54 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:37:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:37:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:37:56 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:37:56 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:37:56 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:37:56 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Rebuilding the list of instances to heal {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 03:37:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-25ab4a8b-372b-42ab-8929-1d8c3262e3ca" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:37:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-25ab4a8b-372b-42ab-8929-1d8c3262e3ca" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:37:56 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:37:56 user nova-compute[74898]: DEBUG nova.objects.instance [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lazy-loading 'info_cache' on Instance uuid 25ab4a8b-372b-42ab-8929-1d8c3262e3ca {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:37:57 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Updating instance_info_cache with network_info: [{"id": "b5248d6e-e587-409e-9b44-ed1a576ff20f", "address": "fa:16:3e:72:96:4e", "network": {"id": "11050b0f-b7a6-40b1-83ed-f177fe8ff374", "bridge": "br-int", "label": "tempest-TestStampPattern-1875435424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eeadb4c131e45d5a2756825338e5a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5248d6e-e5", "ovs_interfaceid": "b5248d6e-e587-409e-9b44-ed1a576ff20f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:37:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-25ab4a8b-372b-42ab-8929-1d8c3262e3ca" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:37:57 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:37:57 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:38:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:38:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:38:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:38:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:38:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:06 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 25ab4a8b-372b-42ab-8929-1d8c3262e3ca is timed out.
Nov 17 03:38:06 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Successfully detached device vdb from instance 25ab4a8b-372b-42ab-8929-1d8c3262e3ca from the live domain config.
Nov 17 03:38:06 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UpFSwgHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:38:06 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:38:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff23cbf2-b903-4c32-a82d-8bc7207b92f1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:38:06 user nova-compute[74898]: No targets found.
Nov 17 03:38:06 user nova-compute[74898]: iSNS:
Nov 17 03:38:06 user nova-compute[74898]: No targets found.
Nov 17 03:38:06 user nova-compute[74898]: STATIC:
Nov 17 03:38:06 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719
Nov 17 03:38:06 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:38:06 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:38:06 user nova-compute[74898]: FIRMWARE:
Nov 17 03:38:06 user nova-compute[74898]: No targets found.
Nov 17 03:38:06 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:38:06 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:38:06 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9e8916-dc7c-4d55-a09a-86ca95c9aa57]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33e0d53-7086-4d6a-828b-9bb088ef6364]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719 (non-flash)
Nov 17 03:38:06 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719 (non-flash)
Nov 17 03:38:06 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9c184f5900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719'): ({'sdb'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Removing single pathed devices sdb {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4eb387-c6c1-4d7c-b4a6-89c611f0851a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2ef310-3292-429a-84f9-c130bee47173]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Flushing IO for device /dev/sdb {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[384a8414-f703-4d59-82ce-06c658b1f948]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d555dc-2ae6-4eba-92a5-1a06e8b7561d]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee289705-b3c8-4fd7-a50a-d5e0369a6403]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abcdfe3-9382-4bf6-9941-dcbb8c94babd]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719, portal: 172.16.0.220,3260]
Nov 17 03:38:06 user nova-compute[74898]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719, portal: 172.16.0.220,3260] successful.
Nov 17 03:38:06 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62a7f05e-109f-4871-9684-adbd25a00719 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d20769f-f233-4d6d-9073-e6ebf5c6e37d]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] <== disconnect_volume: return (288ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:38:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:07 user nova-compute[74898]: DEBUG nova.objects.instance [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lazy-loading 'flavor' on Instance uuid 25ab4a8b-372b-42ab-8929-1d8c3262e3ca {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:38:07 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-889bf7c6-33f4-4469-b5c9-dc996a2b7ce5 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.604s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:38:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-a7f86130-783a-49fd-b0ad-f29d429b1892 req-205f96dc-09bb-47a0-807e-f4883768495a service nova] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Received event network-changed-0ee25c23-7b34-488e-97b1-db66f921a502 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:38:11 user nova-compute[74898]: DEBUG nova.compute.manager [req-a7f86130-783a-49fd-b0ad-f29d429b1892 req-205f96dc-09bb-47a0-807e-f4883768495a service nova] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Refreshing instance network info cache due to event network-changed-0ee25c23-7b34-488e-97b1-db66f921a502. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:38:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a7f86130-783a-49fd-b0ad-f29d429b1892 req-205f96dc-09bb-47a0-807e-f4883768495a service nova] Acquiring lock "refresh_cache-98ced818-ad9a-4020-9f2b-2520934530ba" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:38:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a7f86130-783a-49fd-b0ad-f29d429b1892 req-205f96dc-09bb-47a0-807e-f4883768495a service nova] Acquired lock "refresh_cache-98ced818-ad9a-4020-9f2b-2520934530ba" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:38:11 user nova-compute[74898]: DEBUG nova.network.neutron [req-a7f86130-783a-49fd-b0ad-f29d429b1892 req-205f96dc-09bb-47a0-807e-f4883768495a service nova] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Refreshing network info cache for port 0ee25c23-7b34-488e-97b1-db66f921a502 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:38:11 user nova-compute[74898]: DEBUG nova.network.neutron [req-a7f86130-783a-49fd-b0ad-f29d429b1892 req-205f96dc-09bb-47a0-807e-f4883768495a service nova] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Updated VIF entry in instance network info cache for port 0ee25c23-7b34-488e-97b1-db66f921a502. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:38:11 user nova-compute[74898]: DEBUG nova.network.neutron [req-a7f86130-783a-49fd-b0ad-f29d429b1892 req-205f96dc-09bb-47a0-807e-f4883768495a service nova] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Updating instance_info_cache with network_info: [{"id": "0ee25c23-7b34-488e-97b1-db66f921a502", "address": "fa:16:3e:82:10:be", "network": {"id": "9efcfeea-8c01-45a8-8a77-3d6a18c71729", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-925876126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8de3683d8d2c4bafbd516c6d80c8486d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee25c23-7b", "ovs_interfaceid": "0ee25c23-7b34-488e-97b1-db66f921a502", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:38:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a7f86130-783a-49fd-b0ad-f29d429b1892 req-205f96dc-09bb-47a0-807e-f4883768495a service nova] Releasing lock "refresh_cache-98ced818-ad9a-4020-9f2b-2520934530ba" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:38:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "98ced818-ad9a-4020-9f2b-2520934530ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:38:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "98ced818-ad9a-4020-9f2b-2520934530ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:38:15 user nova-compute[74898]: DEBUG nova.objects.instance [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lazy-loading 'flavor' on Instance uuid 98ced818-ad9a-4020-9f2b-2520934530ba {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:38:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "98ced818-ad9a-4020-9f2b-2520934530ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:38:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "98ced818-ad9a-4020-9f2b-2520934530ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:38:15 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "98ced818-ad9a-4020-9f2b-2520934530ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:38:15 user nova-compute[74898]: INFO nova.compute.manager [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Attaching volume 1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2 to /dev/vdb
Nov 17 03:38:15 user nova-compute[74898]: DEBUG os_brick.utils [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:38:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:15 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[251782f4-48cc-4073-b039-07944937c58e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:15 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[84860bf3-60c7-47de-bb89-ebe21750994b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:15 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[187e01dc-a970-4586-a55e-7349296e927d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:15 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e03509-4d3c-4927-ad41-36825df75d8a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:38:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:38:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:15 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:38:15 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:38:15 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[490ece34-77d6-4116-93fd-a14f26e9c54f]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:38:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:38:15 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:38:15 user nova-compute[74898]: DEBUG os_brick.utils [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:38:15 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Updating existing volume attachment record: e478201c-a64e-42b3-8afe-3a4d644f2089 {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:38:16 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:16 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zsgDbIjU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:38:21 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:38:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:38:21 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:38:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:38:21 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[529b8b8d-fdc4-49ba-a5c7-028294736be9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:38:21 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[698ddd23-ed12-4132-8de1-3763f47a3e3a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2] added
Nov 17 03:38:21 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2bda49-edc6-4957-9aab-ba0748db8344]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[46391f75-527a-42b2-86b9-74a90df573c2]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zsgDbIjU {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zsgDbIjU" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a91ef7-1da1-4880-953e-521e5a5ab86b]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zsgDbIjU'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[552b07d9-68a7-4c20-971c-1bc292e4f64a]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[81005653-a6b0-4c2e-adba-db90b30ed5ff]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 17 03:38:21 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 17 03:38:21 user nova-compute[74898]:  {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:38:21 user nova-compute[74898]: WARNING os_brick.initiator.connectors.iscsi [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 17 03:38:21 user nova-compute[74898]: 
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[63041f6e-1ace-4a41-8439-0254c5e5f042]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2, portal: 172.16.0.220,3260]
Nov 17 03:38:21 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2, portal: 172.16.0.220,3260] successful.
Nov 17 03:38:21 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2821935a-fade-4154-af12-f5fd7068ced9]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d548ad3e-ef31-4058-a468-efa1d232d879]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2 (non-flash)
Nov 17 03:38:21 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2 (non-flash)
Nov 17 03:38:21 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6466a8-5af7-4ce8-b41c-64d306d65c1a]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zsgDbIjU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:38:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.267s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:38:22 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] <== connect_volume: return (1269ms) {'type': 'block', 'scsi_wwn': '23334396136646236', 'path': '/dev/sdb'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:38:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334396136646236', 'path': '/dev/sdb'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:38:22 user nova-compute[74898]: DEBUG nova.objects.instance [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lazy-loading 'flavor' on Instance uuid 98ced818-ad9a-4020-9f2b-2520934530ba {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:38:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 03:38:22 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:38:22 user nova-compute[74898]:   <source dev="/dev/sdb"/>
Nov 17 03:38:22 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:38:22 user nova-compute[74898]:   <serial>1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2</serial>
Nov 17 03:38:22 user nova-compute[74898]: </disk>
Nov 17 03:38:22 user nova-compute[74898]:  {{(pid=74898) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 03:38:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:38:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:38:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] No VIF found with MAC fa:16:3e:82:10:be, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:38:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-87f44dec-bfa0-4c62-bb83-8cdc1f44a5ec tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "98ced818-ad9a-4020-9f2b-2520934530ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.192s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:38:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:26 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "98ced818-ad9a-4020-9f2b-2520934530ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:38:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "98ced818-ad9a-4020-9f2b-2520934530ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:38:33 user nova-compute[74898]: INFO nova.compute.manager [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Detaching volume 1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2
Nov 17 03:38:33 user nova-compute[74898]: INFO nova.virt.block_device [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Attempting to driver detach volume 1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2 from mountpoint /dev/vdb
Nov 17 03:38:33 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Attempting to detach device vdb from instance 98ced818-ad9a-4020-9f2b-2520934530ba from the persistent domain config. {{(pid=74898) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 03:38:33 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:38:33 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:38:33 user nova-compute[74898]:   <source dev="/dev/sdb"/>
Nov 17 03:38:33 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:38:33 user nova-compute[74898]:   <serial>1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2</serial>
Nov 17 03:38:33 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:38:33 user nova-compute[74898]: </disk>
Nov 17 03:38:33 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:38:33 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Successfully detached device vdb from instance 98ced818-ad9a-4020-9f2b-2520934530ba from the persistent domain config.
Nov 17 03:38:33 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 98ced818-ad9a-4020-9f2b-2520934530ba from the live domain config. {{(pid=74898) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 03:38:33 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:38:33 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:38:33 user nova-compute[74898]:   <source dev="/dev/sdb"/>
Nov 17 03:38:33 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:38:33 user nova-compute[74898]:   <serial>1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2</serial>
Nov 17 03:38:33 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:38:33 user nova-compute[74898]: </disk>
Nov 17 03:38:33 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:38:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 98ced818-ad9a-4020-9f2b-2520934530ba {{(pid=74898) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 03:38:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:39 user nova-compute[74898]: DEBUG nova.compute.manager [None req-ba0bc042-123f-4f36-9f08-210a9ab52f4b tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:38:39 user nova-compute[74898]: INFO nova.compute.manager [None req-ba0bc042-123f-4f36-9f08-210a9ab52f4b tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] instance snapshotting
Nov 17 03:38:39 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-ba0bc042-123f-4f36-9f08-210a9ab52f4b tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Beginning live snapshot process
Nov 17 03:38:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-ba0bc042-123f-4f36-9f08-210a9ab52f4b tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json -f qcow2 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-ba0bc042-123f-4f36-9f08-210a9ab52f4b tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-ba0bc042-123f-4f36-9f08-210a9ab52f4b tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json -f qcow2 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-ba0bc042-123f-4f36-9f08-210a9ab52f4b tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:39 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-ba0bc042-123f-4f36-9f08-210a9ab52f4b tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-ba0bc042-123f-4f36-9f08-210a9ab52f4b tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.168s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-ba0bc042-123f-4f36-9f08-210a9ab52f4b tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp3mrsf81g/a7f5a5227bf54e5abda7f6ebddf43286.delta 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-ba0bc042-123f-4f36-9f08-210a9ab52f4b tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp3mrsf81g/a7f5a5227bf54e5abda7f6ebddf43286.delta 1073741824" returned: 0 in 0.052s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:40 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-ba0bc042-123f-4f36-9f08-210a9ab52f4b tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 17 03:38:40 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-ba0bc042-123f-4f36-9f08-210a9ab52f4b tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74898) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 03:38:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:38:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-ba0bc042-123f-4f36-9f08-210a9ab52f4b tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74898) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 03:38:41 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-ba0bc042-123f-4f36-9f08-210a9ab52f4b tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 17 03:38:41 user nova-compute[74898]: DEBUG nova.privsep.utils [None req-ba0bc042-123f-4f36-9f08-210a9ab52f4b tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74898) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 03:38:41 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-ba0bc042-123f-4f36-9f08-210a9ab52f4b tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp3mrsf81g/a7f5a5227bf54e5abda7f6ebddf43286.delta /opt/stack/data/nova/instances/snapshots/tmp3mrsf81g/a7f5a5227bf54e5abda7f6ebddf43286 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-ba0bc042-123f-4f36-9f08-210a9ab52f4b tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp3mrsf81g/a7f5a5227bf54e5abda7f6ebddf43286.delta /opt/stack/data/nova/instances/snapshots/tmp3mrsf81g/a7f5a5227bf54e5abda7f6ebddf43286" returned: 0 in 0.583s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:42 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-ba0bc042-123f-4f36-9f08-210a9ab52f4b tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Snapshot extracted, beginning image upload
Nov 17 03:38:44 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-ba0bc042-123f-4f36-9f08-210a9ab52f4b tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Snapshot image upload complete
Nov 17 03:38:44 user nova-compute[74898]: INFO nova.compute.manager [None req-ba0bc042-123f-4f36-9f08-210a9ab52f4b tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Took 5.22 seconds to snapshot the instance on the hypervisor.
Nov 17 03:38:44 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:38:45 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:38:45 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:38:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "336f927e-824f-473f-9bdc-a9595fb76a49" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:38:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "336f927e-824f-473f-9bdc-a9595fb76a49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:38:47 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:38:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:38:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:38:47 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:38:47 user nova-compute[74898]: INFO nova.compute.claims [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Claim successful on node user
Nov 17 03:38:47 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:38:47 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:38:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.247s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:38:47 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:38:47 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:38:47 user nova-compute[74898]: DEBUG nova.network.neutron [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:38:47 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:38:47 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:38:47 user nova-compute[74898]: DEBUG nova.policy [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '70d8f2bbd9f4448096b0991222a32994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeadb4c131e45d5a2756825338e5a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:38:47 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:38:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:38:47 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Creating image(s)
Nov 17 03:38:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "/opt/stack/data/nova/instances/336f927e-824f-473f-9bdc-a9595fb76a49/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:38:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "/opt/stack/data/nova/instances/336f927e-824f-473f-9bdc-a9595fb76a49/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:38:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "/opt/stack/data/nova/instances/336f927e-824f-473f-9bdc-a9595fb76a49/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:38:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "26c79ca4b7bd7cbfd5e6327996b3a9b06c63e7c6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:38:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "26c79ca4b7bd7cbfd5e6327996b3a9b06c63e7c6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:38:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26c79ca4b7bd7cbfd5e6327996b3a9b06c63e7c6.part --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:49 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:38:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:49 user nova-compute[74898]: DEBUG nova.network.neutron [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Successfully created port: 9bd87e94-cbe6-4688-b272-eeb179a89d39 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:38:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26c79ca4b7bd7cbfd5e6327996b3a9b06c63e7c6.part --force-share --output=json" returned: 0 in 0.200s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:49 user nova-compute[74898]: DEBUG nova.virt.images [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] decddeae-d698-432c-8e2e-57c22597e5fa was qcow2, converting to raw {{(pid=74898) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 17 03:38:49 user nova-compute[74898]: DEBUG nova.privsep.utils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74898) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 03:38:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/26c79ca4b7bd7cbfd5e6327996b3a9b06c63e7c6.part /opt/stack/data/nova/instances/_base/26c79ca4b7bd7cbfd5e6327996b3a9b06c63e7c6.converted {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:49 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:38:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/26c79ca4b7bd7cbfd5e6327996b3a9b06c63e7c6.part /opt/stack/data/nova/instances/_base/26c79ca4b7bd7cbfd5e6327996b3a9b06c63e7c6.converted" returned: 0 in 0.683s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:49 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26c79ca4b7bd7cbfd5e6327996b3a9b06c63e7c6.converted --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.network.neutron [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Successfully updated port: 9bd87e94-cbe6-4688-b272-eeb179a89d39 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.compute.manager [req-7da799ac-0ea0-4512-9464-2130c6aa9bd8 req-a57e93af-6322-49f8-bc24-8e4058ea5e57 service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Received event network-changed-9bd87e94-cbe6-4688-b272-eeb179a89d39 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.compute.manager [req-7da799ac-0ea0-4512-9464-2130c6aa9bd8 req-a57e93af-6322-49f8-bc24-8e4058ea5e57 service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Refreshing instance network info cache due to event network-changed-9bd87e94-cbe6-4688-b272-eeb179a89d39. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7da799ac-0ea0-4512-9464-2130c6aa9bd8 req-a57e93af-6322-49f8-bc24-8e4058ea5e57 service nova] Acquiring lock "refresh_cache-336f927e-824f-473f-9bdc-a9595fb76a49" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7da799ac-0ea0-4512-9464-2130c6aa9bd8 req-a57e93af-6322-49f8-bc24-8e4058ea5e57 service nova] Acquired lock "refresh_cache-336f927e-824f-473f-9bdc-a9595fb76a49" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.network.neutron [req-7da799ac-0ea0-4512-9464-2130c6aa9bd8 req-a57e93af-6322-49f8-bc24-8e4058ea5e57 service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Refreshing network info cache for port 9bd87e94-cbe6-4688-b272-eeb179a89d39 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "refresh_cache-336f927e-824f-473f-9bdc-a9595fb76a49" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.network.neutron [req-7da799ac-0ea0-4512-9464-2130c6aa9bd8 req-a57e93af-6322-49f8-bc24-8e4058ea5e57 service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26c79ca4b7bd7cbfd5e6327996b3a9b06c63e7c6.converted --force-share --output=json" returned: 0 in 0.206s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "26c79ca4b7bd7cbfd5e6327996b3a9b06c63e7c6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.232s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26c79ca4b7bd7cbfd5e6327996b3a9b06c63e7c6 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.network.neutron [req-7da799ac-0ea0-4512-9464-2130c6aa9bd8 req-a57e93af-6322-49f8-bc24-8e4058ea5e57 service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7da799ac-0ea0-4512-9464-2130c6aa9bd8 req-a57e93af-6322-49f8-bc24-8e4058ea5e57 service nova] Releasing lock "refresh_cache-336f927e-824f-473f-9bdc-a9595fb76a49" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquired lock "refresh_cache-336f927e-824f-473f-9bdc-a9595fb76a49" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.network.neutron [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26c79ca4b7bd7cbfd5e6327996b3a9b06c63e7c6 --force-share --output=json" returned: 0 in 0.180s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "26c79ca4b7bd7cbfd5e6327996b3a9b06c63e7c6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "26c79ca4b7bd7cbfd5e6327996b3a9b06c63e7c6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26c79ca4b7bd7cbfd5e6327996b3a9b06c63e7c6 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.network.neutron [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26c79ca4b7bd7cbfd5e6327996b3a9b06c63e7c6 --force-share --output=json" returned: 0 in 0.174s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/26c79ca4b7bd7cbfd5e6327996b3a9b06c63e7c6,backing_fmt=raw /opt/stack/data/nova/instances/336f927e-824f-473f-9bdc-a9595fb76a49/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/26c79ca4b7bd7cbfd5e6327996b3a9b06c63e7c6,backing_fmt=raw /opt/stack/data/nova/instances/336f927e-824f-473f-9bdc-a9595fb76a49/disk 1073741824" returned: 0 in 0.049s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "26c79ca4b7bd7cbfd5e6327996b3a9b06c63e7c6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26c79ca4b7bd7cbfd5e6327996b3a9b06c63e7c6 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.network.neutron [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Updating instance_info_cache with network_info: [{"id": "9bd87e94-cbe6-4688-b272-eeb179a89d39", "address": "fa:16:3e:c1:bb:b4", "network": {"id": "11050b0f-b7a6-40b1-83ed-f177fe8ff374", "bridge": "br-int", "label": "tempest-TestStampPattern-1875435424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eeadb4c131e45d5a2756825338e5a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bd87e94-cb", "ovs_interfaceid": "9bd87e94-cbe6-4688-b272-eeb179a89d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Releasing lock "refresh_cache-336f927e-824f-473f-9bdc-a9595fb76a49" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Instance network_info: |[{"id": "9bd87e94-cbe6-4688-b272-eeb179a89d39", "address": "fa:16:3e:c1:bb:b4", "network": {"id": "11050b0f-b7a6-40b1-83ed-f177fe8ff374", "bridge": "br-int", "label": "tempest-TestStampPattern-1875435424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eeadb4c131e45d5a2756825338e5a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bd87e94-cb", "ovs_interfaceid": "9bd87e94-cbe6-4688-b272-eeb179a89d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26c79ca4b7bd7cbfd5e6327996b3a9b06c63e7c6 --force-share --output=json" returned: 0 in 0.172s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Ensure instance console log exists: /opt/stack/data/nova/instances/336f927e-824f-473f-9bdc-a9595fb76a49/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Start _get_guest_xml network_info=[{"id": "9bd87e94-cbe6-4688-b272-eeb179a89d39", "address": "fa:16:3e:c1:bb:b4", "network": {"id": "11050b0f-b7a6-40b1-83ed-f177fe8ff374", "bridge": "br-int", "label": "tempest-TestStampPattern-1875435424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eeadb4c131e45d5a2756825338e5a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bd87e94-cb", "ovs_interfaceid": "9bd87e94-cbe6-4688-b272-eeb179a89d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='32f2d9bf7d745411b47fb951b1e59a10',container_format='bare',created_at=2023-11-17T03:38:39Z,direct_url=<?>,disk_format='qcow2',id=decddeae-d698-432c-8e2e-57c22597e5fa,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-562439629',owner='0eeadb4c131e45d5a2756825338e5a5d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-17T03:38:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': 'decddeae-d698-432c-8e2e-57c22597e5fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:38:50 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:38:50 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:38:50 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='32f2d9bf7d745411b47fb951b1e59a10',container_format='bare',created_at=2023-11-17T03:38:39Z,direct_url=<?>,disk_format='qcow2',id=decddeae-d698-432c-8e2e-57c22597e5fa,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-562439629',owner='0eeadb4c131e45d5a2756825338e5a5d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-17T03:38:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:38:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1348849848',display_name='tempest-TestStampPattern-server-1348849848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1348849848',id=50,image_ref='decddeae-d698-432c-8e2e-57c22597e5fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNa/gTkhJ7iIlZtCXnubc5rXETxMR2xUqH0IcU5ToxMKsPxgETVhY1EbVW15n7a6qWBKm8+HQ/+QUHZOadI1pzdW0upx9o5IqHzfYPIJA/hjdkH9FBegXsZhGz2BAci2Q==',key_name='tempest-TestStampPattern-825908881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eeadb4c131e45d5a2756825338e5a5d',ramdisk_id='',reservation_id='r-cm7tuf0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='25ab4a8b-372b-42ab-8929-1d8c3262e3ca',image_min_disk='1',image_min_ram='0',image_owner_id='0eeadb4c131e45d5a2756825338e5a5d',image_owner_project_name='tempest-TestStampPattern-1480169250',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1480169250-project-member',image_user_id='70d8f2bbd9f4448096b0991222a32994',network_allocated='True',owner_project_name='tempest-TestStampPattern-1480169250',owner_user_name='tempest-TestStampPattern-1480169250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:38:48Z,user_data=None,user_id='70d8f2bbd9f4448096b0991222a32994',uuid=336f927e-824f-473f-9bdc-a9595fb76a49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bd87e94-cbe6-4688-b272-eeb179a89d39", "address": "fa:16:3e:c1:bb:b4", "network": {"id": "11050b0f-b7a6-40b1-83ed-f177fe8ff374", "bridge": "br-int", "label": "tempest-TestStampPattern-1875435424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eeadb4c131e45d5a2756825338e5a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bd87e94-cb", "ovs_interfaceid": "9bd87e94-cbe6-4688-b272-eeb179a89d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Converting VIF {"id": "9bd87e94-cbe6-4688-b272-eeb179a89d39", "address": "fa:16:3e:c1:bb:b4", "network": {"id": "11050b0f-b7a6-40b1-83ed-f177fe8ff374", "bridge": "br-int", "label": "tempest-TestStampPattern-1875435424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eeadb4c131e45d5a2756825338e5a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bd87e94-cb", "ovs_interfaceid": "9bd87e94-cbe6-4688-b272-eeb179a89d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:bb:b4,bridge_name='br-int',has_traffic_filtering=True,id=9bd87e94-cbe6-4688-b272-eeb179a89d39,network=Network(11050b0f-b7a6-40b1-83ed-f177fe8ff374),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bd87e94-cb') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.objects.instance [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lazy-loading 'pci_devices' on Instance uuid 336f927e-824f-473f-9bdc-a9595fb76a49 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:38:50 user nova-compute[74898]:   <uuid>336f927e-824f-473f-9bdc-a9595fb76a49</uuid>
Nov 17 03:38:50 user nova-compute[74898]:   <name>instance-00000032</name>
Nov 17 03:38:50 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:38:50 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:38:50 user nova-compute[74898]:   <metadata>
Nov 17 03:38:50 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:38:50 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:38:50 user nova-compute[74898]:       <nova:name>tempest-TestStampPattern-server-1348849848</nova:name>
Nov 17 03:38:50 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:38:50</nova:creationTime>
Nov 17 03:38:50 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:38:50 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:38:50 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:38:50 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:38:50 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:38:50 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:38:50 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:38:50 user nova-compute[74898]:       <nova:owner>
Nov 17 03:38:50 user nova-compute[74898]:         <nova:user uuid="70d8f2bbd9f4448096b0991222a32994">tempest-TestStampPattern-1480169250-project-member</nova:user>
Nov 17 03:38:50 user nova-compute[74898]:         <nova:project uuid="0eeadb4c131e45d5a2756825338e5a5d">tempest-TestStampPattern-1480169250</nova:project>
Nov 17 03:38:50 user nova-compute[74898]:       </nova:owner>
Nov 17 03:38:50 user nova-compute[74898]:       <nova:root type="image" uuid="decddeae-d698-432c-8e2e-57c22597e5fa"/>
Nov 17 03:38:50 user nova-compute[74898]:       <nova:ports>
Nov 17 03:38:50 user nova-compute[74898]:         <nova:port uuid="9bd87e94-cbe6-4688-b272-eeb179a89d39">
Nov 17 03:38:50 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 17 03:38:50 user nova-compute[74898]:         </nova:port>
Nov 17 03:38:50 user nova-compute[74898]:       </nova:ports>
Nov 17 03:38:50 user nova-compute[74898]:     </nova:instance>
Nov 17 03:38:50 user nova-compute[74898]:   </metadata>
Nov 17 03:38:50 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:38:50 user nova-compute[74898]:     <system>
Nov 17 03:38:50 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:38:50 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:38:50 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:38:50 user nova-compute[74898]:       <entry name="serial">336f927e-824f-473f-9bdc-a9595fb76a49</entry>
Nov 17 03:38:50 user nova-compute[74898]:       <entry name="uuid">336f927e-824f-473f-9bdc-a9595fb76a49</entry>
Nov 17 03:38:50 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:38:50 user nova-compute[74898]:     </system>
Nov 17 03:38:50 user nova-compute[74898]:   </sysinfo>
Nov 17 03:38:50 user nova-compute[74898]:   <os>
Nov 17 03:38:50 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:38:50 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:38:50 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:38:50 user nova-compute[74898]:   </os>
Nov 17 03:38:50 user nova-compute[74898]:   <features>
Nov 17 03:38:50 user nova-compute[74898]:     <acpi/>
Nov 17 03:38:50 user nova-compute[74898]:     <apic/>
Nov 17 03:38:50 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:38:50 user nova-compute[74898]:   </features>
Nov 17 03:38:50 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:38:50 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:38:50 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:38:50 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:38:50 user nova-compute[74898]:   </clock>
Nov 17 03:38:50 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:38:50 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:38:50 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:38:50 user nova-compute[74898]:   </cpu>
Nov 17 03:38:50 user nova-compute[74898]:   <devices>
Nov 17 03:38:50 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:38:50 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:38:50 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/336f927e-824f-473f-9bdc-a9595fb76a49/disk"/>
Nov 17 03:38:50 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:38:50 user nova-compute[74898]:     </disk>
Nov 17 03:38:50 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:38:50 user nova-compute[74898]:       <mac address="fa:16:3e:c1:bb:b4"/>
Nov 17 03:38:50 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:38:50 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:38:50 user nova-compute[74898]:       <target dev="tap9bd87e94-cb"/>
Nov 17 03:38:50 user nova-compute[74898]:     </interface>
Nov 17 03:38:50 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:38:50 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/336f927e-824f-473f-9bdc-a9595fb76a49/console.log" append="off"/>
Nov 17 03:38:50 user nova-compute[74898]:     </serial>
Nov 17 03:38:50 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:38:50 user nova-compute[74898]:     <video>
Nov 17 03:38:50 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:38:50 user nova-compute[74898]:     </video>
Nov 17 03:38:50 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:38:50 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:38:50 user nova-compute[74898]:     </rng>
Nov 17 03:38:50 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:38:50 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:38:50 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:38:50 user nova-compute[74898]:     </memballoon>
Nov 17 03:38:50 user nova-compute[74898]:   </devices>
Nov 17 03:38:50 user nova-compute[74898]: </domain>
Nov 17 03:38:50 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:38:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1348849848',display_name='tempest-TestStampPattern-server-1348849848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1348849848',id=50,image_ref='decddeae-d698-432c-8e2e-57c22597e5fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNa/gTkhJ7iIlZtCXnubc5rXETxMR2xUqH0IcU5ToxMKsPxgETVhY1EbVW15n7a6qWBKm8+HQ/+QUHZOadI1pzdW0upx9o5IqHzfYPIJA/hjdkH9FBegXsZhGz2BAci2Q==',key_name='tempest-TestStampPattern-825908881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eeadb4c131e45d5a2756825338e5a5d',ramdisk_id='',reservation_id='r-cm7tuf0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='25ab4a8b-372b-42ab-8929-1d8c3262e3ca',image_min_disk='1',image_min_ram='0',image_owner_id='0eeadb4c131e45d5a2756825338e5a5d',image_owner_project_name='tempest-TestStampPattern-1480169250',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1480169250-project-member',image_user_id='70d8f2bbd9f4448096b0991222a32994',network_allocated='True',owner_project_name='tempest-TestStampPattern-1480169250',owner_user_name='tempest-TestStampPattern-1480169250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:38:48Z,user_data=None,user_id='70d8f2bbd9f4448096b0991222a32994',uuid=336f927e-824f-473f-9bdc-a9595fb76a49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bd87e94-cbe6-4688-b272-eeb179a89d39", "address": "fa:16:3e:c1:bb:b4", "network": {"id": "11050b0f-b7a6-40b1-83ed-f177fe8ff374", "bridge": "br-int", "label": "tempest-TestStampPattern-1875435424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eeadb4c131e45d5a2756825338e5a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bd87e94-cb", "ovs_interfaceid": "9bd87e94-cbe6-4688-b272-eeb179a89d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Converting VIF {"id": "9bd87e94-cbe6-4688-b272-eeb179a89d39", "address": "fa:16:3e:c1:bb:b4", "network": {"id": "11050b0f-b7a6-40b1-83ed-f177fe8ff374", "bridge": "br-int", "label": "tempest-TestStampPattern-1875435424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eeadb4c131e45d5a2756825338e5a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bd87e94-cb", "ovs_interfaceid": "9bd87e94-cbe6-4688-b272-eeb179a89d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:bb:b4,bridge_name='br-int',has_traffic_filtering=True,id=9bd87e94-cbe6-4688-b272-eeb179a89d39,network=Network(11050b0f-b7a6-40b1-83ed-f177fe8ff374),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bd87e94-cb') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG os_vif [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:bb:b4,bridge_name='br-int',has_traffic_filtering=True,id=9bd87e94-cbe6-4688-b272-eeb179a89d39,network=Network(11050b0f-b7a6-40b1-83ed-f177fe8ff374),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bd87e94-cb') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b4192e5-5f1f-53dc-8b26-7a32572d3b25', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9bd87e94-cb, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9bd87e94-cb, col_values=(('qos', UUID('8ca09046-f463-4871-b9bf-cfbab8386b57')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9bd87e94-cb, col_values=(('external_ids', {'iface-id': '9bd87e94-cbe6-4688-b272-eeb179a89d39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:bb:b4', 'vm-uuid': '336f927e-824f-473f-9bdc-a9595fb76a49'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:38:50 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:50 user nova-compute[74898]: INFO os_vif [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:bb:b4,bridge_name='br-int',has_traffic_filtering=True,id=9bd87e94-cbe6-4688-b272-eeb179a89d39,network=Network(11050b0f-b7a6-40b1-83ed-f177fe8ff374),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bd87e94-cb')
Nov 17 03:38:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:38:51 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] No VIF found with MAC fa:16:3e:c1:bb:b4, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:38:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:52 user nova-compute[74898]: DEBUG nova.compute.manager [req-c8c6c82c-8af4-43d5-978e-ab9f83809420 req-13a6ebdb-bdc8-4755-a3c8-b6c95527fa09 service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Received event network-vif-plugged-9bd87e94-cbe6-4688-b272-eeb179a89d39 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:38:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c8c6c82c-8af4-43d5-978e-ab9f83809420 req-13a6ebdb-bdc8-4755-a3c8-b6c95527fa09 service nova] Acquiring lock "336f927e-824f-473f-9bdc-a9595fb76a49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:38:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c8c6c82c-8af4-43d5-978e-ab9f83809420 req-13a6ebdb-bdc8-4755-a3c8-b6c95527fa09 service nova] Lock "336f927e-824f-473f-9bdc-a9595fb76a49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:38:52 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-c8c6c82c-8af4-43d5-978e-ab9f83809420 req-13a6ebdb-bdc8-4755-a3c8-b6c95527fa09 service nova] Lock "336f927e-824f-473f-9bdc-a9595fb76a49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:38:52 user nova-compute[74898]: DEBUG nova.compute.manager [req-c8c6c82c-8af4-43d5-978e-ab9f83809420 req-13a6ebdb-bdc8-4755-a3c8-b6c95527fa09 service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] No waiting events found dispatching network-vif-plugged-9bd87e94-cbe6-4688-b272-eeb179a89d39 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:38:52 user nova-compute[74898]: WARNING nova.compute.manager [req-c8c6c82c-8af4-43d5-978e-ab9f83809420 req-13a6ebdb-bdc8-4755-a3c8-b6c95527fa09 service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Received unexpected event network-vif-plugged-9bd87e94-cbe6-4688-b272-eeb179a89d39 for instance with vm_state building and task_state spawning.
Nov 17 03:38:54 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 98ced818-ad9a-4020-9f2b-2520934530ba is timed out.
Nov 17 03:38:54 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Successfully detached device vdb from instance 98ced818-ad9a-4020-9f2b-2520934530ba from the live domain config.
Nov 17 03:38:54 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zsgDbIjU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:38:54 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:38:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f041d9df-3cba-4ed2-9c09-294ad0f25f51]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:38:54 user nova-compute[74898]: No targets found.
Nov 17 03:38:54 user nova-compute[74898]: iSNS:
Nov 17 03:38:54 user nova-compute[74898]: No targets found.
Nov 17 03:38:54 user nova-compute[74898]: STATIC:
Nov 17 03:38:54 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2
Nov 17 03:38:54 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:38:54 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:38:54 user nova-compute[74898]: FIRMWARE:
Nov 17 03:38:54 user nova-compute[74898]: No targets found.
Nov 17 03:38:54 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:38:54 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:38:54 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[25397210-9a4b-4d77-8b7d-ce09a6563216]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[543cfbd3-bea3-4c69-ba5c-934f86703881]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2 (non-flash)
Nov 17 03:38:54 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2 (non-flash)
Nov 17 03:38:54 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf84ca440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2'): ({'sdb'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Removing single pathed devices sdb {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b777182-fdf5-47ff-ae20-ae262c54092c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8d296c-9335-419a-ba52-21ffcd50887f]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Flushing IO for device /dev/sdb {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[934b6038-cecf-4347-8599-01fd32cf4651]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6dd9e8-286f-4b27-81fa-a00275609225]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[099d4cff-1449-4274-950d-563e15d081a0]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:38:54 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Instance spawned successfully.
Nov 17 03:38:54 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[637d4589-f7b7-4010-8d76-4912d7718be9]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2, portal: 172.16.0.220,3260]
Nov 17 03:38:54 user nova-compute[74898]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2, portal: 172.16.0.220,3260] successful.
Nov 17 03:38:54 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dacad1b-11fd-4af6-9f0c-a363fc4f0dd2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a19dbc-993c-42c1-86cc-550ccf01406e]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] <== disconnect_volume: return (288ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:38:54 user nova-compute[74898]: INFO nova.compute.manager [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Took 6.42 seconds to spawn the instance on the hypervisor.
Nov 17 03:38:54 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:38:54 user nova-compute[74898]: INFO nova.compute.manager [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Took 6.98 seconds to build instance.
Nov 17 03:38:54 user nova-compute[74898]: DEBUG nova.compute.manager [req-6d3ac920-8656-4563-a537-a7fac816d9fe req-64759d71-9fda-4ad8-8b50-b7ec9895ede4 service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Received event network-vif-plugged-9bd87e94-cbe6-4688-b272-eeb179a89d39 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-6d3ac920-8656-4563-a537-a7fac816d9fe req-64759d71-9fda-4ad8-8b50-b7ec9895ede4 service nova] Acquiring lock "336f927e-824f-473f-9bdc-a9595fb76a49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-6d3ac920-8656-4563-a537-a7fac816d9fe req-64759d71-9fda-4ad8-8b50-b7ec9895ede4 service nova] Lock "336f927e-824f-473f-9bdc-a9595fb76a49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-6d3ac920-8656-4563-a537-a7fac816d9fe req-64759d71-9fda-4ad8-8b50-b7ec9895ede4 service nova] Lock "336f927e-824f-473f-9bdc-a9595fb76a49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG nova.compute.manager [req-6d3ac920-8656-4563-a537-a7fac816d9fe req-64759d71-9fda-4ad8-8b50-b7ec9895ede4 service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] No waiting events found dispatching network-vif-plugged-9bd87e94-cbe6-4688-b272-eeb179a89d39 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:38:54 user nova-compute[74898]: WARNING nova.compute.manager [req-6d3ac920-8656-4563-a537-a7fac816d9fe req-64759d71-9fda-4ad8-8b50-b7ec9895ede4 service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Received unexpected event network-vif-plugged-9bd87e94-cbe6-4688-b272-eeb179a89d39 for instance with vm_state active and task_state None.
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c1eb38b9-5ef6-4fa5-8322-31a72ff2f8cd tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "336f927e-824f-473f-9bdc-a9595fb76a49" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.237s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:38:54 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:38:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:55 user nova-compute[74898]: DEBUG nova.objects.instance [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lazy-loading 'flavor' on Instance uuid 98ced818-ad9a-4020-9f2b-2520934530ba {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:38:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ef89c474-b471-46b5-b81c-50dac63e8f9d tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "98ced818-ad9a-4020-9f2b-2520934530ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.703s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:38:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f371ad-3117-4dd7-a08f-e66f83e0ea90/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f371ad-3117-4dd7-a08f-e66f83e0ea90/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f371ad-3117-4dd7-a08f-e66f83e0ea90/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8f371ad-3117-4dd7-a08f-e66f83e0ea90/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:55 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336f927e-824f-473f-9bdc-a9595fb76a49/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336f927e-824f-473f-9bdc-a9595fb76a49/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336f927e-824f-473f-9bdc-a9595fb76a49/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:38:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336f927e-824f-473f-9bdc-a9595fb76a49/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:38:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:38:57 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:38:57 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:38:57 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=8640MB free_disk=25.068492889404297GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:38:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:38:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:38:57 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 25ab4a8b-372b-42ab-8929-1d8c3262e3ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:38:57 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 98ced818-ad9a-4020-9f2b-2520934530ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:38:57 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance f8f371ad-3117-4dd7-a08f-e66f83e0ea90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:38:57 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 336f927e-824f-473f-9bdc-a9595fb76a49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:38:57 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:38:57 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:38:57 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:38:57 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:38:57 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:38:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:38:58 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:38:58 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:38:58 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:38:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-98ced818-ad9a-4020-9f2b-2520934530ba" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:38:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-98ced818-ad9a-4020-9f2b-2520934530ba" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:38:58 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:38:58 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Updating instance_info_cache with network_info: [{"id": "0ee25c23-7b34-488e-97b1-db66f921a502", "address": "fa:16:3e:82:10:be", "network": {"id": "9efcfeea-8c01-45a8-8a77-3d6a18c71729", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-925876126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8de3683d8d2c4bafbd516c6d80c8486d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee25c23-7b", "ovs_interfaceid": "0ee25c23-7b34-488e-97b1-db66f921a502", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:38:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-98ced818-ad9a-4020-9f2b-2520934530ba" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:38:58 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:38:58 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:39:00 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:39:05 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:39:10 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:39:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:39:15 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:39:16 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:39:20 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:39:21 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:39:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "98ced818-ad9a-4020-9f2b-2520934530ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:39:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "98ced818-ad9a-4020-9f2b-2520934530ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:39:25 user nova-compute[74898]: DEBUG nova.objects.instance [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lazy-loading 'flavor' on Instance uuid 98ced818-ad9a-4020-9f2b-2520934530ba {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:39:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "98ced818-ad9a-4020-9f2b-2520934530ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:39:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "98ced818-ad9a-4020-9f2b-2520934530ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:39:25 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "98ced818-ad9a-4020-9f2b-2520934530ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:39:25 user nova-compute[74898]: INFO nova.compute.manager [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Attaching volume 3762b355-fd70-411a-ba38-2a6d040f8c39 to /dev/vdb
Nov 17 03:39:25 user nova-compute[74898]: DEBUG os_brick.utils [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:39:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:39:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:39:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec40e6da-9845-4045-a84c-a6e55c55812f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:39:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:39:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[55020c2c-ce5f-459e-88ac-cc6d3d9ab2da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:39:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:39:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7611e8-747a-4e0d-aaf7-31e879d56e3e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:39:25 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[99148f98-94b6-4e6b-8c16-a42272d3139b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:39:25 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:39:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:39:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:26 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:39:26 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:39:26 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2588d8db-80d2-4ba1-b922-3e1160327404]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:39:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:39:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:39:26 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:39:26 user nova-compute[74898]: DEBUG os_brick.utils [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:39:26 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Updating existing volume attachment record: 4f9e8267-8f0d-4d1f-8952-73425e8fe77a {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:39:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:39:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c68fbe44-2296-4c5b-a1e1-f82da2c404dd tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Acquiring lock "f8f371ad-3117-4dd7-a08f-e66f83e0ea90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:39:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c68fbe44-2296-4c5b-a1e1-f82da2c404dd tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "f8f371ad-3117-4dd7-a08f-e66f83e0ea90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:39:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c68fbe44-2296-4c5b-a1e1-f82da2c404dd tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Acquiring lock "f8f371ad-3117-4dd7-a08f-e66f83e0ea90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:39:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c68fbe44-2296-4c5b-a1e1-f82da2c404dd tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "f8f371ad-3117-4dd7-a08f-e66f83e0ea90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:39:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c68fbe44-2296-4c5b-a1e1-f82da2c404dd tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "f8f371ad-3117-4dd7-a08f-e66f83e0ea90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:39:29 user nova-compute[74898]: INFO nova.compute.manager [None req-c68fbe44-2296-4c5b-a1e1-f82da2c404dd tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Terminating instance
Nov 17 03:39:29 user nova-compute[74898]: DEBUG nova.compute.manager [None req-c68fbe44-2296-4c5b-a1e1-f82da2c404dd tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:39:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:39:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:39:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:39:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:39:29 user nova-compute[74898]: DEBUG nova.compute.manager [req-14466988-4ca5-4d5c-9e9f-92aa99548fc6 req-59c2a8d5-2771-4ce2-89d5-47ff6c83a8c5 service nova] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Received event network-vif-unplugged-e9aba286-7203-4e63-8a1d-8dd7e13a3292 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:39:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-14466988-4ca5-4d5c-9e9f-92aa99548fc6 req-59c2a8d5-2771-4ce2-89d5-47ff6c83a8c5 service nova] Acquiring lock "f8f371ad-3117-4dd7-a08f-e66f83e0ea90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:39:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-14466988-4ca5-4d5c-9e9f-92aa99548fc6 req-59c2a8d5-2771-4ce2-89d5-47ff6c83a8c5 service nova] Lock "f8f371ad-3117-4dd7-a08f-e66f83e0ea90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:39:29 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-14466988-4ca5-4d5c-9e9f-92aa99548fc6 req-59c2a8d5-2771-4ce2-89d5-47ff6c83a8c5 service nova] Lock "f8f371ad-3117-4dd7-a08f-e66f83e0ea90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:39:29 user nova-compute[74898]: DEBUG nova.compute.manager [req-14466988-4ca5-4d5c-9e9f-92aa99548fc6 req-59c2a8d5-2771-4ce2-89d5-47ff6c83a8c5 service nova] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] No waiting events found dispatching network-vif-unplugged-e9aba286-7203-4e63-8a1d-8dd7e13a3292 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:39:29 user nova-compute[74898]: DEBUG nova.compute.manager [req-14466988-4ca5-4d5c-9e9f-92aa99548fc6 req-59c2a8d5-2771-4ce2-89d5-47ff6c83a8c5 service nova] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Received event network-vif-unplugged-e9aba286-7203-4e63-8a1d-8dd7e13a3292 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:39:29 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Instance destroyed successfully.
Nov 17 03:39:29 user nova-compute[74898]: DEBUG nova.objects.instance [None req-c68fbe44-2296-4c5b-a1e1-f82da2c404dd tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lazy-loading 'resources' on Instance uuid f8f371ad-3117-4dd7-a08f-e66f83e0ea90 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:39:29 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-c68fbe44-2296-4c5b-a1e1-f82da2c404dd tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:37:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-978069785',display_name='tempest-VolumesActionsTest-instance-978069785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-978069785',id=49,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:37:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d10fbc9614248b68a632ac20bcc50d9',ramdisk_id='',reservation_id='r-apuzwmka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-449010661',owner_user_name='tempest-VolumesActionsTest-449010661-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:37:45Z,user_data=None,user_id='f053a881930440279c298a857df6e1dd',uuid=f8f371ad-3117-4dd7-a08f-e66f83e0ea90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9aba286-7203-4e63-8a1d-8dd7e13a3292", "address": "fa:16:3e:cd:0c:2d", "network": {"id": "b1fbc710-83f1-4388-aca7-a91fd4e9323d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1026031661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d10fbc9614248b68a632ac20bcc50d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9aba286-72", "ovs_interfaceid": "e9aba286-7203-4e63-8a1d-8dd7e13a3292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:39:29 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-c68fbe44-2296-4c5b-a1e1-f82da2c404dd tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Converting VIF {"id": "e9aba286-7203-4e63-8a1d-8dd7e13a3292", "address": "fa:16:3e:cd:0c:2d", "network": {"id": "b1fbc710-83f1-4388-aca7-a91fd4e9323d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1026031661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d10fbc9614248b68a632ac20bcc50d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9aba286-72", "ovs_interfaceid": "e9aba286-7203-4e63-8a1d-8dd7e13a3292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:39:29 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-c68fbe44-2296-4c5b-a1e1-f82da2c404dd tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:0c:2d,bridge_name='br-int',has_traffic_filtering=True,id=e9aba286-7203-4e63-8a1d-8dd7e13a3292,network=Network(b1fbc710-83f1-4388-aca7-a91fd4e9323d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9aba286-72') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:39:29 user nova-compute[74898]: DEBUG os_vif [None req-c68fbe44-2296-4c5b-a1e1-f82da2c404dd tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:0c:2d,bridge_name='br-int',has_traffic_filtering=True,id=e9aba286-7203-4e63-8a1d-8dd7e13a3292,network=Network(b1fbc710-83f1-4388-aca7-a91fd4e9323d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9aba286-72') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:39:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:39:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9aba286-72, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:39:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:39:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:39:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:39:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c11dc37e-4075-44c1-921d-6152daacde4a) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:39:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:39:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:39:29 user nova-compute[74898]: INFO os_vif [None req-c68fbe44-2296-4c5b-a1e1-f82da2c404dd tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:0c:2d,bridge_name='br-int',has_traffic_filtering=True,id=e9aba286-7203-4e63-8a1d-8dd7e13a3292,network=Network(b1fbc710-83f1-4388-aca7-a91fd4e9323d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9aba286-72')
Nov 17 03:39:29 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-c68fbe44-2296-4c5b-a1e1-f82da2c404dd tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Deleting instance files /opt/stack/data/nova/instances/f8f371ad-3117-4dd7-a08f-e66f83e0ea90_del
Nov 17 03:39:29 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-c68fbe44-2296-4c5b-a1e1-f82da2c404dd tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Deletion of /opt/stack/data/nova/instances/f8f371ad-3117-4dd7-a08f-e66f83e0ea90_del complete
Nov 17 03:39:30 user nova-compute[74898]: INFO nova.compute.manager [None req-c68fbe44-2296-4c5b-a1e1-f82da2c404dd tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 17 03:39:30 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-c68fbe44-2296-4c5b-a1e1-f82da2c404dd tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:39:30 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:39:30 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:39:30 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:39:30 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Took 0.48 seconds to deallocate network for instance.
Nov 17 03:39:30 user nova-compute[74898]: DEBUG nova.compute.manager [req-59475d3c-5733-4981-8ed7-58f042ff01f0 req-95f70300-5359-45fa-a7c2-d51cd25fdc44 service nova] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Received event network-vif-deleted-e9aba286-7203-4e63-8a1d-8dd7e13a3292 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:39:30 user nova-compute[74898]: INFO nova.compute.manager [req-59475d3c-5733-4981-8ed7-58f042ff01f0 req-95f70300-5359-45fa-a7c2-d51cd25fdc44 service nova] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Neutron deleted interface e9aba286-7203-4e63-8a1d-8dd7e13a3292; detaching it from the instance and deleting it from the info cache
Nov 17 03:39:30 user nova-compute[74898]: DEBUG nova.network.neutron [req-59475d3c-5733-4981-8ed7-58f042ff01f0 req-95f70300-5359-45fa-a7c2-d51cd25fdc44 service nova] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:39:30 user nova-compute[74898]: DEBUG nova.compute.manager [req-59475d3c-5733-4981-8ed7-58f042ff01f0 req-95f70300-5359-45fa-a7c2-d51cd25fdc44 service nova] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Detach interface failed, port_id=e9aba286-7203-4e63-8a1d-8dd7e13a3292, reason: Instance f8f371ad-3117-4dd7-a08f-e66f83e0ea90 could not be found. {{(pid=74898) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 03:39:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c68fbe44-2296-4c5b-a1e1-f82da2c404dd tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:39:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c68fbe44-2296-4c5b-a1e1-f82da2c404dd tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:39:30 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-c68fbe44-2296-4c5b-a1e1-f82da2c404dd tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:39:30 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-c68fbe44-2296-4c5b-a1e1-f82da2c404dd tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:39:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c68fbe44-2296-4c5b-a1e1-f82da2c404dd tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.193s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:39:30 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-c68fbe44-2296-4c5b-a1e1-f82da2c404dd tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Deleted allocations for instance f8f371ad-3117-4dd7-a08f-e66f83e0ea90
Nov 17 03:39:30 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-c68fbe44-2296-4c5b-a1e1-f82da2c404dd tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "f8f371ad-3117-4dd7-a08f-e66f83e0ea90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.512s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kzdKEvIr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:39:31 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:39:31 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:39:31 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:39:31 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:39:31 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d4071c-c811-4183-9090-4afcdcfa98b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:39:31 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a4d534-2295-4b93-ae45-96f78b6aae2c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39] added
Nov 17 03:39:31 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[96aa8707-013b-4040-bf60-60ccff39c808]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e626475a-f1c0-400c-83df-ba82e515254c]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kzdKEvIr {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kzdKEvIr" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d369361-cc51-45d6-857a-85fae0d60576]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kzdKEvIr'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5359d4f1-2e0a-48d4-b6f1-8027244b0cd6]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[05424e09-2394-41c5-bca2-6aa8d73e3143]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 17 03:39:31 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 17 03:39:31 user nova-compute[74898]:  {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:39:31 user nova-compute[74898]: WARNING os_brick.initiator.connectors.iscsi [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 17 03:39:31 user nova-compute[74898]: 
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc9ea8f-a37c-4c4f-94e6-3c7352c757eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39, portal: 172.16.0.220,3260]
Nov 17 03:39:31 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39, portal: 172.16.0.220,3260] successful.
Nov 17 03:39:31 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f30d3cc-498f-43e1-b6f3-b65dbcaadb8f]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39c5097-1fa0-4781-ad64-d5c1980e72f0]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39 (non-flash)
Nov 17 03:39:31 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39 (non-flash)
Nov 17 03:39:31 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG nova.compute.manager [req-68d08009-e2df-412d-bb41-118926c02eea req-a8c9e1e3-42ed-4855-a1ab-08465543fdc5 service nova] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Received event network-vif-plugged-e9aba286-7203-4e63-8a1d-8dd7e13a3292 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-68d08009-e2df-412d-bb41-118926c02eea req-a8c9e1e3-42ed-4855-a1ab-08465543fdc5 service nova] Acquiring lock "f8f371ad-3117-4dd7-a08f-e66f83e0ea90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-68d08009-e2df-412d-bb41-118926c02eea req-a8c9e1e3-42ed-4855-a1ab-08465543fdc5 service nova] Lock "f8f371ad-3117-4dd7-a08f-e66f83e0ea90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-68d08009-e2df-412d-bb41-118926c02eea req-a8c9e1e3-42ed-4855-a1ab-08465543fdc5 service nova] Lock "f8f371ad-3117-4dd7-a08f-e66f83e0ea90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG nova.compute.manager [req-68d08009-e2df-412d-bb41-118926c02eea req-a8c9e1e3-42ed-4855-a1ab-08465543fdc5 service nova] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] No waiting events found dispatching network-vif-plugged-e9aba286-7203-4e63-8a1d-8dd7e13a3292 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:39:31 user nova-compute[74898]: WARNING nova.compute.manager [req-68d08009-e2df-412d-bb41-118926c02eea req-a8c9e1e3-42ed-4855-a1ab-08465543fdc5 service nova] [instance: f8f371ad-3117-4dd7-a08f-e66f83e0ea90] Received unexpected event network-vif-plugged-e9aba286-7203-4e63-8a1d-8dd7e13a3292 for instance with vm_state deleted and task_state None.
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[31bd3170-6b81-432e-b18b-51655dcd5e0e]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:39:31 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kzdKEvIr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:39:32 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:39:32 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23963336432333335', 'path': '/dev/sdb'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:39:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963336432333335', 'path': '/dev/sdb'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:39:32 user nova-compute[74898]: DEBUG nova.objects.instance [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lazy-loading 'flavor' on Instance uuid 98ced818-ad9a-4020-9f2b-2520934530ba {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:39:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 03:39:32 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:39:32 user nova-compute[74898]:   <source dev="/dev/sdb"/>
Nov 17 03:39:32 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:39:32 user nova-compute[74898]:   <serial>3762b355-fd70-411a-ba38-2a6d040f8c39</serial>
Nov 17 03:39:32 user nova-compute[74898]: </disk>
Nov 17 03:39:32 user nova-compute[74898]:  {{(pid=74898) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 03:39:33 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:39:33 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:39:33 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] No VIF found with MAC fa:16:3e:82:10:be, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:39:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6fbdede6-1308-4694-9516-a1361744d92a tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "98ced818-ad9a-4020-9f2b-2520934530ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.322s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:39:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:39:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "98ced818-ad9a-4020-9f2b-2520934530ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:39:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "98ced818-ad9a-4020-9f2b-2520934530ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:39:35 user nova-compute[74898]: INFO nova.compute.manager [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Detaching volume 3762b355-fd70-411a-ba38-2a6d040f8c39
Nov 17 03:39:35 user nova-compute[74898]: INFO nova.virt.block_device [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Attempting to driver detach volume 3762b355-fd70-411a-ba38-2a6d040f8c39 from mountpoint /dev/vdb
Nov 17 03:39:35 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Attempting to detach device vdb from instance 98ced818-ad9a-4020-9f2b-2520934530ba from the persistent domain config. {{(pid=74898) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 03:39:35 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:39:35 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:39:35 user nova-compute[74898]:   <source dev="/dev/sdb"/>
Nov 17 03:39:35 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:39:35 user nova-compute[74898]:   <serial>3762b355-fd70-411a-ba38-2a6d040f8c39</serial>
Nov 17 03:39:35 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:39:35 user nova-compute[74898]: </disk>
Nov 17 03:39:35 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:39:35 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Successfully detached device vdb from instance 98ced818-ad9a-4020-9f2b-2520934530ba from the persistent domain config.
Nov 17 03:39:35 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 98ced818-ad9a-4020-9f2b-2520934530ba from the live domain config. {{(pid=74898) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 03:39:35 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:39:35 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:39:35 user nova-compute[74898]:   <source dev="/dev/sdb"/>
Nov 17 03:39:35 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:39:35 user nova-compute[74898]:   <serial>3762b355-fd70-411a-ba38-2a6d040f8c39</serial>
Nov 17 03:39:35 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:39:35 user nova-compute[74898]: </disk>
Nov 17 03:39:35 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:39:35 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 98ced818-ad9a-4020-9f2b-2520934530ba {{(pid=74898) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 03:39:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:39:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:39:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:39:45 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:39:45 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:39:46 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:39:49 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:39:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:39:50 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:39:52 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:39:53 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:39:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:39:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:39:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:39:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:39:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:39:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:39:55 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 98ced818-ad9a-4020-9f2b-2520934530ba is timed out.
Nov 17 03:39:55 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Successfully detached device vdb from instance 98ced818-ad9a-4020-9f2b-2520934530ba from the live domain config.
Nov 17 03:39:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kzdKEvIr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:39:55 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:39:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09016cc-1926-4a15-9d8c-6593381fbe4f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:39:55 user nova-compute[74898]: No targets found.
Nov 17 03:39:55 user nova-compute[74898]: iSNS:
Nov 17 03:39:55 user nova-compute[74898]: No targets found.
Nov 17 03:39:55 user nova-compute[74898]: STATIC:
Nov 17 03:39:55 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39
Nov 17 03:39:55 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:39:55 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:39:55 user nova-compute[74898]: FIRMWARE:
Nov 17 03:39:55 user nova-compute[74898]: No targets found.
Nov 17 03:39:55 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:39:55 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:39:55 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8356b73-c5bb-4277-ad56-c84fcb79af57]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d385e44-a5a1-43d9-8571-27b7fb391823]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39 (non-flash)
Nov 17 03:39:55 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39 (non-flash)
Nov 17 03:39:55 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf86af370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39'): ({'sdb'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Removing single pathed devices sdb {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8783acac-a007-42a7-940d-90905b115066]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dedb73-1d56-413a-a4fc-4544ba169d57]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Flushing IO for device /dev/sdb {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0058dd-342e-4bbd-8e46-d8b7763ce4fc]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.030s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[325eb7ca-14af-44a8-99a9-176aa84eed31]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc36c193-c28e-48ed-bf7c-0e1789b4d3eb]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0641b6e5-25b8-4691-964e-933268e03ee1]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39, portal: 172.16.0.220,3260]
Nov 17 03:39:55 user nova-compute[74898]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39, portal: 172.16.0.220,3260] successful.
Nov 17 03:39:55 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3762b355-fd70-411a-ba38-2a6d040f8c39 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf403003-d303-4bb4-bf98-ba612c8732d1]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] <== disconnect_volume: return (288ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:39:55 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:39:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:39:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:39:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:56 user nova-compute[74898]: DEBUG nova.objects.instance [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lazy-loading 'flavor' on Instance uuid 98ced818-ad9a-4020-9f2b-2520934530ba {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:39:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-09a547e2-c6f1-45ef-a11b-f9ad4b1002de tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "98ced818-ad9a-4020-9f2b-2520934530ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.672s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:39:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:39:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336f927e-824f-473f-9bdc-a9595fb76a49/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336f927e-824f-473f-9bdc-a9595fb76a49/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:39:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336f927e-824f-473f-9bdc-a9595fb76a49/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:39:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336f927e-824f-473f-9bdc-a9595fb76a49/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:39:57 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:39:57 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:39:57 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=8653MB free_disk=25.094074249267578GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:39:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:39:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:39:57 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 25ab4a8b-372b-42ab-8929-1d8c3262e3ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:39:57 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 98ced818-ad9a-4020-9f2b-2520934530ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:39:57 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 336f927e-824f-473f-9bdc-a9595fb76a49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:39:57 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:39:57 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:39:57 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:39:57 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:39:57 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:39:57 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:39:58 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:39:58 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:39:58 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:39:58 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Didn't find any instances for network info cache update. {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 17 03:39:58 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:39:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:14 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:40:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Acquiring lock "ae42fa01-316d-43e7-b0f1-aa07827082d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:40:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "ae42fa01-316d-43e7-b0f1-aa07827082d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:40:21 user nova-compute[74898]: DEBUG nova.compute.manager [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:40:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:40:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:40:21 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:40:21 user nova-compute[74898]: INFO nova.compute.claims [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Claim successful on node user
Nov 17 03:40:21 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:40:21 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:40:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.254s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:40:21 user nova-compute[74898]: DEBUG nova.compute.manager [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:40:21 user nova-compute[74898]: DEBUG nova.compute.manager [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:40:21 user nova-compute[74898]: DEBUG nova.network.neutron [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:40:21 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:40:21 user nova-compute[74898]: DEBUG nova.compute.manager [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:40:21 user nova-compute[74898]: DEBUG nova.policy [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f053a881930440279c298a857df6e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d10fbc9614248b68a632ac20bcc50d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:40:21 user nova-compute[74898]: DEBUG nova.compute.manager [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:40:21 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:40:21 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Creating image(s)
Nov 17 03:40:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae42fa01-316d-43e7-b0f1-aa07827082d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:40:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "/opt/stack/data/nova/instances/ae42fa01-316d-43e7-b0f1-aa07827082d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:40:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "/opt/stack/data/nova/instances/ae42fa01-316d-43e7-b0f1-aa07827082d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:40:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.169s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:40:21 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:40:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.175s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:21 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/ae42fa01-316d-43e7-b0f1-aa07827082d3/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/ae42fa01-316d-43e7-b0f1-aa07827082d3/disk 1073741824" returned: 0 in 0.050s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:40:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:22 user nova-compute[74898]: DEBUG nova.network.neutron [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Successfully created port: 9c592fb0-e24d-4b69-a06c-9a88dff79493 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:40:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.195s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:22 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae42fa01-316d-43e7-b0f1-aa07827082d3/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:40:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae42fa01-316d-43e7-b0f1-aa07827082d3/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:22 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae42fa01-316d-43e7-b0f1-aa07827082d3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:22 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Cannot resize image /opt/stack/data/nova/instances/ae42fa01-316d-43e7-b0f1-aa07827082d3/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:40:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:40:22 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Ensure instance console log exists: /opt/stack/data/nova/instances/ae42fa01-316d-43e7-b0f1-aa07827082d3/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:40:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:40:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.012s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:40:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.006s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:40:22 user nova-compute[74898]: DEBUG nova.network.neutron [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Successfully updated port: 9c592fb0-e24d-4b69-a06c-9a88dff79493 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:40:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Acquiring lock "refresh_cache-ae42fa01-316d-43e7-b0f1-aa07827082d3" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:40:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Acquired lock "refresh_cache-ae42fa01-316d-43e7-b0f1-aa07827082d3" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:40:22 user nova-compute[74898]: DEBUG nova.network.neutron [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:40:22 user nova-compute[74898]: DEBUG nova.compute.manager [req-3075b88d-faca-4d19-955e-8ff636a5f341 req-d643d716-7c77-4990-a669-ff147e6920fc service nova] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Received event network-changed-9c592fb0-e24d-4b69-a06c-9a88dff79493 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:40:22 user nova-compute[74898]: DEBUG nova.compute.manager [req-3075b88d-faca-4d19-955e-8ff636a5f341 req-d643d716-7c77-4990-a669-ff147e6920fc service nova] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Refreshing instance network info cache due to event network-changed-9c592fb0-e24d-4b69-a06c-9a88dff79493. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:40:22 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3075b88d-faca-4d19-955e-8ff636a5f341 req-d643d716-7c77-4990-a669-ff147e6920fc service nova] Acquiring lock "refresh_cache-ae42fa01-316d-43e7-b0f1-aa07827082d3" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:40:22 user nova-compute[74898]: DEBUG nova.network.neutron [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.network.neutron [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Updating instance_info_cache with network_info: [{"id": "9c592fb0-e24d-4b69-a06c-9a88dff79493", "address": "fa:16:3e:6e:8a:0b", "network": {"id": "b1fbc710-83f1-4388-aca7-a91fd4e9323d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1026031661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d10fbc9614248b68a632ac20bcc50d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c592fb0-e2", "ovs_interfaceid": "9c592fb0-e24d-4b69-a06c-9a88dff79493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Releasing lock "refresh_cache-ae42fa01-316d-43e7-b0f1-aa07827082d3" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.compute.manager [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Instance network_info: |[{"id": "9c592fb0-e24d-4b69-a06c-9a88dff79493", "address": "fa:16:3e:6e:8a:0b", "network": {"id": "b1fbc710-83f1-4388-aca7-a91fd4e9323d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1026031661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d10fbc9614248b68a632ac20bcc50d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c592fb0-e2", "ovs_interfaceid": "9c592fb0-e24d-4b69-a06c-9a88dff79493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3075b88d-faca-4d19-955e-8ff636a5f341 req-d643d716-7c77-4990-a669-ff147e6920fc service nova] Acquired lock "refresh_cache-ae42fa01-316d-43e7-b0f1-aa07827082d3" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.network.neutron [req-3075b88d-faca-4d19-955e-8ff636a5f341 req-d643d716-7c77-4990-a669-ff147e6920fc service nova] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Refreshing network info cache for port 9c592fb0-e24d-4b69-a06c-9a88dff79493 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Start _get_guest_xml network_info=[{"id": "9c592fb0-e24d-4b69-a06c-9a88dff79493", "address": "fa:16:3e:6e:8a:0b", "network": {"id": "b1fbc710-83f1-4388-aca7-a91fd4e9323d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1026031661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d10fbc9614248b68a632ac20bcc50d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c592fb0-e2", "ovs_interfaceid": "9c592fb0-e24d-4b69-a06c-9a88dff79493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:40:23 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:40:23 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:40:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2042706425',display_name='tempest-VolumesActionsTest-instance-2042706425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2042706425',id=51,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d10fbc9614248b68a632ac20bcc50d9',ramdisk_id='',reservation_id='r-o1ebx1i1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-449010661',owner_user_name='tempest-VolumesActionsTest-449010661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:40:22Z,user_data=None,user_id='f053a881930440279c298a857df6e1dd',uuid=ae42fa01-316d-43e7-b0f1-aa07827082d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c592fb0-e24d-4b69-a06c-9a88dff79493", "address": "fa:16:3e:6e:8a:0b", "network": {"id": "b1fbc710-83f1-4388-aca7-a91fd4e9323d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1026031661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d10fbc9614248b68a632ac20bcc50d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c592fb0-e2", "ovs_interfaceid": "9c592fb0-e24d-4b69-a06c-9a88dff79493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Converting VIF {"id": "9c592fb0-e24d-4b69-a06c-9a88dff79493", "address": "fa:16:3e:6e:8a:0b", "network": {"id": "b1fbc710-83f1-4388-aca7-a91fd4e9323d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1026031661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d10fbc9614248b68a632ac20bcc50d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c592fb0-e2", "ovs_interfaceid": "9c592fb0-e24d-4b69-a06c-9a88dff79493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:8a:0b,bridge_name='br-int',has_traffic_filtering=True,id=9c592fb0-e24d-4b69-a06c-9a88dff79493,network=Network(b1fbc710-83f1-4388-aca7-a91fd4e9323d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c592fb0-e2') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.objects.instance [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lazy-loading 'pci_devices' on Instance uuid ae42fa01-316d-43e7-b0f1-aa07827082d3 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:40:23 user nova-compute[74898]:   <uuid>ae42fa01-316d-43e7-b0f1-aa07827082d3</uuid>
Nov 17 03:40:23 user nova-compute[74898]:   <name>instance-00000033</name>
Nov 17 03:40:23 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:40:23 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:40:23 user nova-compute[74898]:   <metadata>
Nov 17 03:40:23 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:40:23 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:40:23 user nova-compute[74898]:       <nova:name>tempest-VolumesActionsTest-instance-2042706425</nova:name>
Nov 17 03:40:23 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:40:23</nova:creationTime>
Nov 17 03:40:23 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:40:23 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:40:23 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:40:23 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:40:23 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:40:23 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:40:23 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:40:23 user nova-compute[74898]:       <nova:owner>
Nov 17 03:40:23 user nova-compute[74898]:         <nova:user uuid="f053a881930440279c298a857df6e1dd">tempest-VolumesActionsTest-449010661-project-member</nova:user>
Nov 17 03:40:23 user nova-compute[74898]:         <nova:project uuid="9d10fbc9614248b68a632ac20bcc50d9">tempest-VolumesActionsTest-449010661</nova:project>
Nov 17 03:40:23 user nova-compute[74898]:       </nova:owner>
Nov 17 03:40:23 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:40:23 user nova-compute[74898]:       <nova:ports>
Nov 17 03:40:23 user nova-compute[74898]:         <nova:port uuid="9c592fb0-e24d-4b69-a06c-9a88dff79493">
Nov 17 03:40:23 user nova-compute[74898]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 17 03:40:23 user nova-compute[74898]:         </nova:port>
Nov 17 03:40:23 user nova-compute[74898]:       </nova:ports>
Nov 17 03:40:23 user nova-compute[74898]:     </nova:instance>
Nov 17 03:40:23 user nova-compute[74898]:   </metadata>
Nov 17 03:40:23 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:40:23 user nova-compute[74898]:     <system>
Nov 17 03:40:23 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:40:23 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:40:23 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:40:23 user nova-compute[74898]:       <entry name="serial">ae42fa01-316d-43e7-b0f1-aa07827082d3</entry>
Nov 17 03:40:23 user nova-compute[74898]:       <entry name="uuid">ae42fa01-316d-43e7-b0f1-aa07827082d3</entry>
Nov 17 03:40:23 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:40:23 user nova-compute[74898]:     </system>
Nov 17 03:40:23 user nova-compute[74898]:   </sysinfo>
Nov 17 03:40:23 user nova-compute[74898]:   <os>
Nov 17 03:40:23 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:40:23 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:40:23 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:40:23 user nova-compute[74898]:   </os>
Nov 17 03:40:23 user nova-compute[74898]:   <features>
Nov 17 03:40:23 user nova-compute[74898]:     <acpi/>
Nov 17 03:40:23 user nova-compute[74898]:     <apic/>
Nov 17 03:40:23 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:40:23 user nova-compute[74898]:   </features>
Nov 17 03:40:23 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:40:23 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:40:23 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:40:23 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:40:23 user nova-compute[74898]:   </clock>
Nov 17 03:40:23 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:40:23 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:40:23 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:40:23 user nova-compute[74898]:   </cpu>
Nov 17 03:40:23 user nova-compute[74898]:   <devices>
Nov 17 03:40:23 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:40:23 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:40:23 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/ae42fa01-316d-43e7-b0f1-aa07827082d3/disk"/>
Nov 17 03:40:23 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:40:23 user nova-compute[74898]:     </disk>
Nov 17 03:40:23 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:40:23 user nova-compute[74898]:       <mac address="fa:16:3e:6e:8a:0b"/>
Nov 17 03:40:23 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:40:23 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:40:23 user nova-compute[74898]:       <target dev="tap9c592fb0-e2"/>
Nov 17 03:40:23 user nova-compute[74898]:     </interface>
Nov 17 03:40:23 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:40:23 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/ae42fa01-316d-43e7-b0f1-aa07827082d3/console.log" append="off"/>
Nov 17 03:40:23 user nova-compute[74898]:     </serial>
Nov 17 03:40:23 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:40:23 user nova-compute[74898]:     <video>
Nov 17 03:40:23 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:40:23 user nova-compute[74898]:     </video>
Nov 17 03:40:23 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:40:23 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:40:23 user nova-compute[74898]:     </rng>
Nov 17 03:40:23 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:40:23 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:40:23 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:40:23 user nova-compute[74898]:     </memballoon>
Nov 17 03:40:23 user nova-compute[74898]:   </devices>
Nov 17 03:40:23 user nova-compute[74898]: </domain>
Nov 17 03:40:23 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:40:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2042706425',display_name='tempest-VolumesActionsTest-instance-2042706425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2042706425',id=51,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d10fbc9614248b68a632ac20bcc50d9',ramdisk_id='',reservation_id='r-o1ebx1i1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-449010661',owner_user_name='tempest-VolumesActionsTest-449010661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:40:22Z,user_data=None,user_id='f053a881930440279c298a857df6e1dd',uuid=ae42fa01-316d-43e7-b0f1-aa07827082d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c592fb0-e24d-4b69-a06c-9a88dff79493", "address": "fa:16:3e:6e:8a:0b", "network": {"id": "b1fbc710-83f1-4388-aca7-a91fd4e9323d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1026031661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d10fbc9614248b68a632ac20bcc50d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c592fb0-e2", "ovs_interfaceid": "9c592fb0-e24d-4b69-a06c-9a88dff79493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Converting VIF {"id": "9c592fb0-e24d-4b69-a06c-9a88dff79493", "address": "fa:16:3e:6e:8a:0b", "network": {"id": "b1fbc710-83f1-4388-aca7-a91fd4e9323d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1026031661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d10fbc9614248b68a632ac20bcc50d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c592fb0-e2", "ovs_interfaceid": "9c592fb0-e24d-4b69-a06c-9a88dff79493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:8a:0b,bridge_name='br-int',has_traffic_filtering=True,id=9c592fb0-e24d-4b69-a06c-9a88dff79493,network=Network(b1fbc710-83f1-4388-aca7-a91fd4e9323d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c592fb0-e2') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG os_vif [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:8a:0b,bridge_name='br-int',has_traffic_filtering=True,id=9c592fb0-e24d-4b69-a06c-9a88dff79493,network=Network(b1fbc710-83f1-4388-aca7-a91fd4e9323d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c592fb0-e2') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c247a8e-1b8c-52c5-b647-e3e29ba205c4', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c592fb0-e2, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c592fb0-e2, col_values=(('qos', UUID('30389a3e-e63b-48ae-9b65-39e93259c2ce')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c592fb0-e2, col_values=(('external_ids', {'iface-id': '9c592fb0-e24d-4b69-a06c-9a88dff79493', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:8a:0b', 'vm-uuid': 'ae42fa01-316d-43e7-b0f1-aa07827082d3'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:23 user nova-compute[74898]: INFO os_vif [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:8a:0b,bridge_name='br-int',has_traffic_filtering=True,id=9c592fb0-e24d-4b69-a06c-9a88dff79493,network=Network(b1fbc710-83f1-4388-aca7-a91fd4e9323d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c592fb0-e2')
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] No VIF found with MAC fa:16:3e:6e:8a:0b, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.network.neutron [req-3075b88d-faca-4d19-955e-8ff636a5f341 req-d643d716-7c77-4990-a669-ff147e6920fc service nova] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Updated VIF entry in instance network info cache for port 9c592fb0-e24d-4b69-a06c-9a88dff79493. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG nova.network.neutron [req-3075b88d-faca-4d19-955e-8ff636a5f341 req-d643d716-7c77-4990-a669-ff147e6920fc service nova] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Updating instance_info_cache with network_info: [{"id": "9c592fb0-e24d-4b69-a06c-9a88dff79493", "address": "fa:16:3e:6e:8a:0b", "network": {"id": "b1fbc710-83f1-4388-aca7-a91fd4e9323d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1026031661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d10fbc9614248b68a632ac20bcc50d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c592fb0-e2", "ovs_interfaceid": "9c592fb0-e24d-4b69-a06c-9a88dff79493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:40:23 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-3075b88d-faca-4d19-955e-8ff636a5f341 req-d643d716-7c77-4990-a669-ff147e6920fc service nova] Releasing lock "refresh_cache-ae42fa01-316d-43e7-b0f1-aa07827082d3" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:40:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:24 user nova-compute[74898]: DEBUG nova.compute.manager [req-2575feb3-e82f-468c-9617-64c50824a5cc req-8cc76628-e4d2-4649-8cf7-4370d7f93749 service nova] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Received event network-vif-plugged-9c592fb0-e24d-4b69-a06c-9a88dff79493 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:40:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-2575feb3-e82f-468c-9617-64c50824a5cc req-8cc76628-e4d2-4649-8cf7-4370d7f93749 service nova] Acquiring lock "ae42fa01-316d-43e7-b0f1-aa07827082d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:40:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-2575feb3-e82f-468c-9617-64c50824a5cc req-8cc76628-e4d2-4649-8cf7-4370d7f93749 service nova] Lock "ae42fa01-316d-43e7-b0f1-aa07827082d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:40:24 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-2575feb3-e82f-468c-9617-64c50824a5cc req-8cc76628-e4d2-4649-8cf7-4370d7f93749 service nova] Lock "ae42fa01-316d-43e7-b0f1-aa07827082d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:40:24 user nova-compute[74898]: DEBUG nova.compute.manager [req-2575feb3-e82f-468c-9617-64c50824a5cc req-8cc76628-e4d2-4649-8cf7-4370d7f93749 service nova] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] No waiting events found dispatching network-vif-plugged-9c592fb0-e24d-4b69-a06c-9a88dff79493 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:40:24 user nova-compute[74898]: WARNING nova.compute.manager [req-2575feb3-e82f-468c-9617-64c50824a5cc req-8cc76628-e4d2-4649-8cf7-4370d7f93749 service nova] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Received unexpected event network-vif-plugged-9c592fb0-e24d-4b69-a06c-9a88dff79493 for instance with vm_state building and task_state spawning.
Nov 17 03:40:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:25 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:26 user nova-compute[74898]: DEBUG nova.compute.manager [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:40:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:40:26 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Instance spawned successfully.
Nov 17 03:40:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:40:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:40:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:40:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:40:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:40:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:40:26 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:40:26 user nova-compute[74898]: DEBUG nova.compute.manager [req-d0113bc6-79f8-4fb0-822c-38138f8e0af3 req-29242f13-2ad2-4c04-9fbc-f567c7ab21b0 service nova] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Received event network-vif-plugged-9c592fb0-e24d-4b69-a06c-9a88dff79493 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:40:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d0113bc6-79f8-4fb0-822c-38138f8e0af3 req-29242f13-2ad2-4c04-9fbc-f567c7ab21b0 service nova] Acquiring lock "ae42fa01-316d-43e7-b0f1-aa07827082d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:40:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d0113bc6-79f8-4fb0-822c-38138f8e0af3 req-29242f13-2ad2-4c04-9fbc-f567c7ab21b0 service nova] Lock "ae42fa01-316d-43e7-b0f1-aa07827082d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:40:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-d0113bc6-79f8-4fb0-822c-38138f8e0af3 req-29242f13-2ad2-4c04-9fbc-f567c7ab21b0 service nova] Lock "ae42fa01-316d-43e7-b0f1-aa07827082d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:40:26 user nova-compute[74898]: DEBUG nova.compute.manager [req-d0113bc6-79f8-4fb0-822c-38138f8e0af3 req-29242f13-2ad2-4c04-9fbc-f567c7ab21b0 service nova] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] No waiting events found dispatching network-vif-plugged-9c592fb0-e24d-4b69-a06c-9a88dff79493 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:40:26 user nova-compute[74898]: WARNING nova.compute.manager [req-d0113bc6-79f8-4fb0-822c-38138f8e0af3 req-29242f13-2ad2-4c04-9fbc-f567c7ab21b0 service nova] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Received unexpected event network-vif-plugged-9c592fb0-e24d-4b69-a06c-9a88dff79493 for instance with vm_state building and task_state spawning.
Nov 17 03:40:26 user nova-compute[74898]: INFO nova.compute.manager [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Took 5.27 seconds to spawn the instance on the hypervisor.
Nov 17 03:40:26 user nova-compute[74898]: DEBUG nova.compute.manager [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:40:26 user nova-compute[74898]: INFO nova.compute.manager [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Took 5.85 seconds to build instance.
Nov 17 03:40:26 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-383b54de-8ecd-4500-9e26-d64b7d7584b5 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "ae42fa01-316d-43e7-b0f1-aa07827082d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.972s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:40:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "98ced818-ad9a-4020-9f2b-2520934530ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:40:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "98ced818-ad9a-4020-9f2b-2520934530ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:40:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:27 user nova-compute[74898]: DEBUG nova.objects.instance [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lazy-loading 'flavor' on Instance uuid 98ced818-ad9a-4020-9f2b-2520934530ba {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:40:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "98ced818-ad9a-4020-9f2b-2520934530ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:40:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "98ced818-ad9a-4020-9f2b-2520934530ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:40:27 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "98ced818-ad9a-4020-9f2b-2520934530ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:40:27 user nova-compute[74898]: INFO nova.compute.manager [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Attaching volume 67d24239-5804-4152-a786-51e6674c5413 to /dev/vdb
Nov 17 03:40:27 user nova-compute[74898]: DEBUG os_brick.utils [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:40:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[62816518-56bb-44b0-aa63-c2bd2ba8b59b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa8f5ea-27d0-4bd3-a6d3-baa3e481e4e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfb1d1a-3592-4ef0-95ff-d83f89673740]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32025cf-41fa-44b6-a9f4-73d3217ce073]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:40:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:40:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:27 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:40:27 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:40:27 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ce6bb8-8777-4fa9-b40f-1412b9cec53f]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:40:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:40:27 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:40:27 user nova-compute[74898]: DEBUG os_brick.utils [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:40:27 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Updating existing volume attachment record: 4f70bffd-1c89-4a0d-98a4-5fd57419eb5b {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:40:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gPDAEqNd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:40:32 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:40:32 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:40:32 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:40:32 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:40:32 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:40:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cdbed7-0ce0-4de5-8b9c-5de84063b891]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:40:32 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a19aa8-9771-4989-b2b2-8f94373b04ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413] added
Nov 17 03:40:32 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c17cd27-a9a8-4ef8-9182-a2eefe6742b1]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d69c7c-c833-46ad-a4dd-0c1f516662da]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gPDAEqNd {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gPDAEqNd" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[87046c5b-aff8-40b6-b29e-332aa455a42e]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gPDAEqNd'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a01829-2df8-4b8e-a665-5aa88360a89c]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d197041f-1a68-431e-bb33-f8be403cd19d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 17 03:40:32 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:40:32 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 17 03:40:32 user nova-compute[74898]:  {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:40:32 user nova-compute[74898]: WARNING os_brick.initiator.connectors.iscsi [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 17 03:40:32 user nova-compute[74898]: 
Nov 17 03:40:32 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fdc6ec-4c6a-4eb9-96eb-f8df04f8934a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413, portal: 172.16.0.220,3260]
Nov 17 03:40:33 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413, portal: 172.16.0.220,3260] successful.
Nov 17 03:40:33 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:40:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[5520b65c-bc86-4ac9-b704-128105df6ae3]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:40:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4f7799-913e-4b1c-81bd-777bf35a0983]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 (non-flash)
Nov 17 03:40:33 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:40:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 (non-flash)
Nov 17 03:40:33 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:40:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:40:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:40:33 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:40:33 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:40:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:33 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:33 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a4dc4d-b4ac-494d-9ed9-acbe517e188f]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:33 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:40:33 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gPDAEqNd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:40:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:40:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26639626631633635', 'path': '/dev/sdb'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:40:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639626631633635', 'path': '/dev/sdb'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:40:34 user nova-compute[74898]: DEBUG nova.objects.instance [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lazy-loading 'flavor' on Instance uuid 98ced818-ad9a-4020-9f2b-2520934530ba {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:40:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 03:40:34 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:40:34 user nova-compute[74898]:   <source dev="/dev/sdb"/>
Nov 17 03:40:34 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:40:34 user nova-compute[74898]:   <serial>67d24239-5804-4152-a786-51e6674c5413</serial>
Nov 17 03:40:34 user nova-compute[74898]: </disk>
Nov 17 03:40:34 user nova-compute[74898]:  {{(pid=74898) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 03:40:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:40:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:40:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] No VIF found with MAC fa:16:3e:82:10:be, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:40:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-63c60bb0-7e6b-4234-beb3-81e54d1e2894 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "98ced818-ad9a-4020-9f2b-2520934530ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.463s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:40:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "98ced818-ad9a-4020-9f2b-2520934530ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:40:36 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "98ced818-ad9a-4020-9f2b-2520934530ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:40:36 user nova-compute[74898]: INFO nova.compute.manager [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Detaching volume 67d24239-5804-4152-a786-51e6674c5413
Nov 17 03:40:36 user nova-compute[74898]: INFO nova.virt.block_device [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Attempting to driver detach volume 67d24239-5804-4152-a786-51e6674c5413 from mountpoint /dev/vdb
Nov 17 03:40:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Attempting to detach device vdb from instance 98ced818-ad9a-4020-9f2b-2520934530ba from the persistent domain config. {{(pid=74898) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 03:40:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:40:36 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:40:36 user nova-compute[74898]:   <source dev="/dev/sdb"/>
Nov 17 03:40:36 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:40:36 user nova-compute[74898]:   <serial>67d24239-5804-4152-a786-51e6674c5413</serial>
Nov 17 03:40:36 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:40:36 user nova-compute[74898]: </disk>
Nov 17 03:40:36 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:40:36 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Successfully detached device vdb from instance 98ced818-ad9a-4020-9f2b-2520934530ba from the persistent domain config.
Nov 17 03:40:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 98ced818-ad9a-4020-9f2b-2520934530ba from the live domain config. {{(pid=74898) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 03:40:36 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:40:36 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:40:36 user nova-compute[74898]:   <source dev="/dev/sdb"/>
Nov 17 03:40:36 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:40:36 user nova-compute[74898]:   <serial>67d24239-5804-4152-a786-51e6674c5413</serial>
Nov 17 03:40:36 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:40:36 user nova-compute[74898]: </disk>
Nov 17 03:40:36 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:40:37 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 98ced818-ad9a-4020-9f2b-2520934530ba {{(pid=74898) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 03:40:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:38 user nova-compute[74898]: DEBUG nova.compute.manager [req-583e4456-90fa-4d33-902d-1034a882319f req-1281e590-90ad-4512-a849-bf90202b09ef service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Received event network-changed-9bd87e94-cbe6-4688-b272-eeb179a89d39 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:40:38 user nova-compute[74898]: DEBUG nova.compute.manager [req-583e4456-90fa-4d33-902d-1034a882319f req-1281e590-90ad-4512-a849-bf90202b09ef service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Refreshing instance network info cache due to event network-changed-9bd87e94-cbe6-4688-b272-eeb179a89d39. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:40:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-583e4456-90fa-4d33-902d-1034a882319f req-1281e590-90ad-4512-a849-bf90202b09ef service nova] Acquiring lock "refresh_cache-336f927e-824f-473f-9bdc-a9595fb76a49" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:40:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-583e4456-90fa-4d33-902d-1034a882319f req-1281e590-90ad-4512-a849-bf90202b09ef service nova] Acquired lock "refresh_cache-336f927e-824f-473f-9bdc-a9595fb76a49" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:40:38 user nova-compute[74898]: DEBUG nova.network.neutron [req-583e4456-90fa-4d33-902d-1034a882319f req-1281e590-90ad-4512-a849-bf90202b09ef service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Refreshing network info cache for port 9bd87e94-cbe6-4688-b272-eeb179a89d39 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:40:39 user nova-compute[74898]: DEBUG nova.network.neutron [req-583e4456-90fa-4d33-902d-1034a882319f req-1281e590-90ad-4512-a849-bf90202b09ef service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Updated VIF entry in instance network info cache for port 9bd87e94-cbe6-4688-b272-eeb179a89d39. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:40:39 user nova-compute[74898]: DEBUG nova.network.neutron [req-583e4456-90fa-4d33-902d-1034a882319f req-1281e590-90ad-4512-a849-bf90202b09ef service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Updating instance_info_cache with network_info: [{"id": "9bd87e94-cbe6-4688-b272-eeb179a89d39", "address": "fa:16:3e:c1:bb:b4", "network": {"id": "11050b0f-b7a6-40b1-83ed-f177fe8ff374", "bridge": "br-int", "label": "tempest-TestStampPattern-1875435424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eeadb4c131e45d5a2756825338e5a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bd87e94-cb", "ovs_interfaceid": "9bd87e94-cbe6-4688-b272-eeb179a89d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:40:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-583e4456-90fa-4d33-902d-1034a882319f req-1281e590-90ad-4512-a849-bf90202b09ef service nova] Releasing lock "refresh_cache-336f927e-824f-473f-9bdc-a9595fb76a49" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:40:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "336f927e-824f-473f-9bdc-a9595fb76a49" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:40:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "336f927e-824f-473f-9bdc-a9595fb76a49" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:40:39 user nova-compute[74898]: DEBUG nova.objects.instance [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lazy-loading 'flavor' on Instance uuid 336f927e-824f-473f-9bdc-a9595fb76a49 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:40:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "336f927e-824f-473f-9bdc-a9595fb76a49" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:40:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "336f927e-824f-473f-9bdc-a9595fb76a49" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:40:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "336f927e-824f-473f-9bdc-a9595fb76a49" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:40:39 user nova-compute[74898]: INFO nova.compute.manager [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Attaching volume a414c9be-ab50-44a4-855a-251e4706efdc to /dev/vdb
Nov 17 03:40:40 user nova-compute[74898]: DEBUG os_brick.utils [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:40:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7b4696-a115-4664-805f-6dac1e2ae174]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[deff6d4d-6417-4c76-8841-6c9174a22683]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[132cfd15-d0fb-4141-b10c-293fc742921e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[56679d40-49ad-4609-b406-f7ca320aea6d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:40:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:40:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:40 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:40:40 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:40:40 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b057ac63-2e15-4242-9d7d-0f18724cf1af]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:40:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:40:40 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:40:40 user nova-compute[74898]: DEBUG os_brick.utils [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:40:40 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Updating existing volume attachment record: 183129b7-759c-4997-abe0-cf193217b44b {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:40:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtbALQmf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:40:45 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:40:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:40:45 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:40:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:40:45 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[be043c8b-4283-4735-bf32-b17c495a2c82]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:40:45 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77f467f-3ff5-4ccd-b67e-9742a5a8241a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc] added
Nov 17 03:40:45 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8550d3f6-dc7b-40b0-bb8f-3e6d8bc73e40]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fc2a11-56f7-4f2b-b6ea-7441c6d8eb70]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gtbALQmf {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gtbALQmf" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7960ebb9-3575-4a66-88c6-c9e7824c8dac]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gtbALQmf'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65c656d-e6ad-4285-b4a7-18797b970fae]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65ef4ac-202c-4c17-b94d-d10990068325]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 (non-flash)
Nov 17 03:40:45 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 (non-flash)
Nov 17 03:40:45 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f3bfc4-8992-4dc5-9a3b-ec395cdcae97]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc, portal: 172.16.0.220,3260]
Nov 17 03:40:45 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc, portal: 172.16.0.220,3260] successful.
Nov 17 03:40:45 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c653929-0dc6-4f6c-a4de-c76f54797463]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e3d366-293b-48d8-84bb-48b37ef76591]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 (non-flash)
Nov 17 03:40:45 user nova-compute[74898]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc (non-flash)
Nov 17 03:40:45 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 (non-flash)
Nov 17 03:40:45 user nova-compute[74898]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc (non-flash)
Nov 17 03:40:45 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0b1d68-3faf-4fbb-99c6-ca37c324c80d]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:45 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: None {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:40:46 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:40:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtbALQmf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:40:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:40:46 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23332333764323035', 'path': '/dev/sdc'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:40:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332333764323035', 'path': '/dev/sdc'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:40:46 user nova-compute[74898]: DEBUG nova.objects.instance [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lazy-loading 'flavor' on Instance uuid 336f927e-824f-473f-9bdc-a9595fb76a49 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:40:46 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 03:40:46 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:40:46 user nova-compute[74898]:   <source dev="/dev/sdc"/>
Nov 17 03:40:46 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:40:46 user nova-compute[74898]:   <serial>a414c9be-ab50-44a4-855a-251e4706efdc</serial>
Nov 17 03:40:46 user nova-compute[74898]: </disk>
Nov 17 03:40:46 user nova-compute[74898]:  {{(pid=74898) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 03:40:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:40:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:40:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] No VIF found with MAC fa:16:3e:c1:bb:b4, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:40:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6c8d9262-509a-48b2-9807-0926db70c470 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "336f927e-824f-473f-9bdc-a9595fb76a49" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.500s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:40:47 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:40:47 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:40:47 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:40:48 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "336f927e-824f-473f-9bdc-a9595fb76a49" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:40:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "336f927e-824f-473f-9bdc-a9595fb76a49" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:40:49 user nova-compute[74898]: INFO nova.compute.manager [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Detaching volume a414c9be-ab50-44a4-855a-251e4706efdc
Nov 17 03:40:49 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:40:49 user nova-compute[74898]: INFO nova.virt.block_device [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Attempting to driver detach volume a414c9be-ab50-44a4-855a-251e4706efdc from mountpoint /dev/vdb
Nov 17 03:40:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Attempting to detach device vdb from instance 336f927e-824f-473f-9bdc-a9595fb76a49 from the persistent domain config. {{(pid=74898) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 03:40:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:40:49 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:40:49 user nova-compute[74898]:   <source dev="/dev/sdc"/>
Nov 17 03:40:49 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:40:49 user nova-compute[74898]:   <serial>a414c9be-ab50-44a4-855a-251e4706efdc</serial>
Nov 17 03:40:49 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:40:49 user nova-compute[74898]: </disk>
Nov 17 03:40:49 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:40:49 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Successfully detached device vdb from instance 336f927e-824f-473f-9bdc-a9595fb76a49 from the persistent domain config.
Nov 17 03:40:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 336f927e-824f-473f-9bdc-a9595fb76a49 from the live domain config. {{(pid=74898) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 03:40:49 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:40:49 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:40:49 user nova-compute[74898]:   <source dev="/dev/sdc"/>
Nov 17 03:40:49 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:40:49 user nova-compute[74898]:   <serial>a414c9be-ab50-44a4-855a-251e4706efdc</serial>
Nov 17 03:40:49 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:40:49 user nova-compute[74898]: </disk>
Nov 17 03:40:49 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:40:50 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 336f927e-824f-473f-9bdc-a9595fb76a49 {{(pid=74898) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 03:40:51 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:40:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:52 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:40:53 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:56 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:40:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:40:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:40:56 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:40:56 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:40:56 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:57 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 98ced818-ad9a-4020-9f2b-2520934530ba is timed out.
Nov 17 03:40:57 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Successfully detached device vdb from instance 98ced818-ad9a-4020-9f2b-2520934530ba from the live domain config.
Nov 17 03:40:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gPDAEqNd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:40:57 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:40:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b34dd2-d13e-46db-880f-f22f0f265e86]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:40:57 user nova-compute[74898]: No targets found.
Nov 17 03:40:57 user nova-compute[74898]: iSNS:
Nov 17 03:40:57 user nova-compute[74898]: No targets found.
Nov 17 03:40:57 user nova-compute[74898]: STATIC:
Nov 17 03:40:57 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413
Nov 17 03:40:57 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:40:57 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:40:57 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc
Nov 17 03:40:57 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:40:57 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:40:57 user nova-compute[74898]: FIRMWARE:
Nov 17 03:40:57 user nova-compute[74898]: No targets found.
Nov 17 03:40:57 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:40:57 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:40:57 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[40233250-ddd4-4810-be85-581e3a7ddbdf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2793ad4-496d-49a9-af02-bb06e2d8af7b]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 (non-flash)
Nov 17 03:40:57 user nova-compute[74898]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc (non-flash)
Nov 17 03:40:57 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 (non-flash)
Nov 17 03:40:57 user nova-compute[74898]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc (non-flash)
Nov 17 03:40:57 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf84cbd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413'): ({'sdb'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Removing single pathed devices sdb {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c59ba61-c660-4eaf-9f4f-f9e31107af80]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[400357c1-83ee-4bc3-89a9-064254f55ef5]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Flushing IO for device /dev/sdb {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[986aec0d-9c9a-4ce4-8377-219028378769]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfd8aa2-bbcb-4286-9f2c-13ff780afaca]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1ed019-8e73-4ab1-b553-8b74109dbe30]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8bdc4a-8f85-4dfd-9850-b72c168da156]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413, portal: 172.16.0.220,3260]
Nov 17 03:40:57 user nova-compute[74898]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413, portal: 172.16.0.220,3260] successful.
Nov 17 03:40:57 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d24239-5804-4152-a786-51e6674c5413 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8086120-bbcc-42fa-9045-b4261a76f11a]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] <== disconnect_volume: return (364ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336f927e-824f-473f-9bdc-a9595fb76a49/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336f927e-824f-473f-9bdc-a9595fb76a49/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:57 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336f927e-824f-473f-9bdc-a9595fb76a49/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336f927e-824f-473f-9bdc-a9595fb76a49/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae42fa01-316d-43e7-b0f1-aa07827082d3/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:58 user nova-compute[74898]: DEBUG nova.objects.instance [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lazy-loading 'flavor' on Instance uuid 98ced818-ad9a-4020-9f2b-2520934530ba {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:40:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-d1ab4e67-1280-4804-8195-42149646db17 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "98ced818-ad9a-4020-9f2b-2520934530ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.931s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:40:58 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:40:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae42fa01-316d-43e7-b0f1-aa07827082d3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae42fa01-316d-43e7-b0f1-aa07827082d3/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:40:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae42fa01-316d-43e7-b0f1-aa07827082d3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:40:59 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:40:59 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:40:59 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=8487MB free_disk=25.06365966796875GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:40:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:40:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:40:59 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 25ab4a8b-372b-42ab-8929-1d8c3262e3ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:40:59 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 98ced818-ad9a-4020-9f2b-2520934530ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:40:59 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 336f927e-824f-473f-9bdc-a9595fb76a49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:40:59 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance ae42fa01-316d-43e7-b0f1-aa07827082d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:40:59 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:40:59 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:40:59 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Refreshing inventories for resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 17 03:40:59 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Updating ProviderTree inventory for provider b743bdc9-a8bb-467c-98c8-06f1954f87df from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 17 03:40:59 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Updating inventory in ProviderTree for provider b743bdc9-a8bb-467c-98c8-06f1954f87df with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 17 03:40:59 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Refreshing aggregate associations for resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df, aggregates: None {{(pid=74898) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 17 03:40:59 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Refreshing trait associations for resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=74898) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 17 03:40:59 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:40:59 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:40:59 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:40:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.499s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:40:59 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:40:59 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:40:59 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:40:59 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Rebuilding the list of instances to heal {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 03:40:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-25ab4a8b-372b-42ab-8929-1d8c3262e3ca" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:40:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-25ab4a8b-372b-42ab-8929-1d8c3262e3ca" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:40:59 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:40:59 user nova-compute[74898]: DEBUG nova.objects.instance [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lazy-loading 'info_cache' on Instance uuid 25ab4a8b-372b-42ab-8929-1d8c3262e3ca {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:41:00 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Updating instance_info_cache with network_info: [{"id": "b5248d6e-e587-409e-9b44-ed1a576ff20f", "address": "fa:16:3e:72:96:4e", "network": {"id": "11050b0f-b7a6-40b1-83ed-f177fe8ff374", "bridge": "br-int", "label": "tempest-TestStampPattern-1875435424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eeadb4c131e45d5a2756825338e5a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5248d6e-e5", "ovs_interfaceid": "b5248d6e-e587-409e-9b44-ed1a576ff20f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:41:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-25ab4a8b-372b-42ab-8929-1d8c3262e3ca" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:41:00 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:41:00 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:41:00 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:41:00 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Cleaning up deleted instances {{(pid=74898) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 17 03:41:00 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] There are 0 instances to clean {{(pid=74898) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 17 03:41:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:41:03 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:41:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:41:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:41:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:41:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:41:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:41:08 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:41:10 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 336f927e-824f-473f-9bdc-a9595fb76a49 is timed out.
Nov 17 03:41:10 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Successfully detached device vdb from instance 336f927e-824f-473f-9bdc-a9595fb76a49 from the live domain config.
Nov 17 03:41:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtbALQmf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:41:10 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:41:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e09fa82-e2b7-43bb-90df-88e002f49a3b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:41:10 user nova-compute[74898]: No targets found.
Nov 17 03:41:10 user nova-compute[74898]: iSNS:
Nov 17 03:41:10 user nova-compute[74898]: No targets found.
Nov 17 03:41:10 user nova-compute[74898]: STATIC:
Nov 17 03:41:10 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc
Nov 17 03:41:10 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:41:10 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:41:10 user nova-compute[74898]: FIRMWARE:
Nov 17 03:41:10 user nova-compute[74898]: No targets found.
Nov 17 03:41:10 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:41:10 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:41:10 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3119cdf1-da46-473d-b54b-f3ff230e6e8f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdb8118-38f3-48c1-91df-ec57859823ce]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc (non-flash)
Nov 17 03:41:10 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc (non-flash)
Nov 17 03:41:10 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf869b760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc'): ({'sdc'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Removing single pathed devices sdc {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeaee656-2e51-4dca-a674-27f6161e70e8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ac813d-b00e-4141-a6ef-3c2d0cb9cebf]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Flushing IO for device /dev/sdc {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e289a7e-8f2a-4432-b4e2-eed8f25f811f]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de54832-4e07-4f1f-9add-02a374fb8214]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] SCSI volumes sdc have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a081dda-0236-4323-a5f2-d39f06624067]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb299698-c62e-40d6-961e-491c34ab260f]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc, portal: 172.16.0.220,3260]
Nov 17 03:41:10 user nova-compute[74898]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc, portal: 172.16.0.220,3260] successful.
Nov 17 03:41:10 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a414c9be-ab50-44a4-855a-251e4706efdc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d67d21-fd45-4581-9075-6d8d2e9ffbd9]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] <== disconnect_volume: return (277ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:41:10 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Cleaning up deleted instances with incomplete migration  {{(pid=74898) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 17 03:41:11 user nova-compute[74898]: DEBUG nova.objects.instance [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lazy-loading 'flavor' on Instance uuid 336f927e-824f-473f-9bdc-a9595fb76a49 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:41:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2b6e4a55-9e5c-4de6-aaea-4a14d6fef428 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "336f927e-824f-473f-9bdc-a9595fb76a49" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.634s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:41:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:41:13 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:41:18 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:41:19 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:41:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:41:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:41:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:41:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:41:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:41:23 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "98ced818-ad9a-4020-9f2b-2520934530ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "98ced818-ad9a-4020-9f2b-2520934530ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG nova.objects.instance [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lazy-loading 'flavor' on Instance uuid 98ced818-ad9a-4020-9f2b-2520934530ba {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "98ced818-ad9a-4020-9f2b-2520934530ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "98ced818-ad9a-4020-9f2b-2520934530ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "98ced818-ad9a-4020-9f2b-2520934530ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:41:28 user nova-compute[74898]: INFO nova.compute.manager [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Attaching volume 27faf1bf-c3cb-4475-9026-4d927a55d7f6 to /dev/vdb
Nov 17 03:41:28 user nova-compute[74898]: DEBUG os_brick.utils [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d839731b-d71d-468e-81d2-10d9676683a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ba16b1e79aa0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[51dc724e-868a-4db9-8f62-f061a7582e79]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7082b085-242d-40b6-a047-e979ed2e4d1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[64224d6a-1483-4327-93a7-e6c125113eac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Running cmd (subprocess): nvme version {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] 'nvme version' failed. Not Retrying. {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] nvme not present on system {{(pid=74898) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 03:41:28 user nova-compute[74898]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 03:41:28 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[16496766-4e5f-4dba-a580-3c44e37b61e0]: (4, '') {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74898) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.lightos [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] LIGHTOS: no hostnqn found. {{(pid=74898) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG os_brick.utils [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ba16b1e79aa0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:41:28 user nova-compute[74898]: DEBUG nova.virt.block_device [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Updating existing volume attachment record: 47849a62-10b0-48f8-a24b-d2240f6bc0bf {{(pid=74898) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 03:41:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:41:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Calling os-brick to attach iSCSI Volume {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaLseqwc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:41:34 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:41:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:41:34 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:41:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:41:34 user nova-compute[74898]: INFO os_brick.initiator.connectors.iscsi [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6 -p 172.16.0.220:3260 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad5f2a4-1bac-4d2b-aff6-e3f4bb311452]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 03:41:34 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89a4269-577d-4afc-8eac-f4b07db412b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6] added\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6] added
Nov 17 03:41:34 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[390ee246-aa03-4ee5-af03-7ac81f3b927f]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[509bd597-791e-45dc-97a8-74431d7395d1]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yaLseqwc {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yaLseqwc" returned: 0 in 0.025s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f9ae23-7414-43b3-a694-9f95a3c72677]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yaLseqwc'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e309ae-f518-48c3-b7c3-af153a48fff1]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c869e8-aaff-4ec0-a8c9-eccc24b0af39]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 17 03:41:34 user nova-compute[74898]:  {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 17 03:41:34 user nova-compute[74898]:  {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:41:34 user nova-compute[74898]: WARNING os_brick.initiator.connectors.iscsi [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 17 03:41:34 user nova-compute[74898]: 
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6 -p 172.16.0.220:3260 --login {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3543e0-8ff9-4c23-b7d6-9f828375c28b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6, portal: 172.16.0.220,3260]
Nov 17 03:41:34 user nova-compute[74898]: Login to [iface: default, target: iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6, portal: 172.16.0.220,3260] successful.
Nov 17 03:41:34 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f642d38-dd25-4885-a190-18bf55ff87ce]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd4c544-557e-4672-ae4f-dc33c061dce5]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6 (non-flash)
Nov 17 03:41:34 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6 (non-flash)
Nov 17 03:41:34 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Connected to 172.16.0.220:3260 {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=74898) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74898) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[0017ebeb-cbb6-46da-9c62-36672f08966d]: (4, ('- - 0', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74898) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 03:41:34 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaLseqwc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74898) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 03:41:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:41:35 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23465376234363431', 'path': '/dev/sdb'} {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:41:35 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465376234363431', 'path': '/dev/sdb'} {{(pid=74898) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 03:41:35 user nova-compute[74898]: DEBUG nova.objects.instance [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lazy-loading 'flavor' on Instance uuid 98ced818-ad9a-4020-9f2b-2520934530ba {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:41:35 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 03:41:35 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:41:35 user nova-compute[74898]:   <source dev="/dev/sdb"/>
Nov 17 03:41:35 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:41:35 user nova-compute[74898]:   <serial>27faf1bf-c3cb-4475-9026-4d927a55d7f6</serial>
Nov 17 03:41:35 user nova-compute[74898]: </disk>
Nov 17 03:41:35 user nova-compute[74898]:  {{(pid=74898) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 03:41:35 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:41:35 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:41:35 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] No VIF found with MAC fa:16:3e:82:10:be, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:41:35 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3a13256d-0caf-4f02-b485-5de9177f7cdc tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "98ced818-ad9a-4020-9f2b-2520934530ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.175s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:41:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:41:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "98ced818-ad9a-4020-9f2b-2520934530ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:41:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "98ced818-ad9a-4020-9f2b-2520934530ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:41:37 user nova-compute[74898]: INFO nova.compute.manager [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Detaching volume 27faf1bf-c3cb-4475-9026-4d927a55d7f6
Nov 17 03:41:38 user nova-compute[74898]: INFO nova.virt.block_device [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Attempting to driver detach volume 27faf1bf-c3cb-4475-9026-4d927a55d7f6 from mountpoint /dev/vdb
Nov 17 03:41:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Attempting to detach device vdb from instance 98ced818-ad9a-4020-9f2b-2520934530ba from the persistent domain config. {{(pid=74898) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 03:41:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:41:38 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:41:38 user nova-compute[74898]:   <source dev="/dev/sdb"/>
Nov 17 03:41:38 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:41:38 user nova-compute[74898]:   <serial>27faf1bf-c3cb-4475-9026-4d927a55d7f6</serial>
Nov 17 03:41:38 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:41:38 user nova-compute[74898]: </disk>
Nov 17 03:41:38 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:41:38 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Successfully detached device vdb from instance 98ced818-ad9a-4020-9f2b-2520934530ba from the persistent domain config.
Nov 17 03:41:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 98ced818-ad9a-4020-9f2b-2520934530ba from the live domain config. {{(pid=74898) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 03:41:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.guest [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 03:41:38 user nova-compute[74898]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 03:41:38 user nova-compute[74898]:   <source dev="/dev/sdb"/>
Nov 17 03:41:38 user nova-compute[74898]:   <target dev="vdb" bus="virtio"/>
Nov 17 03:41:38 user nova-compute[74898]:   <serial>27faf1bf-c3cb-4475-9026-4d927a55d7f6</serial>
Nov 17 03:41:38 user nova-compute[74898]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 03:41:38 user nova-compute[74898]: </disk>
Nov 17 03:41:38 user nova-compute[74898]:  {{(pid=74898) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 03:41:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:41:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 98ced818-ad9a-4020-9f2b-2520934530ba {{(pid=74898) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 03:41:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:41:40 user nova-compute[74898]: DEBUG nova.compute.manager [req-e7dfb4ee-aed7-4330-ba58-7120d0bfcf09 req-c336eb73-852f-4e05-8ed5-0a95dbfdd82a service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Received event network-changed-9bd87e94-cbe6-4688-b272-eeb179a89d39 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:41:40 user nova-compute[74898]: DEBUG nova.compute.manager [req-e7dfb4ee-aed7-4330-ba58-7120d0bfcf09 req-c336eb73-852f-4e05-8ed5-0a95dbfdd82a service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Refreshing instance network info cache due to event network-changed-9bd87e94-cbe6-4688-b272-eeb179a89d39. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:41:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e7dfb4ee-aed7-4330-ba58-7120d0bfcf09 req-c336eb73-852f-4e05-8ed5-0a95dbfdd82a service nova] Acquiring lock "refresh_cache-336f927e-824f-473f-9bdc-a9595fb76a49" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:41:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e7dfb4ee-aed7-4330-ba58-7120d0bfcf09 req-c336eb73-852f-4e05-8ed5-0a95dbfdd82a service nova] Acquired lock "refresh_cache-336f927e-824f-473f-9bdc-a9595fb76a49" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:41:40 user nova-compute[74898]: DEBUG nova.network.neutron [req-e7dfb4ee-aed7-4330-ba58-7120d0bfcf09 req-c336eb73-852f-4e05-8ed5-0a95dbfdd82a service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Refreshing network info cache for port 9bd87e94-cbe6-4688-b272-eeb179a89d39 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:41:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-33bd241b-b74b-4b97-8e80-277a2daf4982 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "336f927e-824f-473f-9bdc-a9595fb76a49" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:41:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-33bd241b-b74b-4b97-8e80-277a2daf4982 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "336f927e-824f-473f-9bdc-a9595fb76a49" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:41:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-33bd241b-b74b-4b97-8e80-277a2daf4982 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "336f927e-824f-473f-9bdc-a9595fb76a49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:41:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-33bd241b-b74b-4b97-8e80-277a2daf4982 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "336f927e-824f-473f-9bdc-a9595fb76a49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:41:40 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-33bd241b-b74b-4b97-8e80-277a2daf4982 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "336f927e-824f-473f-9bdc-a9595fb76a49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:41:40 user nova-compute[74898]: INFO nova.compute.manager [None req-33bd241b-b74b-4b97-8e80-277a2daf4982 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Terminating instance
Nov 17 03:41:40 user nova-compute[74898]: DEBUG nova.compute.manager [None req-33bd241b-b74b-4b97-8e80-277a2daf4982 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:41:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:41:40 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:41:41 user nova-compute[74898]: DEBUG nova.network.neutron [req-e7dfb4ee-aed7-4330-ba58-7120d0bfcf09 req-c336eb73-852f-4e05-8ed5-0a95dbfdd82a service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Updated VIF entry in instance network info cache for port 9bd87e94-cbe6-4688-b272-eeb179a89d39. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:41:41 user nova-compute[74898]: DEBUG nova.network.neutron [req-e7dfb4ee-aed7-4330-ba58-7120d0bfcf09 req-c336eb73-852f-4e05-8ed5-0a95dbfdd82a service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Updating instance_info_cache with network_info: [{"id": "9bd87e94-cbe6-4688-b272-eeb179a89d39", "address": "fa:16:3e:c1:bb:b4", "network": {"id": "11050b0f-b7a6-40b1-83ed-f177fe8ff374", "bridge": "br-int", "label": "tempest-TestStampPattern-1875435424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eeadb4c131e45d5a2756825338e5a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bd87e94-cb", "ovs_interfaceid": "9bd87e94-cbe6-4688-b272-eeb179a89d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:41:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:41:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:41:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e7dfb4ee-aed7-4330-ba58-7120d0bfcf09 req-c336eb73-852f-4e05-8ed5-0a95dbfdd82a service nova] Releasing lock "refresh_cache-336f927e-824f-473f-9bdc-a9595fb76a49" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:41:41 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Instance destroyed successfully.
Nov 17 03:41:41 user nova-compute[74898]: DEBUG nova.objects.instance [None req-33bd241b-b74b-4b97-8e80-277a2daf4982 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lazy-loading 'resources' on Instance uuid 336f927e-824f-473f-9bdc-a9595fb76a49 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:41:41 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-33bd241b-b74b-4b97-8e80-277a2daf4982 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:38:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1348849848',display_name='tempest-TestStampPattern-server-1348849848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1348849848',id=50,image_ref='decddeae-d698-432c-8e2e-57c22597e5fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNa/gTkhJ7iIlZtCXnubc5rXETxMR2xUqH0IcU5ToxMKsPxgETVhY1EbVW15n7a6qWBKm8+HQ/+QUHZOadI1pzdW0upx9o5IqHzfYPIJA/hjdkH9FBegXsZhGz2BAci2Q==',key_name='tempest-TestStampPattern-825908881',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:38:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0eeadb4c131e45d5a2756825338e5a5d',ramdisk_id='',reservation_id='r-cm7tuf0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='25ab4a8b-372b-42ab-8929-1d8c3262e3ca',image_min_disk='1',image_min_ram='0',image_owner_id='0eeadb4c131e45d5a2756825338e5a5d',image_owner_project_name='tempest-TestStampPattern-1480169250',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1480169250-project-member',image_user_id='70d8f2bbd9f4448096b0991222a32994',owner_project_name='tempest-TestStampPattern-1480169250',owner_user_name='tempest-TestStampPattern-1480169250-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:38:54Z,user_data=None,user_id='70d8f2bbd9f4448096b0991222a32994',uuid=336f927e-824f-473f-9bdc-a9595fb76a49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9bd87e94-cbe6-4688-b272-eeb179a89d39", "address": "fa:16:3e:c1:bb:b4", "network": {"id": "11050b0f-b7a6-40b1-83ed-f177fe8ff374", "bridge": "br-int", "label": "tempest-TestStampPattern-1875435424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eeadb4c131e45d5a2756825338e5a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bd87e94-cb", "ovs_interfaceid": "9bd87e94-cbe6-4688-b272-eeb179a89d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:41:41 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-33bd241b-b74b-4b97-8e80-277a2daf4982 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Converting VIF {"id": "9bd87e94-cbe6-4688-b272-eeb179a89d39", "address": "fa:16:3e:c1:bb:b4", "network": {"id": "11050b0f-b7a6-40b1-83ed-f177fe8ff374", "bridge": "br-int", "label": "tempest-TestStampPattern-1875435424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eeadb4c131e45d5a2756825338e5a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bd87e94-cb", "ovs_interfaceid": "9bd87e94-cbe6-4688-b272-eeb179a89d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:41:41 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-33bd241b-b74b-4b97-8e80-277a2daf4982 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:bb:b4,bridge_name='br-int',has_traffic_filtering=True,id=9bd87e94-cbe6-4688-b272-eeb179a89d39,network=Network(11050b0f-b7a6-40b1-83ed-f177fe8ff374),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bd87e94-cb') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:41:41 user nova-compute[74898]: DEBUG os_vif [None req-33bd241b-b74b-4b97-8e80-277a2daf4982 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:bb:b4,bridge_name='br-int',has_traffic_filtering=True,id=9bd87e94-cbe6-4688-b272-eeb179a89d39,network=Network(11050b0f-b7a6-40b1-83ed-f177fe8ff374),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bd87e94-cb') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:41:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:41:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9bd87e94-cb, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:41:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:41:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:41:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:41:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ca09046-f463-4871-b9bf-cfbab8386b57) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:41:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:41:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:41:41 user nova-compute[74898]: INFO os_vif [None req-33bd241b-b74b-4b97-8e80-277a2daf4982 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:bb:b4,bridge_name='br-int',has_traffic_filtering=True,id=9bd87e94-cbe6-4688-b272-eeb179a89d39,network=Network(11050b0f-b7a6-40b1-83ed-f177fe8ff374),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bd87e94-cb')
Nov 17 03:41:41 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-33bd241b-b74b-4b97-8e80-277a2daf4982 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Deleting instance files /opt/stack/data/nova/instances/336f927e-824f-473f-9bdc-a9595fb76a49_del
Nov 17 03:41:41 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-33bd241b-b74b-4b97-8e80-277a2daf4982 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Deletion of /opt/stack/data/nova/instances/336f927e-824f-473f-9bdc-a9595fb76a49_del complete
Nov 17 03:41:41 user nova-compute[74898]: INFO nova.compute.manager [None req-33bd241b-b74b-4b97-8e80-277a2daf4982 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 17 03:41:41 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-33bd241b-b74b-4b97-8e80-277a2daf4982 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:41:41 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:41:41 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:41:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:41:42 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:41:42 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Took 0.48 seconds to deallocate network for instance.
Nov 17 03:41:42 user nova-compute[74898]: DEBUG nova.compute.manager [req-0f5edd38-f7e6-4869-85fb-672232d77cec req-6299ad2d-3d05-428d-9e8d-c624e693b30c service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Received event network-vif-deleted-9bd87e94-cbe6-4688-b272-eeb179a89d39 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:41:42 user nova-compute[74898]: INFO nova.compute.manager [req-0f5edd38-f7e6-4869-85fb-672232d77cec req-6299ad2d-3d05-428d-9e8d-c624e693b30c service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Neutron deleted interface 9bd87e94-cbe6-4688-b272-eeb179a89d39; detaching it from the instance and deleting it from the info cache
Nov 17 03:41:42 user nova-compute[74898]: DEBUG nova.network.neutron [req-0f5edd38-f7e6-4869-85fb-672232d77cec req-6299ad2d-3d05-428d-9e8d-c624e693b30c service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:41:42 user nova-compute[74898]: DEBUG nova.compute.manager [req-0f5edd38-f7e6-4869-85fb-672232d77cec req-6299ad2d-3d05-428d-9e8d-c624e693b30c service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Detach interface failed, port_id=9bd87e94-cbe6-4688-b272-eeb179a89d39, reason: Instance 336f927e-824f-473f-9bdc-a9595fb76a49 could not be found. {{(pid=74898) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 03:41:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-33bd241b-b74b-4b97-8e80-277a2daf4982 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:41:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-33bd241b-b74b-4b97-8e80-277a2daf4982 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:41:42 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-33bd241b-b74b-4b97-8e80-277a2daf4982 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:41:42 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-33bd241b-b74b-4b97-8e80-277a2daf4982 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:41:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-33bd241b-b74b-4b97-8e80-277a2daf4982 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.218s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:41:42 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-33bd241b-b74b-4b97-8e80-277a2daf4982 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Deleted allocations for instance 336f927e-824f-473f-9bdc-a9595fb76a49
Nov 17 03:41:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-33bd241b-b74b-4b97-8e80-277a2daf4982 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "336f927e-824f-473f-9bdc-a9595fb76a49" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.771s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:41:42 user nova-compute[74898]: DEBUG nova.compute.manager [req-a5875c20-f980-4946-8d15-a5d9afebebc2 req-75345df9-9b1f-4b6e-b9cf-8d7cf71dae0d service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Received event network-vif-unplugged-9bd87e94-cbe6-4688-b272-eeb179a89d39 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:41:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a5875c20-f980-4946-8d15-a5d9afebebc2 req-75345df9-9b1f-4b6e-b9cf-8d7cf71dae0d service nova] Acquiring lock "336f927e-824f-473f-9bdc-a9595fb76a49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:41:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a5875c20-f980-4946-8d15-a5d9afebebc2 req-75345df9-9b1f-4b6e-b9cf-8d7cf71dae0d service nova] Lock "336f927e-824f-473f-9bdc-a9595fb76a49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:41:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a5875c20-f980-4946-8d15-a5d9afebebc2 req-75345df9-9b1f-4b6e-b9cf-8d7cf71dae0d service nova] Lock "336f927e-824f-473f-9bdc-a9595fb76a49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:41:42 user nova-compute[74898]: DEBUG nova.compute.manager [req-a5875c20-f980-4946-8d15-a5d9afebebc2 req-75345df9-9b1f-4b6e-b9cf-8d7cf71dae0d service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] No waiting events found dispatching network-vif-unplugged-9bd87e94-cbe6-4688-b272-eeb179a89d39 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:41:42 user nova-compute[74898]: WARNING nova.compute.manager [req-a5875c20-f980-4946-8d15-a5d9afebebc2 req-75345df9-9b1f-4b6e-b9cf-8d7cf71dae0d service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Received unexpected event network-vif-unplugged-9bd87e94-cbe6-4688-b272-eeb179a89d39 for instance with vm_state deleted and task_state None.
Nov 17 03:41:42 user nova-compute[74898]: DEBUG nova.compute.manager [req-a5875c20-f980-4946-8d15-a5d9afebebc2 req-75345df9-9b1f-4b6e-b9cf-8d7cf71dae0d service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Received event network-vif-plugged-9bd87e94-cbe6-4688-b272-eeb179a89d39 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:41:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a5875c20-f980-4946-8d15-a5d9afebebc2 req-75345df9-9b1f-4b6e-b9cf-8d7cf71dae0d service nova] Acquiring lock "336f927e-824f-473f-9bdc-a9595fb76a49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:41:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a5875c20-f980-4946-8d15-a5d9afebebc2 req-75345df9-9b1f-4b6e-b9cf-8d7cf71dae0d service nova] Lock "336f927e-824f-473f-9bdc-a9595fb76a49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:41:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-a5875c20-f980-4946-8d15-a5d9afebebc2 req-75345df9-9b1f-4b6e-b9cf-8d7cf71dae0d service nova] Lock "336f927e-824f-473f-9bdc-a9595fb76a49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:41:42 user nova-compute[74898]: DEBUG nova.compute.manager [req-a5875c20-f980-4946-8d15-a5d9afebebc2 req-75345df9-9b1f-4b6e-b9cf-8d7cf71dae0d service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] No waiting events found dispatching network-vif-plugged-9bd87e94-cbe6-4688-b272-eeb179a89d39 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:41:42 user nova-compute[74898]: WARNING nova.compute.manager [req-a5875c20-f980-4946-8d15-a5d9afebebc2 req-75345df9-9b1f-4b6e-b9cf-8d7cf71dae0d service nova] [instance: 336f927e-824f-473f-9bdc-a9595fb76a49] Received unexpected event network-vif-plugged-9bd87e94-cbe6-4688-b272-eeb179a89d39 for instance with vm_state deleted and task_state None.
Nov 17 03:41:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:41:48 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:41:49 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:41:49 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:41:50 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:41:51 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:41:52 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:41:52 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:41:54 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:41:56 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:41:58 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 98ced818-ad9a-4020-9f2b-2520934530ba is timed out.
Nov 17 03:41:58 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Successfully detached device vdb from instance 98ced818-ad9a-4020-9f2b-2520934530ba from the live domain config.
Nov 17 03:41:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] calling os-brick to detach iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9c183341c0>, {'target_iqn': 'iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaLseqwc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 03:41:58 user nova-compute[74898]: WARNING os_brick.initiator.connectors.base [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 03:41:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be9a3c2-d8b4-4c84-a763-3ff117fe09a5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 03:41:58 user nova-compute[74898]: No targets found.
Nov 17 03:41:58 user nova-compute[74898]: iSNS:
Nov 17 03:41:58 user nova-compute[74898]: No targets found.
Nov 17 03:41:58 user nova-compute[74898]: STATIC:
Nov 17 03:41:58 user nova-compute[74898]: Target: iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6
Nov 17 03:41:58 user nova-compute[74898]:         Portal: 172.16.0.220:3260,-1
Nov 17 03:41:58 user nova-compute[74898]:                 Iface Name: default
Nov 17 03:41:58 user nova-compute[74898]: FIRMWARE:
Nov 17 03:41:58 user nova-compute[74898]: No targets found.
Nov 17 03:41:58 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 03:41:58 user nova-compute[74898]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 03:41:58 user nova-compute[74898]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74898) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6', 0)] {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ab15c5-f38b-412e-b469-a3b12b30470a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[64388c6c-6fef-47c8-a3d4-9d06db6e8aef]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6 (non-flash)\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6 (non-flash)
Nov 17 03:41:58 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6 (non-flash)
Nov 17 03:41:58 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9bf83989d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6'): ({'sdb'}, set())}) {{(pid=74898) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Removing single pathed devices sdb {{(pid=74898) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1430c67-b435-4565-b681-a5f29d3e7eb9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eefab75-a354-4003-97a6-4f0866d09f2e]: (4, ('ok\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Flushing IO for device /dev/sdb {{(pid=74898) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda18a13-b0e7-4207-86e6-da9dc62c7879]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74898) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7713ca-ad88-4a32-9748-97e175ce041e]: (4, ('1', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG os_brick.initiator.linuxscsi [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] SCSI volumes sdb have been removed. {{(pid=74898) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6')] {{(pid=74898) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[403150ef-15ad-44c6-ab6a-d72dcf28f6cc]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6 -p 172.16.0.220:3260 --logout {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[9727f25d-61f3-40e5-82b3-b6a75a6d8b3f]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6, portal: 172.16.0.220,3260]
Nov 17 03:41:58 user nova-compute[74898]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6, portal: 172.16.0.220,3260] successful.
Nov 17 03:41:58 user nova-compute[74898]:  stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6 -p 172.16.0.220:3260 --op delete {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27faf1bf-c3cb-4475-9026-4d927a55d7f6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo.privsep.daemon [-] privsep: reply[be09238b-a342-46b8-b0ab-6ee931fd86ae]: (4, ('', '')) {{(pid=86021) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74898) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.base [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] <== disconnect_volume: return (307ms) None {{(pid=74898) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Disconnected iSCSI Volume {{(pid=74898) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-98ced818-ad9a-4020-9f2b-2520934530ba" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-98ced818-ad9a-4020-9f2b-2520934530ba" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:41:58 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:41:59 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Updating instance_info_cache with network_info: [{"id": "0ee25c23-7b34-488e-97b1-db66f921a502", "address": "fa:16:3e:82:10:be", "network": {"id": "9efcfeea-8c01-45a8-8a77-3d6a18c71729", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-925876126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8de3683d8d2c4bafbd516c6d80c8486d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee25c23-7b", "ovs_interfaceid": "0ee25c23-7b34-488e-97b1-db66f921a502", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:41:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-98ced818-ad9a-4020-9f2b-2520934530ba" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:41:59 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:41:59 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:41:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:41:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:41:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:41:59 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:41:59 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:59 user nova-compute[74898]: DEBUG nova.objects.instance [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lazy-loading 'flavor' on Instance uuid 98ced818-ad9a-4020-9f2b-2520934530ba {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:41:59 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:59 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:41:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-ffa65be9-59d2-4723-b51d-68b9cdcee11c tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "98ced818-ad9a-4020-9f2b-2520934530ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.744s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:41:59 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:41:59 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:42:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:42:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:42:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:42:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae42fa01-316d-43e7-b0f1-aa07827082d3/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:42:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae42fa01-316d-43e7-b0f1-aa07827082d3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:42:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae42fa01-316d-43e7-b0f1-aa07827082d3/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:42:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae42fa01-316d-43e7-b0f1-aa07827082d3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:42:00 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:42:01 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:42:01 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=8681MB free_disk=25.063716888427734GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:42:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:42:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:42:01 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 25ab4a8b-372b-42ab-8929-1d8c3262e3ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:42:01 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 98ced818-ad9a-4020-9f2b-2520934530ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:42:01 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance ae42fa01-316d-43e7-b0f1-aa07827082d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:42:01 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:42:01 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:42:01 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:42:01 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:42:01 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:42:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.257s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:42:01 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:42:02 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:42:02 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:42:06 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:42:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:42:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4a65c875-36b5-4a27-b4d1-0bf435217ae0 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Acquiring lock "ae42fa01-316d-43e7-b0f1-aa07827082d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:42:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4a65c875-36b5-4a27-b4d1-0bf435217ae0 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "ae42fa01-316d-43e7-b0f1-aa07827082d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:42:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4a65c875-36b5-4a27-b4d1-0bf435217ae0 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Acquiring lock "ae42fa01-316d-43e7-b0f1-aa07827082d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:42:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4a65c875-36b5-4a27-b4d1-0bf435217ae0 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "ae42fa01-316d-43e7-b0f1-aa07827082d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:42:11 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4a65c875-36b5-4a27-b4d1-0bf435217ae0 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "ae42fa01-316d-43e7-b0f1-aa07827082d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:42:11 user nova-compute[74898]: INFO nova.compute.manager [None req-4a65c875-36b5-4a27-b4d1-0bf435217ae0 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Terminating instance
Nov 17 03:42:11 user nova-compute[74898]: DEBUG nova.compute.manager [None req-4a65c875-36b5-4a27-b4d1-0bf435217ae0 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:42:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:42:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:42:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:42:11 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:42:12 user nova-compute[74898]: DEBUG nova.compute.manager [req-fdb32ce6-55b7-4465-87a3-fdfa267ef852 req-79644ed0-7daa-409f-8f3b-75291134c69e service nova] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Received event network-vif-unplugged-9c592fb0-e24d-4b69-a06c-9a88dff79493 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:42:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fdb32ce6-55b7-4465-87a3-fdfa267ef852 req-79644ed0-7daa-409f-8f3b-75291134c69e service nova] Acquiring lock "ae42fa01-316d-43e7-b0f1-aa07827082d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:42:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fdb32ce6-55b7-4465-87a3-fdfa267ef852 req-79644ed0-7daa-409f-8f3b-75291134c69e service nova] Lock "ae42fa01-316d-43e7-b0f1-aa07827082d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:42:12 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-fdb32ce6-55b7-4465-87a3-fdfa267ef852 req-79644ed0-7daa-409f-8f3b-75291134c69e service nova] Lock "ae42fa01-316d-43e7-b0f1-aa07827082d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:42:12 user nova-compute[74898]: DEBUG nova.compute.manager [req-fdb32ce6-55b7-4465-87a3-fdfa267ef852 req-79644ed0-7daa-409f-8f3b-75291134c69e service nova] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] No waiting events found dispatching network-vif-unplugged-9c592fb0-e24d-4b69-a06c-9a88dff79493 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:42:12 user nova-compute[74898]: DEBUG nova.compute.manager [req-fdb32ce6-55b7-4465-87a3-fdfa267ef852 req-79644ed0-7daa-409f-8f3b-75291134c69e service nova] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Received event network-vif-unplugged-9c592fb0-e24d-4b69-a06c-9a88dff79493 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:42:12 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Instance destroyed successfully.
Nov 17 03:42:12 user nova-compute[74898]: DEBUG nova.objects.instance [None req-4a65c875-36b5-4a27-b4d1-0bf435217ae0 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lazy-loading 'resources' on Instance uuid ae42fa01-316d-43e7-b0f1-aa07827082d3 {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:42:12 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-4a65c875-36b5-4a27-b4d1-0bf435217ae0 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:40:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2042706425',display_name='tempest-VolumesActionsTest-instance-2042706425',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2042706425',id=51,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:40:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d10fbc9614248b68a632ac20bcc50d9',ramdisk_id='',reservation_id='r-o1ebx1i1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-449010661',owner_user_name='tempest-VolumesActionsTest-449010661-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:40:27Z,user_data=None,user_id='f053a881930440279c298a857df6e1dd',uuid=ae42fa01-316d-43e7-b0f1-aa07827082d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c592fb0-e24d-4b69-a06c-9a88dff79493", "address": "fa:16:3e:6e:8a:0b", "network": {"id": "b1fbc710-83f1-4388-aca7-a91fd4e9323d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1026031661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d10fbc9614248b68a632ac20bcc50d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c592fb0-e2", "ovs_interfaceid": "9c592fb0-e24d-4b69-a06c-9a88dff79493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:42:12 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-4a65c875-36b5-4a27-b4d1-0bf435217ae0 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Converting VIF {"id": "9c592fb0-e24d-4b69-a06c-9a88dff79493", "address": "fa:16:3e:6e:8a:0b", "network": {"id": "b1fbc710-83f1-4388-aca7-a91fd4e9323d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1026031661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d10fbc9614248b68a632ac20bcc50d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c592fb0-e2", "ovs_interfaceid": "9c592fb0-e24d-4b69-a06c-9a88dff79493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:42:12 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-4a65c875-36b5-4a27-b4d1-0bf435217ae0 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:8a:0b,bridge_name='br-int',has_traffic_filtering=True,id=9c592fb0-e24d-4b69-a06c-9a88dff79493,network=Network(b1fbc710-83f1-4388-aca7-a91fd4e9323d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c592fb0-e2') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:42:12 user nova-compute[74898]: DEBUG os_vif [None req-4a65c875-36b5-4a27-b4d1-0bf435217ae0 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:8a:0b,bridge_name='br-int',has_traffic_filtering=True,id=9c592fb0-e24d-4b69-a06c-9a88dff79493,network=Network(b1fbc710-83f1-4388-aca7-a91fd4e9323d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c592fb0-e2') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:42:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:42:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c592fb0-e2, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:42:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:42:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:42:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:42:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30389a3e-e63b-48ae-9b65-39e93259c2ce) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:42:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:42:12 user nova-compute[74898]: INFO os_vif [None req-4a65c875-36b5-4a27-b4d1-0bf435217ae0 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:8a:0b,bridge_name='br-int',has_traffic_filtering=True,id=9c592fb0-e24d-4b69-a06c-9a88dff79493,network=Network(b1fbc710-83f1-4388-aca7-a91fd4e9323d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c592fb0-e2')
Nov 17 03:42:12 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-4a65c875-36b5-4a27-b4d1-0bf435217ae0 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Deleting instance files /opt/stack/data/nova/instances/ae42fa01-316d-43e7-b0f1-aa07827082d3_del
Nov 17 03:42:12 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-4a65c875-36b5-4a27-b4d1-0bf435217ae0 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Deletion of /opt/stack/data/nova/instances/ae42fa01-316d-43e7-b0f1-aa07827082d3_del complete
Nov 17 03:42:12 user nova-compute[74898]: INFO nova.compute.manager [None req-4a65c875-36b5-4a27-b4d1-0bf435217ae0 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 17 03:42:12 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-4a65c875-36b5-4a27-b4d1-0bf435217ae0 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:42:12 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:42:12 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:42:13 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:42:13 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Took 0.38 seconds to deallocate network for instance.
Nov 17 03:42:13 user nova-compute[74898]: DEBUG nova.compute.manager [req-acd1e26c-7666-4665-a3b8-f8378590e31e req-a4cb3cb4-df47-4d60-8b3b-6a559385c85b service nova] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Received event network-vif-deleted-9c592fb0-e24d-4b69-a06c-9a88dff79493 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:42:13 user nova-compute[74898]: INFO nova.compute.manager [req-acd1e26c-7666-4665-a3b8-f8378590e31e req-a4cb3cb4-df47-4d60-8b3b-6a559385c85b service nova] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Neutron deleted interface 9c592fb0-e24d-4b69-a06c-9a88dff79493; detaching it from the instance and deleting it from the info cache
Nov 17 03:42:13 user nova-compute[74898]: DEBUG nova.network.neutron [req-acd1e26c-7666-4665-a3b8-f8378590e31e req-a4cb3cb4-df47-4d60-8b3b-6a559385c85b service nova] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:42:13 user nova-compute[74898]: DEBUG nova.compute.manager [req-acd1e26c-7666-4665-a3b8-f8378590e31e req-a4cb3cb4-df47-4d60-8b3b-6a559385c85b service nova] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Detach interface failed, port_id=9c592fb0-e24d-4b69-a06c-9a88dff79493, reason: Instance ae42fa01-316d-43e7-b0f1-aa07827082d3 could not be found. {{(pid=74898) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 03:42:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4a65c875-36b5-4a27-b4d1-0bf435217ae0 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:42:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4a65c875-36b5-4a27-b4d1-0bf435217ae0 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:42:13 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-4a65c875-36b5-4a27-b4d1-0bf435217ae0 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:42:13 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-4a65c875-36b5-4a27-b4d1-0bf435217ae0 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:42:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4a65c875-36b5-4a27-b4d1-0bf435217ae0 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:42:13 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-4a65c875-36b5-4a27-b4d1-0bf435217ae0 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Deleted allocations for instance ae42fa01-316d-43e7-b0f1-aa07827082d3
Nov 17 03:42:13 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-4a65c875-36b5-4a27-b4d1-0bf435217ae0 tempest-VolumesActionsTest-449010661 tempest-VolumesActionsTest-449010661-project-member] Lock "ae42fa01-316d-43e7-b0f1-aa07827082d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.595s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:42:14 user nova-compute[74898]: DEBUG nova.compute.manager [req-7a6c0459-c426-4089-af71-79d39f4b2b23 req-d169b964-d360-4c4e-b1f9-d3e9ed5af0df service nova] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Received event network-vif-plugged-9c592fb0-e24d-4b69-a06c-9a88dff79493 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:42:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7a6c0459-c426-4089-af71-79d39f4b2b23 req-d169b964-d360-4c4e-b1f9-d3e9ed5af0df service nova] Acquiring lock "ae42fa01-316d-43e7-b0f1-aa07827082d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:42:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7a6c0459-c426-4089-af71-79d39f4b2b23 req-d169b964-d360-4c4e-b1f9-d3e9ed5af0df service nova] Lock "ae42fa01-316d-43e7-b0f1-aa07827082d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:42:14 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-7a6c0459-c426-4089-af71-79d39f4b2b23 req-d169b964-d360-4c4e-b1f9-d3e9ed5af0df service nova] Lock "ae42fa01-316d-43e7-b0f1-aa07827082d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:42:14 user nova-compute[74898]: DEBUG nova.compute.manager [req-7a6c0459-c426-4089-af71-79d39f4b2b23 req-d169b964-d360-4c4e-b1f9-d3e9ed5af0df service nova] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] No waiting events found dispatching network-vif-plugged-9c592fb0-e24d-4b69-a06c-9a88dff79493 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:42:14 user nova-compute[74898]: WARNING nova.compute.manager [req-7a6c0459-c426-4089-af71-79d39f4b2b23 req-d169b964-d360-4c4e-b1f9-d3e9ed5af0df service nova] [instance: ae42fa01-316d-43e7-b0f1-aa07827082d3] Received unexpected event network-vif-plugged-9c592fb0-e24d-4b69-a06c-9a88dff79493 for instance with vm_state deleted and task_state None.
Nov 17 03:42:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:42:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:42:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:42:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:42:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:42:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:42:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:42:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:42:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:42:37 user nova-compute[74898]: DEBUG nova.compute.manager [req-384e5860-92f8-47e2-86ca-315f68f68ff6 req-b60f2aba-3839-4529-af65-a7477f4f71e7 service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Received event network-changed-b5248d6e-e587-409e-9b44-ed1a576ff20f {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:42:37 user nova-compute[74898]: DEBUG nova.compute.manager [req-384e5860-92f8-47e2-86ca-315f68f68ff6 req-b60f2aba-3839-4529-af65-a7477f4f71e7 service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Refreshing instance network info cache due to event network-changed-b5248d6e-e587-409e-9b44-ed1a576ff20f. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:42:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-384e5860-92f8-47e2-86ca-315f68f68ff6 req-b60f2aba-3839-4529-af65-a7477f4f71e7 service nova] Acquiring lock "refresh_cache-25ab4a8b-372b-42ab-8929-1d8c3262e3ca" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:42:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-384e5860-92f8-47e2-86ca-315f68f68ff6 req-b60f2aba-3839-4529-af65-a7477f4f71e7 service nova] Acquired lock "refresh_cache-25ab4a8b-372b-42ab-8929-1d8c3262e3ca" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:42:37 user nova-compute[74898]: DEBUG nova.network.neutron [req-384e5860-92f8-47e2-86ca-315f68f68ff6 req-b60f2aba-3839-4529-af65-a7477f4f71e7 service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Refreshing network info cache for port b5248d6e-e587-409e-9b44-ed1a576ff20f {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:42:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-14b42a75-bf0d-46a1-8c9c-bc91fca51600 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:42:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-14b42a75-bf0d-46a1-8c9c-bc91fca51600 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:42:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-14b42a75-bf0d-46a1-8c9c-bc91fca51600 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:42:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-14b42a75-bf0d-46a1-8c9c-bc91fca51600 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:42:37 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-14b42a75-bf0d-46a1-8c9c-bc91fca51600 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:42:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:42:37 user nova-compute[74898]: INFO nova.compute.manager [None req-14b42a75-bf0d-46a1-8c9c-bc91fca51600 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Terminating instance
Nov 17 03:42:37 user nova-compute[74898]: DEBUG nova.compute.manager [None req-14b42a75-bf0d-46a1-8c9c-bc91fca51600 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:42:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:42:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:42:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:42:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:42:38 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Instance destroyed successfully.
Nov 17 03:42:38 user nova-compute[74898]: DEBUG nova.objects.instance [None req-14b42a75-bf0d-46a1-8c9c-bc91fca51600 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lazy-loading 'resources' on Instance uuid 25ab4a8b-372b-42ab-8929-1d8c3262e3ca {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:42:38 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-14b42a75-bf0d-46a1-8c9c-bc91fca51600 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-453898625',display_name='tempest-TestStampPattern-server-453898625',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-453898625',id=47,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNa/gTkhJ7iIlZtCXnubc5rXETxMR2xUqH0IcU5ToxMKsPxgETVhY1EbVW15n7a6qWBKm8+HQ/+QUHZOadI1pzdW0upx9o5IqHzfYPIJA/hjdkH9FBegXsZhGz2BAci2Q==',key_name='tempest-TestStampPattern-825908881',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:35:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0eeadb4c131e45d5a2756825338e5a5d',ramdisk_id='',reservation_id='r-885m1iop',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1480169250',owner_user_name='tempest-TestStampPattern-1480169250-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:38:45Z,user_data=None,user_id='70d8f2bbd9f4448096b0991222a32994',uuid=25ab4a8b-372b-42ab-8929-1d8c3262e3ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5248d6e-e587-409e-9b44-ed1a576ff20f", "address": "fa:16:3e:72:96:4e", "network": {"id": "11050b0f-b7a6-40b1-83ed-f177fe8ff374", "bridge": "br-int", "label": "tempest-TestStampPattern-1875435424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eeadb4c131e45d5a2756825338e5a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5248d6e-e5", "ovs_interfaceid": "b5248d6e-e587-409e-9b44-ed1a576ff20f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:42:38 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-14b42a75-bf0d-46a1-8c9c-bc91fca51600 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Converting VIF {"id": "b5248d6e-e587-409e-9b44-ed1a576ff20f", "address": "fa:16:3e:72:96:4e", "network": {"id": "11050b0f-b7a6-40b1-83ed-f177fe8ff374", "bridge": "br-int", "label": "tempest-TestStampPattern-1875435424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eeadb4c131e45d5a2756825338e5a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5248d6e-e5", "ovs_interfaceid": "b5248d6e-e587-409e-9b44-ed1a576ff20f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:42:38 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-14b42a75-bf0d-46a1-8c9c-bc91fca51600 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:96:4e,bridge_name='br-int',has_traffic_filtering=True,id=b5248d6e-e587-409e-9b44-ed1a576ff20f,network=Network(11050b0f-b7a6-40b1-83ed-f177fe8ff374),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5248d6e-e5') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:42:38 user nova-compute[74898]: DEBUG os_vif [None req-14b42a75-bf0d-46a1-8c9c-bc91fca51600 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:96:4e,bridge_name='br-int',has_traffic_filtering=True,id=b5248d6e-e587-409e-9b44-ed1a576ff20f,network=Network(11050b0f-b7a6-40b1-83ed-f177fe8ff374),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5248d6e-e5') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:42:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:42:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5248d6e-e5, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:42:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:42:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:42:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:42:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=18404af9-2e8e-4705-923c-3e03ee5f1863) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:42:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:42:38 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:42:38 user nova-compute[74898]: INFO os_vif [None req-14b42a75-bf0d-46a1-8c9c-bc91fca51600 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:96:4e,bridge_name='br-int',has_traffic_filtering=True,id=b5248d6e-e587-409e-9b44-ed1a576ff20f,network=Network(11050b0f-b7a6-40b1-83ed-f177fe8ff374),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5248d6e-e5')
Nov 17 03:42:38 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-14b42a75-bf0d-46a1-8c9c-bc91fca51600 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Deleting instance files /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca_del
Nov 17 03:42:38 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-14b42a75-bf0d-46a1-8c9c-bc91fca51600 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Deletion of /opt/stack/data/nova/instances/25ab4a8b-372b-42ab-8929-1d8c3262e3ca_del complete
Nov 17 03:42:38 user nova-compute[74898]: DEBUG nova.network.neutron [req-384e5860-92f8-47e2-86ca-315f68f68ff6 req-b60f2aba-3839-4529-af65-a7477f4f71e7 service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Updated VIF entry in instance network info cache for port b5248d6e-e587-409e-9b44-ed1a576ff20f. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:42:38 user nova-compute[74898]: DEBUG nova.network.neutron [req-384e5860-92f8-47e2-86ca-315f68f68ff6 req-b60f2aba-3839-4529-af65-a7477f4f71e7 service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Updating instance_info_cache with network_info: [{"id": "b5248d6e-e587-409e-9b44-ed1a576ff20f", "address": "fa:16:3e:72:96:4e", "network": {"id": "11050b0f-b7a6-40b1-83ed-f177fe8ff374", "bridge": "br-int", "label": "tempest-TestStampPattern-1875435424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eeadb4c131e45d5a2756825338e5a5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5248d6e-e5", "ovs_interfaceid": "b5248d6e-e587-409e-9b44-ed1a576ff20f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:42:38 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-384e5860-92f8-47e2-86ca-315f68f68ff6 req-b60f2aba-3839-4529-af65-a7477f4f71e7 service nova] Releasing lock "refresh_cache-25ab4a8b-372b-42ab-8929-1d8c3262e3ca" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:42:38 user nova-compute[74898]: INFO nova.compute.manager [None req-14b42a75-bf0d-46a1-8c9c-bc91fca51600 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 17 03:42:38 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-14b42a75-bf0d-46a1-8c9c-bc91fca51600 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:42:38 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:42:38 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:42:39 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:42:39 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Took 0.41 seconds to deallocate network for instance.
Nov 17 03:42:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-5180f188-3848-4719-8e68-167cc3077277 req-4109c922-a5ab-484e-9f61-67d635cfccf2 service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Received event network-vif-deleted-b5248d6e-e587-409e-9b44-ed1a576ff20f {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:42:39 user nova-compute[74898]: INFO nova.compute.manager [req-5180f188-3848-4719-8e68-167cc3077277 req-4109c922-a5ab-484e-9f61-67d635cfccf2 service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Neutron deleted interface b5248d6e-e587-409e-9b44-ed1a576ff20f; detaching it from the instance and deleting it from the info cache
Nov 17 03:42:39 user nova-compute[74898]: DEBUG nova.network.neutron [req-5180f188-3848-4719-8e68-167cc3077277 req-4109c922-a5ab-484e-9f61-67d635cfccf2 service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:42:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-5180f188-3848-4719-8e68-167cc3077277 req-4109c922-a5ab-484e-9f61-67d635cfccf2 service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Detach interface failed, port_id=b5248d6e-e587-409e-9b44-ed1a576ff20f, reason: Instance 25ab4a8b-372b-42ab-8929-1d8c3262e3ca could not be found. {{(pid=74898) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 03:42:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-14b42a75-bf0d-46a1-8c9c-bc91fca51600 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:42:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-14b42a75-bf0d-46a1-8c9c-bc91fca51600 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:42:39 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-14b42a75-bf0d-46a1-8c9c-bc91fca51600 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:42:39 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-14b42a75-bf0d-46a1-8c9c-bc91fca51600 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:42:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-14b42a75-bf0d-46a1-8c9c-bc91fca51600 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:42:39 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-14b42a75-bf0d-46a1-8c9c-bc91fca51600 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Deleted allocations for instance 25ab4a8b-372b-42ab-8929-1d8c3262e3ca
Nov 17 03:42:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-14b42a75-bf0d-46a1-8c9c-bc91fca51600 tempest-TestStampPattern-1480169250 tempest-TestStampPattern-1480169250-project-member] Lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.967s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:42:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-e812241c-2105-4ed4-8545-15c3c31d9f5a req-766af366-cbde-40ea-9953-08e7178013e1 service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Received event network-vif-unplugged-b5248d6e-e587-409e-9b44-ed1a576ff20f {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:42:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e812241c-2105-4ed4-8545-15c3c31d9f5a req-766af366-cbde-40ea-9953-08e7178013e1 service nova] Acquiring lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:42:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e812241c-2105-4ed4-8545-15c3c31d9f5a req-766af366-cbde-40ea-9953-08e7178013e1 service nova] Lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:42:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e812241c-2105-4ed4-8545-15c3c31d9f5a req-766af366-cbde-40ea-9953-08e7178013e1 service nova] Lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:42:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-e812241c-2105-4ed4-8545-15c3c31d9f5a req-766af366-cbde-40ea-9953-08e7178013e1 service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] No waiting events found dispatching network-vif-unplugged-b5248d6e-e587-409e-9b44-ed1a576ff20f {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:42:39 user nova-compute[74898]: WARNING nova.compute.manager [req-e812241c-2105-4ed4-8545-15c3c31d9f5a req-766af366-cbde-40ea-9953-08e7178013e1 service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Received unexpected event network-vif-unplugged-b5248d6e-e587-409e-9b44-ed1a576ff20f for instance with vm_state deleted and task_state None.
Nov 17 03:42:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-e812241c-2105-4ed4-8545-15c3c31d9f5a req-766af366-cbde-40ea-9953-08e7178013e1 service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Received event network-vif-plugged-b5248d6e-e587-409e-9b44-ed1a576ff20f {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:42:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e812241c-2105-4ed4-8545-15c3c31d9f5a req-766af366-cbde-40ea-9953-08e7178013e1 service nova] Acquiring lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:42:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e812241c-2105-4ed4-8545-15c3c31d9f5a req-766af366-cbde-40ea-9953-08e7178013e1 service nova] Lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:42:39 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-e812241c-2105-4ed4-8545-15c3c31d9f5a req-766af366-cbde-40ea-9953-08e7178013e1 service nova] Lock "25ab4a8b-372b-42ab-8929-1d8c3262e3ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:42:39 user nova-compute[74898]: DEBUG nova.compute.manager [req-e812241c-2105-4ed4-8545-15c3c31d9f5a req-766af366-cbde-40ea-9953-08e7178013e1 service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] No waiting events found dispatching network-vif-plugged-b5248d6e-e587-409e-9b44-ed1a576ff20f {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:42:39 user nova-compute[74898]: WARNING nova.compute.manager [req-e812241c-2105-4ed4-8545-15c3c31d9f5a req-766af366-cbde-40ea-9953-08e7178013e1 service nova] [instance: 25ab4a8b-372b-42ab-8929-1d8c3262e3ca] Received unexpected event network-vif-plugged-b5248d6e-e587-409e-9b44-ed1a576ff20f for instance with vm_state deleted and task_state None.
Nov 17 03:42:43 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:42:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6d896499-26cd-4a83-a618-80f0c2bd4472 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "98ced818-ad9a-4020-9f2b-2520934530ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:42:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6d896499-26cd-4a83-a618-80f0c2bd4472 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "98ced818-ad9a-4020-9f2b-2520934530ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:42:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6d896499-26cd-4a83-a618-80f0c2bd4472 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "98ced818-ad9a-4020-9f2b-2520934530ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:42:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6d896499-26cd-4a83-a618-80f0c2bd4472 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "98ced818-ad9a-4020-9f2b-2520934530ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:42:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6d896499-26cd-4a83-a618-80f0c2bd4472 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "98ced818-ad9a-4020-9f2b-2520934530ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:42:47 user nova-compute[74898]: INFO nova.compute.manager [None req-6d896499-26cd-4a83-a618-80f0c2bd4472 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Terminating instance
Nov 17 03:42:47 user nova-compute[74898]: DEBUG nova.compute.manager [None req-6d896499-26cd-4a83-a618-80f0c2bd4472 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:42:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:42:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:42:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:42:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:42:47 user nova-compute[74898]: DEBUG nova.compute.manager [req-545c49f6-7ce9-4513-b612-edfffaf2048e req-859f74d2-6212-4dd1-9e94-ec9a08ebbccb service nova] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Received event network-vif-unplugged-0ee25c23-7b34-488e-97b1-db66f921a502 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:42:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-545c49f6-7ce9-4513-b612-edfffaf2048e req-859f74d2-6212-4dd1-9e94-ec9a08ebbccb service nova] Acquiring lock "98ced818-ad9a-4020-9f2b-2520934530ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:42:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-545c49f6-7ce9-4513-b612-edfffaf2048e req-859f74d2-6212-4dd1-9e94-ec9a08ebbccb service nova] Lock "98ced818-ad9a-4020-9f2b-2520934530ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:42:47 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-545c49f6-7ce9-4513-b612-edfffaf2048e req-859f74d2-6212-4dd1-9e94-ec9a08ebbccb service nova] Lock "98ced818-ad9a-4020-9f2b-2520934530ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:42:47 user nova-compute[74898]: DEBUG nova.compute.manager [req-545c49f6-7ce9-4513-b612-edfffaf2048e req-859f74d2-6212-4dd1-9e94-ec9a08ebbccb service nova] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] No waiting events found dispatching network-vif-unplugged-0ee25c23-7b34-488e-97b1-db66f921a502 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:42:47 user nova-compute[74898]: DEBUG nova.compute.manager [req-545c49f6-7ce9-4513-b612-edfffaf2048e req-859f74d2-6212-4dd1-9e94-ec9a08ebbccb service nova] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Received event network-vif-unplugged-0ee25c23-7b34-488e-97b1-db66f921a502 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:42:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:42:47 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Instance destroyed successfully.
Nov 17 03:42:47 user nova-compute[74898]: DEBUG nova.objects.instance [None req-6d896499-26cd-4a83-a618-80f0c2bd4472 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lazy-loading 'resources' on Instance uuid 98ced818-ad9a-4020-9f2b-2520934530ba {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:42:47 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-6d896499-26cd-4a83-a618-80f0c2bd4472 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:36:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-891970474',display_name='tempest-SnapshotDataIntegrityTests-server-891970474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-891970474',id=48,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5N5kv1/X6BvvVIpVMY3J3yGM4LlsolUTF4o+ogvuEtBoysNuYB772Whjwi0FLOBAeii9gytyn8vgTnEd9kanM4223OFgoZ18MTVKtPi5gC1h0CW6mlGU7s8dNtMasxJQ==',key_name='tempest-keypair-1286091422',keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:36:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8de3683d8d2c4bafbd516c6d80c8486d',ramdisk_id='',reservation_id='r-e1hxt5g6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1758564164',owner_user_name='tempest-SnapshotDataIntegrityTests-1758564164-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:36:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5ff5df400134e05ba0df6989298b04a',uuid=98ced818-ad9a-4020-9f2b-2520934530ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ee25c23-7b34-488e-97b1-db66f921a502", "address": "fa:16:3e:82:10:be", "network": {"id": "9efcfeea-8c01-45a8-8a77-3d6a18c71729", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-925876126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8de3683d8d2c4bafbd516c6d80c8486d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee25c23-7b", "ovs_interfaceid": "0ee25c23-7b34-488e-97b1-db66f921a502", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:42:47 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6d896499-26cd-4a83-a618-80f0c2bd4472 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Converting VIF {"id": "0ee25c23-7b34-488e-97b1-db66f921a502", "address": "fa:16:3e:82:10:be", "network": {"id": "9efcfeea-8c01-45a8-8a77-3d6a18c71729", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-925876126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8de3683d8d2c4bafbd516c6d80c8486d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee25c23-7b", "ovs_interfaceid": "0ee25c23-7b34-488e-97b1-db66f921a502", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:42:47 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-6d896499-26cd-4a83-a618-80f0c2bd4472 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:10:be,bridge_name='br-int',has_traffic_filtering=True,id=0ee25c23-7b34-488e-97b1-db66f921a502,network=Network(9efcfeea-8c01-45a8-8a77-3d6a18c71729),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee25c23-7b') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:42:47 user nova-compute[74898]: DEBUG os_vif [None req-6d896499-26cd-4a83-a618-80f0c2bd4472 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:10:be,bridge_name='br-int',has_traffic_filtering=True,id=0ee25c23-7b34-488e-97b1-db66f921a502,network=Network(9efcfeea-8c01-45a8-8a77-3d6a18c71729),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee25c23-7b') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:42:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:42:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ee25c23-7b, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:42:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:42:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:42:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:42:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fe2b958f-bac7-46bd-b080-0395d7332fa9) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:42:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:42:47 user nova-compute[74898]: INFO os_vif [None req-6d896499-26cd-4a83-a618-80f0c2bd4472 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:10:be,bridge_name='br-int',has_traffic_filtering=True,id=0ee25c23-7b34-488e-97b1-db66f921a502,network=Network(9efcfeea-8c01-45a8-8a77-3d6a18c71729),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee25c23-7b')
Nov 17 03:42:47 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-6d896499-26cd-4a83-a618-80f0c2bd4472 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Deleting instance files /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba_del
Nov 17 03:42:47 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-6d896499-26cd-4a83-a618-80f0c2bd4472 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Deletion of /opt/stack/data/nova/instances/98ced818-ad9a-4020-9f2b-2520934530ba_del complete
Nov 17 03:42:48 user nova-compute[74898]: INFO nova.compute.manager [None req-6d896499-26cd-4a83-a618-80f0c2bd4472 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 17 03:42:48 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-6d896499-26cd-4a83-a618-80f0c2bd4472 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:42:48 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:42:48 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:42:48 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:42:48 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Took 0.75 seconds to deallocate network for instance.
Nov 17 03:42:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6d896499-26cd-4a83-a618-80f0c2bd4472 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:42:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6d896499-26cd-4a83-a618-80f0c2bd4472 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:42:48 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-6d896499-26cd-4a83-a618-80f0c2bd4472 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:42:48 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-6d896499-26cd-4a83-a618-80f0c2bd4472 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:42:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6d896499-26cd-4a83-a618-80f0c2bd4472 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.106s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:42:48 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-6d896499-26cd-4a83-a618-80f0c2bd4472 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Deleted allocations for instance 98ced818-ad9a-4020-9f2b-2520934530ba
Nov 17 03:42:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-6d896499-26cd-4a83-a618-80f0c2bd4472 tempest-SnapshotDataIntegrityTests-1758564164 tempest-SnapshotDataIntegrityTests-1758564164-project-member] Lock "98ced818-ad9a-4020-9f2b-2520934530ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.911s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:42:49 user nova-compute[74898]: DEBUG nova.compute.manager [req-5f7dbc9c-de91-4a62-afce-c42e4602cf71 req-2d27e58e-124b-45e4-b174-1c0310d45e17 service nova] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Received event network-vif-plugged-0ee25c23-7b34-488e-97b1-db66f921a502 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:42:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5f7dbc9c-de91-4a62-afce-c42e4602cf71 req-2d27e58e-124b-45e4-b174-1c0310d45e17 service nova] Acquiring lock "98ced818-ad9a-4020-9f2b-2520934530ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:42:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5f7dbc9c-de91-4a62-afce-c42e4602cf71 req-2d27e58e-124b-45e4-b174-1c0310d45e17 service nova] Lock "98ced818-ad9a-4020-9f2b-2520934530ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:42:49 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-5f7dbc9c-de91-4a62-afce-c42e4602cf71 req-2d27e58e-124b-45e4-b174-1c0310d45e17 service nova] Lock "98ced818-ad9a-4020-9f2b-2520934530ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:42:49 user nova-compute[74898]: DEBUG nova.compute.manager [req-5f7dbc9c-de91-4a62-afce-c42e4602cf71 req-2d27e58e-124b-45e4-b174-1c0310d45e17 service nova] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] No waiting events found dispatching network-vif-plugged-0ee25c23-7b34-488e-97b1-db66f921a502 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:42:49 user nova-compute[74898]: WARNING nova.compute.manager [req-5f7dbc9c-de91-4a62-afce-c42e4602cf71 req-2d27e58e-124b-45e4-b174-1c0310d45e17 service nova] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Received unexpected event network-vif-plugged-0ee25c23-7b34-488e-97b1-db66f921a502 for instance with vm_state deleted and task_state None.
Nov 17 03:42:49 user nova-compute[74898]: DEBUG nova.compute.manager [req-5f7dbc9c-de91-4a62-afce-c42e4602cf71 req-2d27e58e-124b-45e4-b174-1c0310d45e17 service nova] [instance: 98ced818-ad9a-4020-9f2b-2520934530ba] Received event network-vif-deleted-0ee25c23-7b34-488e-97b1-db66f921a502 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:42:49 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:42:49 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:42:50 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:42:51 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:42:52 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:42:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:42:53 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:42:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:42:58 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:42:58 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:42:58 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Didn't find any instances for network info cache update. {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 17 03:42:58 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:42:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:42:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:42:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:42:58 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:42:59 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:42:59 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:42:59 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=9011MB free_disk=25.235897064208984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:42:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:42:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:42:59 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:42:59 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:42:59 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:42:59 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:42:59 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:42:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:43:00 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:43:01 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:43:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:43:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:43:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:43:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:43:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:43:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:43:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:43:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:43:33 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:43:35 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:43:36 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:43:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:43:41 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:43:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Acquiring lock "5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:43:41 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Lock "5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:43:41 user nova-compute[74898]: DEBUG nova.compute.manager [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Starting instance... {{(pid=74898) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 03:43:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:43:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:43:42 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74898) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 03:43:42 user nova-compute[74898]: INFO nova.compute.claims [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Claim successful on node user
Nov 17 03:43:42 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:43:42 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:43:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.238s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:43:42 user nova-compute[74898]: DEBUG nova.compute.manager [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Start building networks asynchronously for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 03:43:42 user nova-compute[74898]: DEBUG nova.compute.manager [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Allocating IP information in the background. {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 03:43:42 user nova-compute[74898]: DEBUG nova.network.neutron [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] allocate_for_instance() {{(pid=74898) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 03:43:42 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 03:43:42 user nova-compute[74898]: DEBUG nova.compute.manager [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Start building block device mappings for instance. {{(pid=74898) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 03:43:42 user nova-compute[74898]: DEBUG nova.policy [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eddee5dc33cf4dc4b9a3af226828f865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18990239b15e4332b61a1b12368b4367', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74898) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 03:43:42 user nova-compute[74898]: DEBUG nova.compute.manager [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Start spawning the instance on the hypervisor. {{(pid=74898) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 03:43:42 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Creating instance directory {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 03:43:42 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Creating image(s)
Nov 17 03:43:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:43:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Lock "/opt/stack/data/nova/instances/5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:43:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Lock "/opt/stack/data/nova/instances/5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:43:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:43:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.345s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:43:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Acquiring lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:43:42 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:43:42 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:43:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:43:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.170s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:43:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f/disk 1073741824 {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:43:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372,backing_fmt=raw /opt/stack/data/nova/instances/5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f/disk 1073741824" returned: 0 in 0.055s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:43:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Lock "b58a60adfb36e496a80975fe5f9e33ecd94e9372" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:43:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:43:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58a60adfb36e496a80975fe5f9e33ecd94e9372 --force-share --output=json" returned: 0 in 0.189s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:43:43 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f/disk. size=1073741824 {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 03:43:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:43:43 user nova-compute[74898]: DEBUG nova.network.neutron [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Successfully created port: 873806a3-0d15-41fc-888c-c187d8013038 {{(pid=74898) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 03:43:43 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:43:43 user nova-compute[74898]: DEBUG nova.virt.disk.api [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Cannot resize image /opt/stack/data/nova/instances/5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f/disk to a smaller size. {{(pid=74898) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 03:43:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Created local disks {{(pid=74898) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 03:43:43 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Ensure instance console log exists: /opt/stack/data/nova/instances/5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f/console.log {{(pid=74898) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 03:43:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:43:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:43:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:43:43 user nova-compute[74898]: DEBUG nova.network.neutron [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Successfully updated port: 873806a3-0d15-41fc-888c-c187d8013038 {{(pid=74898) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 03:43:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Acquiring lock "refresh_cache-5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:43:43 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Acquired lock "refresh_cache-5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:43:43 user nova-compute[74898]: DEBUG nova.network.neutron [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Building network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.compute.manager [req-b1c2b17b-1e20-46b5-b12f-a9f0f3781604 req-98dea7cb-52f3-4285-929b-6be9ce119000 service nova] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Received event network-changed-873806a3-0d15-41fc-888c-c187d8013038 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.compute.manager [req-b1c2b17b-1e20-46b5-b12f-a9f0f3781604 req-98dea7cb-52f3-4285-929b-6be9ce119000 service nova] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Refreshing instance network info cache due to event network-changed-873806a3-0d15-41fc-888c-c187d8013038. {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b1c2b17b-1e20-46b5-b12f-a9f0f3781604 req-98dea7cb-52f3-4285-929b-6be9ce119000 service nova] Acquiring lock "refresh_cache-5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.network.neutron [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Instance cache missing network info. {{(pid=74898) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.network.neutron [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Updating instance_info_cache with network_info: [{"id": "873806a3-0d15-41fc-888c-c187d8013038", "address": "fa:16:3e:36:6f:7b", "network": {"id": "fbbf3d72-284c-4441-b387-7a30aa359a27", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5a361ebc6bc544f29659720fc3a82e30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap873806a3-0d", "ovs_interfaceid": "873806a3-0d15-41fc-888c-c187d8013038", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Releasing lock "refresh_cache-5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.compute.manager [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Instance network_info: |[{"id": "873806a3-0d15-41fc-888c-c187d8013038", "address": "fa:16:3e:36:6f:7b", "network": {"id": "fbbf3d72-284c-4441-b387-7a30aa359a27", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5a361ebc6bc544f29659720fc3a82e30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap873806a3-0d", "ovs_interfaceid": "873806a3-0d15-41fc-888c-c187d8013038", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74898) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b1c2b17b-1e20-46b5-b12f-a9f0f3781604 req-98dea7cb-52f3-4285-929b-6be9ce119000 service nova] Acquired lock "refresh_cache-5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.network.neutron [req-b1c2b17b-1e20-46b5-b12f-a9f0f3781604 req-98dea7cb-52f3-4285-929b-6be9ce119000 service nova] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Refreshing network info cache for port 873806a3-0d15-41fc-888c-c187d8013038 {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Start _get_guest_xml network_info=[{"id": "873806a3-0d15-41fc-888c-c187d8013038", "address": "fa:16:3e:36:6f:7b", "network": {"id": "fbbf3d72-284c-4441-b387-7a30aa359a27", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5a361ebc6bc544f29659720fc3a82e30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap873806a3-0d", "ovs_interfaceid": "873806a3-0d15-41fc-888c-c187d8013038", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'image_id': '50e5d43b-62d6-4f28-a52e-a1c6b84eb51f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 03:43:44 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:43:44 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] CPU controller missing on host. {{(pid=74898) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.host [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] CPU controller found on host. {{(pid=74898) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74898) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T02:55:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T02:55:38Z,direct_url=<?>,disk_format='qcow2',id=50e5d43b-62d6-4f28-a52e-a1c6b84eb51f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5a361ebc6bc544f29659720fc3a82e30',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T02:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Flavor limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Image limits 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Flavor pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Image pref 0:0:0 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74898) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Got 1 possible topologies {{(pid=74898) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.virt.hardware [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74898) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:43:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-980735849',display_name='tempest-VolumesNegativeTest-instance-980735849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-980735849',id=52,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18990239b15e4332b61a1b12368b4367',ramdisk_id='',reservation_id='r-e52qeaay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-599417508',owner_user_name='tempest-VolumesNegativeTest-599417508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:43:42Z,user_data=None,user_id='eddee5dc33cf4dc4b9a3af226828f865',uuid=5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "873806a3-0d15-41fc-888c-c187d8013038", "address": "fa:16:3e:36:6f:7b", "network": {"id": "fbbf3d72-284c-4441-b387-7a30aa359a27", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5a361ebc6bc544f29659720fc3a82e30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap873806a3-0d", "ovs_interfaceid": "873806a3-0d15-41fc-888c-c187d8013038", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74898) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Converting VIF {"id": "873806a3-0d15-41fc-888c-c187d8013038", "address": "fa:16:3e:36:6f:7b", "network": {"id": "fbbf3d72-284c-4441-b387-7a30aa359a27", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5a361ebc6bc544f29659720fc3a82e30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap873806a3-0d", "ovs_interfaceid": "873806a3-0d15-41fc-888c-c187d8013038", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:6f:7b,bridge_name='br-int',has_traffic_filtering=True,id=873806a3-0d15-41fc-888c-c187d8013038,network=Network(fbbf3d72-284c-4441-b387-7a30aa359a27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap873806a3-0d') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.objects.instance [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] End _get_guest_xml xml=<domain type="kvm">
Nov 17 03:43:44 user nova-compute[74898]:   <uuid>5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f</uuid>
Nov 17 03:43:44 user nova-compute[74898]:   <name>instance-00000034</name>
Nov 17 03:43:44 user nova-compute[74898]:   <memory>524288</memory>
Nov 17 03:43:44 user nova-compute[74898]:   <vcpu>1</vcpu>
Nov 17 03:43:44 user nova-compute[74898]:   <metadata>
Nov 17 03:43:44 user nova-compute[74898]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 03:43:44 user nova-compute[74898]:       <nova:package version="0.0.0"/>
Nov 17 03:43:44 user nova-compute[74898]:       <nova:name>tempest-VolumesNegativeTest-instance-980735849</nova:name>
Nov 17 03:43:44 user nova-compute[74898]:       <nova:creationTime>2023-11-17 03:43:44</nova:creationTime>
Nov 17 03:43:44 user nova-compute[74898]:       <nova:flavor name="m1.tiny">
Nov 17 03:43:44 user nova-compute[74898]:         <nova:memory>512</nova:memory>
Nov 17 03:43:44 user nova-compute[74898]:         <nova:disk>1</nova:disk>
Nov 17 03:43:44 user nova-compute[74898]:         <nova:swap>0</nova:swap>
Nov 17 03:43:44 user nova-compute[74898]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 03:43:44 user nova-compute[74898]:         <nova:vcpus>1</nova:vcpus>
Nov 17 03:43:44 user nova-compute[74898]:       </nova:flavor>
Nov 17 03:43:44 user nova-compute[74898]:       <nova:owner>
Nov 17 03:43:44 user nova-compute[74898]:         <nova:user uuid="eddee5dc33cf4dc4b9a3af226828f865">tempest-VolumesNegativeTest-599417508-project-member</nova:user>
Nov 17 03:43:44 user nova-compute[74898]:         <nova:project uuid="18990239b15e4332b61a1b12368b4367">tempest-VolumesNegativeTest-599417508</nova:project>
Nov 17 03:43:44 user nova-compute[74898]:       </nova:owner>
Nov 17 03:43:44 user nova-compute[74898]:       <nova:root type="image" uuid="50e5d43b-62d6-4f28-a52e-a1c6b84eb51f"/>
Nov 17 03:43:44 user nova-compute[74898]:       <nova:ports>
Nov 17 03:43:44 user nova-compute[74898]:         <nova:port uuid="873806a3-0d15-41fc-888c-c187d8013038">
Nov 17 03:43:44 user nova-compute[74898]:           <nova:ip type="fixed" address="192.168.233.242" ipVersion="4"/>
Nov 17 03:43:44 user nova-compute[74898]:         </nova:port>
Nov 17 03:43:44 user nova-compute[74898]:       </nova:ports>
Nov 17 03:43:44 user nova-compute[74898]:     </nova:instance>
Nov 17 03:43:44 user nova-compute[74898]:   </metadata>
Nov 17 03:43:44 user nova-compute[74898]:   <sysinfo type="smbios">
Nov 17 03:43:44 user nova-compute[74898]:     <system>
Nov 17 03:43:44 user nova-compute[74898]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 03:43:44 user nova-compute[74898]:       <entry name="product">OpenStack Nova</entry>
Nov 17 03:43:44 user nova-compute[74898]:       <entry name="version">0.0.0</entry>
Nov 17 03:43:44 user nova-compute[74898]:       <entry name="serial">5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f</entry>
Nov 17 03:43:44 user nova-compute[74898]:       <entry name="uuid">5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f</entry>
Nov 17 03:43:44 user nova-compute[74898]:       <entry name="family">Virtual Machine</entry>
Nov 17 03:43:44 user nova-compute[74898]:     </system>
Nov 17 03:43:44 user nova-compute[74898]:   </sysinfo>
Nov 17 03:43:44 user nova-compute[74898]:   <os>
Nov 17 03:43:44 user nova-compute[74898]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 03:43:44 user nova-compute[74898]:     <boot dev="hd"/>
Nov 17 03:43:44 user nova-compute[74898]:     <smbios mode="sysinfo"/>
Nov 17 03:43:44 user nova-compute[74898]:   </os>
Nov 17 03:43:44 user nova-compute[74898]:   <features>
Nov 17 03:43:44 user nova-compute[74898]:     <acpi/>
Nov 17 03:43:44 user nova-compute[74898]:     <apic/>
Nov 17 03:43:44 user nova-compute[74898]:     <vmcoreinfo/>
Nov 17 03:43:44 user nova-compute[74898]:   </features>
Nov 17 03:43:44 user nova-compute[74898]:   <clock offset="utc">
Nov 17 03:43:44 user nova-compute[74898]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 03:43:44 user nova-compute[74898]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 03:43:44 user nova-compute[74898]:     <timer name="hpet" present="no"/>
Nov 17 03:43:44 user nova-compute[74898]:   </clock>
Nov 17 03:43:44 user nova-compute[74898]:   <cpu mode="custom" match="exact">
Nov 17 03:43:44 user nova-compute[74898]:     <model>Nehalem</model>
Nov 17 03:43:44 user nova-compute[74898]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 03:43:44 user nova-compute[74898]:   </cpu>
Nov 17 03:43:44 user nova-compute[74898]:   <devices>
Nov 17 03:43:44 user nova-compute[74898]:     <disk type="file" device="disk">
Nov 17 03:43:44 user nova-compute[74898]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 03:43:44 user nova-compute[74898]:       <source file="/opt/stack/data/nova/instances/5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f/disk"/>
Nov 17 03:43:44 user nova-compute[74898]:       <target dev="vda" bus="virtio"/>
Nov 17 03:43:44 user nova-compute[74898]:     </disk>
Nov 17 03:43:44 user nova-compute[74898]:     <interface type="ethernet">
Nov 17 03:43:44 user nova-compute[74898]:       <mac address="fa:16:3e:36:6f:7b"/>
Nov 17 03:43:44 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:43:44 user nova-compute[74898]:       <mtu size="1442"/>
Nov 17 03:43:44 user nova-compute[74898]:       <target dev="tap873806a3-0d"/>
Nov 17 03:43:44 user nova-compute[74898]:     </interface>
Nov 17 03:43:44 user nova-compute[74898]:     <serial type="pty">
Nov 17 03:43:44 user nova-compute[74898]:       <log file="/opt/stack/data/nova/instances/5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f/console.log" append="off"/>
Nov 17 03:43:44 user nova-compute[74898]:     </serial>
Nov 17 03:43:44 user nova-compute[74898]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 03:43:44 user nova-compute[74898]:     <video>
Nov 17 03:43:44 user nova-compute[74898]:       <model type="virtio"/>
Nov 17 03:43:44 user nova-compute[74898]:     </video>
Nov 17 03:43:44 user nova-compute[74898]:     <rng model="virtio">
Nov 17 03:43:44 user nova-compute[74898]:       <backend model="random">/dev/urandom</backend>
Nov 17 03:43:44 user nova-compute[74898]:     </rng>
Nov 17 03:43:44 user nova-compute[74898]:     <controller type="usb" index="0" model="none"/>
Nov 17 03:43:44 user nova-compute[74898]:     <memballoon model="virtio">
Nov 17 03:43:44 user nova-compute[74898]:       <stats period="10"/>
Nov 17 03:43:44 user nova-compute[74898]:     </memballoon>
Nov 17 03:43:44 user nova-compute[74898]:   </devices>
Nov 17 03:43:44 user nova-compute[74898]: </domain>
Nov 17 03:43:44 user nova-compute[74898]:  {{(pid=74898) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:43:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-980735849',display_name='tempest-VolumesNegativeTest-instance-980735849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-980735849',id=52,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18990239b15e4332b61a1b12368b4367',ramdisk_id='',reservation_id='r-e52qeaay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-599417508',owner_user_name='tempest-VolumesNegativeTest-599417508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T03:43:42Z,user_data=None,user_id='eddee5dc33cf4dc4b9a3af226828f865',uuid=5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "873806a3-0d15-41fc-888c-c187d8013038", "address": "fa:16:3e:36:6f:7b", "network": {"id": "fbbf3d72-284c-4441-b387-7a30aa359a27", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5a361ebc6bc544f29659720fc3a82e30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap873806a3-0d", "ovs_interfaceid": "873806a3-0d15-41fc-888c-c187d8013038", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Converting VIF {"id": "873806a3-0d15-41fc-888c-c187d8013038", "address": "fa:16:3e:36:6f:7b", "network": {"id": "fbbf3d72-284c-4441-b387-7a30aa359a27", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5a361ebc6bc544f29659720fc3a82e30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap873806a3-0d", "ovs_interfaceid": "873806a3-0d15-41fc-888c-c187d8013038", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:6f:7b,bridge_name='br-int',has_traffic_filtering=True,id=873806a3-0d15-41fc-888c-c187d8013038,network=Network(fbbf3d72-284c-4441-b387-7a30aa359a27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap873806a3-0d') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG os_vif [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:6f:7b,bridge_name='br-int',has_traffic_filtering=True,id=873806a3-0d15-41fc-888c-c187d8013038,network=Network(fbbf3d72-284c-4441-b387-7a30aa359a27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap873806a3-0d') {{(pid=74898) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ece1602-73a7-5eb8-a60e-1b88882ca8ce', '_type': 'linux-noop'}}, row=False) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap873806a3-0d, may_exist=True, interface_attrs={}) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap873806a3-0d, col_values=(('qos', UUID('975edc3b-4248-4e4f-95eb-a87817391b2d')),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap873806a3-0d, col_values=(('external_ids', {'iface-id': '873806a3-0d15-41fc-888c-c187d8013038', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:6f:7b', 'vm-uuid': '5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f'}),), if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:43:44 user nova-compute[74898]: INFO os_vif [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:6f:7b,bridge_name='br-int',has_traffic_filtering=True,id=873806a3-0d15-41fc-888c-c187d8013038,network=Network(fbbf3d72-284c-4441-b387-7a30aa359a27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap873806a3-0d')
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] No BDM found with device name vda, not building metadata. {{(pid=74898) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] No VIF found with MAC fa:16:3e:36:6f:7b, not building metadata {{(pid=74898) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.network.neutron [req-b1c2b17b-1e20-46b5-b12f-a9f0f3781604 req-98dea7cb-52f3-4285-929b-6be9ce119000 service nova] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Updated VIF entry in instance network info cache for port 873806a3-0d15-41fc-888c-c187d8013038. {{(pid=74898) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG nova.network.neutron [req-b1c2b17b-1e20-46b5-b12f-a9f0f3781604 req-98dea7cb-52f3-4285-929b-6be9ce119000 service nova] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Updating instance_info_cache with network_info: [{"id": "873806a3-0d15-41fc-888c-c187d8013038", "address": "fa:16:3e:36:6f:7b", "network": {"id": "fbbf3d72-284c-4441-b387-7a30aa359a27", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5a361ebc6bc544f29659720fc3a82e30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap873806a3-0d", "ovs_interfaceid": "873806a3-0d15-41fc-888c-c187d8013038", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:43:44 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-b1c2b17b-1e20-46b5-b12f-a9f0f3781604 req-98dea7cb-52f3-4285-929b-6be9ce119000 service nova] Releasing lock "refresh_cache-5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:43:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:43:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:43:45 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:43:46 user nova-compute[74898]: DEBUG nova.compute.manager [req-387ebda3-02ee-46b6-b160-148019e8db54 req-418a17cd-5ac7-4016-a9ea-e5900dd6914c service nova] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Received event network-vif-plugged-873806a3-0d15-41fc-888c-c187d8013038 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:43:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-387ebda3-02ee-46b6-b160-148019e8db54 req-418a17cd-5ac7-4016-a9ea-e5900dd6914c service nova] Acquiring lock "5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:43:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-387ebda3-02ee-46b6-b160-148019e8db54 req-418a17cd-5ac7-4016-a9ea-e5900dd6914c service nova] Lock "5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:43:46 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-387ebda3-02ee-46b6-b160-148019e8db54 req-418a17cd-5ac7-4016-a9ea-e5900dd6914c service nova] Lock "5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:43:46 user nova-compute[74898]: DEBUG nova.compute.manager [req-387ebda3-02ee-46b6-b160-148019e8db54 req-418a17cd-5ac7-4016-a9ea-e5900dd6914c service nova] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] No waiting events found dispatching network-vif-plugged-873806a3-0d15-41fc-888c-c187d8013038 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:43:46 user nova-compute[74898]: WARNING nova.compute.manager [req-387ebda3-02ee-46b6-b160-148019e8db54 req-418a17cd-5ac7-4016-a9ea-e5900dd6914c service nova] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Received unexpected event network-vif-plugged-873806a3-0d15-41fc-888c-c187d8013038 for instance with vm_state building and task_state spawning.
Nov 17 03:43:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:43:46 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:43:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:43:48 user nova-compute[74898]: DEBUG nova.compute.manager [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Instance event wait completed in 0 seconds for  {{(pid=74898) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 03:43:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Guest created on hypervisor {{(pid=74898) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 03:43:48 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Instance spawned successfully.
Nov 17 03:43:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 03:43:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Found default for hw_cdrom_bus of ide {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:43:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Found default for hw_disk_bus of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:43:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Found default for hw_input_bus of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:43:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Found default for hw_pointer_model of None {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:43:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Found default for hw_video_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:43:48 user nova-compute[74898]: DEBUG nova.virt.libvirt.driver [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Found default for hw_vif_model of virtio {{(pid=74898) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 03:43:48 user nova-compute[74898]: INFO nova.compute.manager [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Took 5.83 seconds to spawn the instance on the hypervisor.
Nov 17 03:43:48 user nova-compute[74898]: DEBUG nova.compute.manager [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Checking state {{(pid=74898) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 03:43:48 user nova-compute[74898]: DEBUG nova.compute.manager [req-371a737d-cae4-4030-b3ac-0da1dce7a4b6 req-ec9246e4-1a00-4a1b-86b7-6e280d3b5cfd service nova] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Received event network-vif-plugged-873806a3-0d15-41fc-888c-c187d8013038 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:43:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-371a737d-cae4-4030-b3ac-0da1dce7a4b6 req-ec9246e4-1a00-4a1b-86b7-6e280d3b5cfd service nova] Acquiring lock "5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:43:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-371a737d-cae4-4030-b3ac-0da1dce7a4b6 req-ec9246e4-1a00-4a1b-86b7-6e280d3b5cfd service nova] Lock "5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:43:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-371a737d-cae4-4030-b3ac-0da1dce7a4b6 req-ec9246e4-1a00-4a1b-86b7-6e280d3b5cfd service nova] Lock "5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:43:48 user nova-compute[74898]: DEBUG nova.compute.manager [req-371a737d-cae4-4030-b3ac-0da1dce7a4b6 req-ec9246e4-1a00-4a1b-86b7-6e280d3b5cfd service nova] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] No waiting events found dispatching network-vif-plugged-873806a3-0d15-41fc-888c-c187d8013038 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:43:48 user nova-compute[74898]: WARNING nova.compute.manager [req-371a737d-cae4-4030-b3ac-0da1dce7a4b6 req-ec9246e4-1a00-4a1b-86b7-6e280d3b5cfd service nova] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Received unexpected event network-vif-plugged-873806a3-0d15-41fc-888c-c187d8013038 for instance with vm_state building and task_state spawning.
Nov 17 03:43:48 user nova-compute[74898]: INFO nova.compute.manager [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Took 6.44 seconds to build instance.
Nov 17 03:43:48 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-2bfebcc0-1fd1-4529-8076-820c8b018b87 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Lock "5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.538s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:43:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:43:49 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:43:49 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:43:51 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:43:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:43:52 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:43:53 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:43:53 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:43:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:43:58 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:43:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:43:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:43:58 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:43:58 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:43:58 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:43:59 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:43:59 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:43:59 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:43:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:43:59 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:43:59 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:43:59 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=9014MB free_disk=25.231433868408203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:43:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:43:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:43:59 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:43:59 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:43:59 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:43:59 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:43:59 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:43:59 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:43:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.292s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:44:00 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:44:00 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:44:00 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:44:00 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Rebuilding the list of instances to heal {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 03:44:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:44:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:44:01 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:44:01 user nova-compute[74898]: DEBUG nova.objects.instance [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lazy-loading 'info_cache' on Instance uuid 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:44:01 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Updating instance_info_cache with network_info: [{"id": "873806a3-0d15-41fc-888c-c187d8013038", "address": "fa:16:3e:36:6f:7b", "network": {"id": "fbbf3d72-284c-4441-b387-7a30aa359a27", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5a361ebc6bc544f29659720fc3a82e30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap873806a3-0d", "ovs_interfaceid": "873806a3-0d15-41fc-888c-c187d8013038", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:44:01 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:44:01 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:44:02 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:44:02 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:44:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:44:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:44:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:44:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:44:14 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:44:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:44:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:44:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:44:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:44:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:44:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:44:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:44:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:44:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:44:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:44:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:44:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:44:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:44:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:44:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:44:34 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:44:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:44:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:44:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:44:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:44:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:44:39 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:44:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:44:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:44:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:44:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:44:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:44:44 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:44:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:44:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:44:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:44:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:44:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:44:49 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:44:50 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:44:50 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:44:51 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:44:52 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:44:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:44:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:44:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:44:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:44:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:44:54 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:44:55 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:44:55 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:44:59 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:44:59 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:44:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:44:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:44:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:44:59 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:44:59 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:45:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:45:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f/disk --force-share --output=json {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 03:45:00 user nova-compute[74898]: DEBUG oslo_concurrency.processutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74898) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 03:45:00 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:45:00 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:45:00 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=9014MB free_disk=25.20306396484375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:45:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:45:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:45:00 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Instance 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74898) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 03:45:00 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:45:00 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:45:00 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:45:00 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:45:00 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:45:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:45:02 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:45:02 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:45:02 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:45:02 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Rebuilding the list of instances to heal {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 03:45:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "refresh_cache-5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 03:45:02 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquired lock "refresh_cache-5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 03:45:02 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Forcefully refreshing network info cache for instance {{(pid=74898) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 03:45:02 user nova-compute[74898]: DEBUG nova.objects.instance [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lazy-loading 'info_cache' on Instance uuid 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:45:03 user nova-compute[74898]: DEBUG nova.network.neutron [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Updating instance_info_cache with network_info: [{"id": "873806a3-0d15-41fc-888c-c187d8013038", "address": "fa:16:3e:36:6f:7b", "network": {"id": "fbbf3d72-284c-4441-b387-7a30aa359a27", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5a361ebc6bc544f29659720fc3a82e30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap873806a3-0d", "ovs_interfaceid": "873806a3-0d15-41fc-888c-c187d8013038", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:45:03 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Releasing lock "refresh_cache-5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f" {{(pid=74898) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 03:45:03 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Updated the network info_cache for instance {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 03:45:03 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:45:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:45:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:45:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:45:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:45:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:45:04 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:45:09 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:45:14 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:45:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:45:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:45:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:45:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:45:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:45:19 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:45:24 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:45:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:45:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:45:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:45:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:45:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:45:29 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:45:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3e50f9b3-8585-41fa-80db-890fc74b9691 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Acquiring lock "5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:45:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3e50f9b3-8585-41fa-80db-890fc74b9691 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Lock "5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:45:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3e50f9b3-8585-41fa-80db-890fc74b9691 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Acquiring lock "5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:45:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3e50f9b3-8585-41fa-80db-890fc74b9691 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Lock "5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:45:31 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3e50f9b3-8585-41fa-80db-890fc74b9691 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Lock "5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:45:31 user nova-compute[74898]: INFO nova.compute.manager [None req-3e50f9b3-8585-41fa-80db-890fc74b9691 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Terminating instance
Nov 17 03:45:31 user nova-compute[74898]: DEBUG nova.compute.manager [None req-3e50f9b3-8585-41fa-80db-890fc74b9691 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Start destroying the instance on the hypervisor. {{(pid=74898) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 03:45:31 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:45:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:45:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:45:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:45:32 user nova-compute[74898]: DEBUG nova.compute.manager [req-da560d6a-095a-4b01-8615-1c69e4e1d149 req-f2e77f6e-4315-48f3-9dd1-7d0dcbfa055f service nova] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Received event network-vif-unplugged-873806a3-0d15-41fc-888c-c187d8013038 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:45:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-da560d6a-095a-4b01-8615-1c69e4e1d149 req-f2e77f6e-4315-48f3-9dd1-7d0dcbfa055f service nova] Acquiring lock "5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:45:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-da560d6a-095a-4b01-8615-1c69e4e1d149 req-f2e77f6e-4315-48f3-9dd1-7d0dcbfa055f service nova] Lock "5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:45:32 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-da560d6a-095a-4b01-8615-1c69e4e1d149 req-f2e77f6e-4315-48f3-9dd1-7d0dcbfa055f service nova] Lock "5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:45:32 user nova-compute[74898]: DEBUG nova.compute.manager [req-da560d6a-095a-4b01-8615-1c69e4e1d149 req-f2e77f6e-4315-48f3-9dd1-7d0dcbfa055f service nova] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] No waiting events found dispatching network-vif-unplugged-873806a3-0d15-41fc-888c-c187d8013038 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:45:32 user nova-compute[74898]: DEBUG nova.compute.manager [req-da560d6a-095a-4b01-8615-1c69e4e1d149 req-f2e77f6e-4315-48f3-9dd1-7d0dcbfa055f service nova] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Received event network-vif-unplugged-873806a3-0d15-41fc-888c-c187d8013038 for instance with task_state deleting. {{(pid=74898) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 03:45:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:45:32 user nova-compute[74898]: INFO nova.virt.libvirt.driver [-] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Instance destroyed successfully.
Nov 17 03:45:32 user nova-compute[74898]: DEBUG nova.objects.instance [None req-3e50f9b3-8585-41fa-80db-890fc74b9691 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Lazy-loading 'resources' on Instance uuid 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f {{(pid=74898) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 03:45:32 user nova-compute[74898]: DEBUG nova.virt.libvirt.vif [None req-3e50f9b3-8585-41fa-80db-890fc74b9691 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T03:43:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-980735849',display_name='tempest-VolumesNegativeTest-instance-980735849',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-980735849',id=52,image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T03:43:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18990239b15e4332b61a1b12368b4367',ramdisk_id='',reservation_id='r-e52qeaay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='50e5d43b-62d6-4f28-a52e-a1c6b84eb51f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-599417508',owner_user_name='tempest-VolumesNegativeTest-599417508-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T03:43:48Z,user_data=None,user_id='eddee5dc33cf4dc4b9a3af226828f865',uuid=5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "873806a3-0d15-41fc-888c-c187d8013038", "address": "fa:16:3e:36:6f:7b", "network": {"id": "fbbf3d72-284c-4441-b387-7a30aa359a27", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5a361ebc6bc544f29659720fc3a82e30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap873806a3-0d", "ovs_interfaceid": "873806a3-0d15-41fc-888c-c187d8013038", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 03:45:32 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3e50f9b3-8585-41fa-80db-890fc74b9691 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Converting VIF {"id": "873806a3-0d15-41fc-888c-c187d8013038", "address": "fa:16:3e:36:6f:7b", "network": {"id": "fbbf3d72-284c-4441-b387-7a30aa359a27", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5a361ebc6bc544f29659720fc3a82e30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap873806a3-0d", "ovs_interfaceid": "873806a3-0d15-41fc-888c-c187d8013038", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 03:45:32 user nova-compute[74898]: DEBUG nova.network.os_vif_util [None req-3e50f9b3-8585-41fa-80db-890fc74b9691 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:6f:7b,bridge_name='br-int',has_traffic_filtering=True,id=873806a3-0d15-41fc-888c-c187d8013038,network=Network(fbbf3d72-284c-4441-b387-7a30aa359a27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap873806a3-0d') {{(pid=74898) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 03:45:32 user nova-compute[74898]: DEBUG os_vif [None req-3e50f9b3-8585-41fa-80db-890fc74b9691 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:6f:7b,bridge_name='br-int',has_traffic_filtering=True,id=873806a3-0d15-41fc-888c-c187d8013038,network=Network(fbbf3d72-284c-4441-b387-7a30aa359a27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap873806a3-0d') {{(pid=74898) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 03:45:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:45:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap873806a3-0d, bridge=br-int, if_exists=True) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:45:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:45:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:45:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:45:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=975edc3b-4248-4e4f-95eb-a87817391b2d) {{(pid=74898) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 03:45:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:45:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:45:32 user nova-compute[74898]: INFO os_vif [None req-3e50f9b3-8585-41fa-80db-890fc74b9691 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:6f:7b,bridge_name='br-int',has_traffic_filtering=True,id=873806a3-0d15-41fc-888c-c187d8013038,network=Network(fbbf3d72-284c-4441-b387-7a30aa359a27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap873806a3-0d')
Nov 17 03:45:32 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-3e50f9b3-8585-41fa-80db-890fc74b9691 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Deleting instance files /opt/stack/data/nova/instances/5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f_del
Nov 17 03:45:32 user nova-compute[74898]: INFO nova.virt.libvirt.driver [None req-3e50f9b3-8585-41fa-80db-890fc74b9691 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Deletion of /opt/stack/data/nova/instances/5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f_del complete
Nov 17 03:45:32 user nova-compute[74898]: INFO nova.compute.manager [None req-3e50f9b3-8585-41fa-80db-890fc74b9691 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 17 03:45:32 user nova-compute[74898]: DEBUG oslo.service.loopingcall [None req-3e50f9b3-8585-41fa-80db-890fc74b9691 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74898) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 03:45:32 user nova-compute[74898]: DEBUG nova.compute.manager [-] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Deallocating network for instance {{(pid=74898) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 03:45:32 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] deallocate_for_instance() {{(pid=74898) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 03:45:32 user nova-compute[74898]: DEBUG nova.network.neutron [-] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:45:33 user nova-compute[74898]: INFO nova.compute.manager [-] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Took 0.40 seconds to deallocate network for instance.
Nov 17 03:45:33 user nova-compute[74898]: DEBUG nova.compute.manager [req-9381015d-1d34-45f2-86c1-caf9bec669f6 req-a525c125-b791-48e4-9570-271daf5003ef service nova] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Received event network-vif-deleted-873806a3-0d15-41fc-888c-c187d8013038 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:45:33 user nova-compute[74898]: INFO nova.compute.manager [req-9381015d-1d34-45f2-86c1-caf9bec669f6 req-a525c125-b791-48e4-9570-271daf5003ef service nova] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Neutron deleted interface 873806a3-0d15-41fc-888c-c187d8013038; detaching it from the instance and deleting it from the info cache
Nov 17 03:45:33 user nova-compute[74898]: DEBUG nova.network.neutron [req-9381015d-1d34-45f2-86c1-caf9bec669f6 req-a525c125-b791-48e4-9570-271daf5003ef service nova] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Updating instance_info_cache with network_info: [] {{(pid=74898) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 03:45:33 user nova-compute[74898]: DEBUG nova.compute.manager [req-9381015d-1d34-45f2-86c1-caf9bec669f6 req-a525c125-b791-48e4-9570-271daf5003ef service nova] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Detach interface failed, port_id=873806a3-0d15-41fc-888c-c187d8013038, reason: Instance 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f could not be found. {{(pid=74898) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 03:45:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3e50f9b3-8585-41fa-80db-890fc74b9691 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:45:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3e50f9b3-8585-41fa-80db-890fc74b9691 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:45:33 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-3e50f9b3-8585-41fa-80db-890fc74b9691 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:45:33 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-3e50f9b3-8585-41fa-80db-890fc74b9691 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:45:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3e50f9b3-8585-41fa-80db-890fc74b9691 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:45:33 user nova-compute[74898]: INFO nova.scheduler.client.report [None req-3e50f9b3-8585-41fa-80db-890fc74b9691 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Deleted allocations for instance 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f
Nov 17 03:45:33 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-3e50f9b3-8585-41fa-80db-890fc74b9691 tempest-VolumesNegativeTest-599417508 tempest-VolumesNegativeTest-599417508-project-member] Lock "5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.366s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:45:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-f6721ffe-f577-4617-8a0a-d09b99224d20 req-d662a226-d457-4172-9556-268a535865ab service nova] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Received event network-vif-plugged-873806a3-0d15-41fc-888c-c187d8013038 {{(pid=74898) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 03:45:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f6721ffe-f577-4617-8a0a-d09b99224d20 req-d662a226-d457-4172-9556-268a535865ab service nova] Acquiring lock "5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:45:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f6721ffe-f577-4617-8a0a-d09b99224d20 req-d662a226-d457-4172-9556-268a535865ab service nova] Lock "5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:45:34 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [req-f6721ffe-f577-4617-8a0a-d09b99224d20 req-d662a226-d457-4172-9556-268a535865ab service nova] Lock "5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:45:34 user nova-compute[74898]: DEBUG nova.compute.manager [req-f6721ffe-f577-4617-8a0a-d09b99224d20 req-d662a226-d457-4172-9556-268a535865ab service nova] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] No waiting events found dispatching network-vif-plugged-873806a3-0d15-41fc-888c-c187d8013038 {{(pid=74898) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 03:45:34 user nova-compute[74898]: WARNING nova.compute.manager [req-f6721ffe-f577-4617-8a0a-d09b99224d20 req-d662a226-d457-4172-9556-268a535865ab service nova] [instance: 5a9ca3b3-67aa-4676-a7a3-40ddfb0a082f] Received unexpected event network-vif-plugged-873806a3-0d15-41fc-888c-c187d8013038 for instance with vm_state deleted and task_state None.
Nov 17 03:45:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:45:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:45:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:45:50 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:45:50 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:45:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:45:52 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:45:54 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:45:57 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:45:57 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:45:57 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:45:59 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:45:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:45:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:45:59 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:45:59 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Auditing locally available compute resources for user (node: user) {{(pid=74898) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 03:46:00 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:46:00 user nova-compute[74898]: WARNING nova.virt.libvirt.driver [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 03:46:00 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Hypervisor/Node resource view: name=user free_ram=9153MB free_disk=25.23031234741211GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74898) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 03:46:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 03:46:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 03:46:00 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 03:46:00 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74898) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 03:46:00 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Refreshing inventories for resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 17 03:46:00 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Updating ProviderTree inventory for provider b743bdc9-a8bb-467c-98c8-06f1954f87df from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 17 03:46:00 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Updating inventory in ProviderTree for provider b743bdc9-a8bb-467c-98c8-06f1954f87df with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 17 03:46:00 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Refreshing aggregate associations for resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df, aggregates: None {{(pid=74898) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 17 03:46:00 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Refreshing trait associations for resource provider b743bdc9-a8bb-467c-98c8-06f1954f87df, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA {{(pid=74898) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 17 03:46:00 user nova-compute[74898]: DEBUG nova.compute.provider_tree [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed in ProviderTree for provider: b743bdc9-a8bb-467c-98c8-06f1954f87df {{(pid=74898) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 03:46:00 user nova-compute[74898]: DEBUG nova.scheduler.client.report [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Inventory has not changed for provider b743bdc9-a8bb-467c-98c8-06f1954f87df based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74898) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 03:46:00 user nova-compute[74898]: DEBUG nova.compute.resource_tracker [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Compute_service record updated for user:user {{(pid=74898) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 03:46:00 user nova-compute[74898]: DEBUG oslo_concurrency.lockutils [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.446s {{(pid=74898) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 03:46:00 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:46:00 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Cleaning up deleted instances {{(pid=74898) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 17 03:46:00 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] There are 0 instances to clean {{(pid=74898) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 17 03:46:02 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:46:04 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:46:04 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:46:04 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Starting heal instance info cache {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 03:46:04 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Rebuilding the list of instances to heal {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 03:46:04 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Didn't find any instances for network info cache update. {{(pid=74898) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 17 03:46:04 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:46:04 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:46:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:46:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:46:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:46:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:46:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:46:07 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:46:12 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:46:13 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:46:13 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Cleaning up deleted instances with incomplete migration  {{(pid=74898) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 17 03:46:17 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:46:19 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:46:22 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:46:27 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:46:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:46:32 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:46:37 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:46:42 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:46:47 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:46:50 user nova-compute[74898]: DEBUG oslo_service.periodic_task [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74898) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 03:46:50 user nova-compute[74898]: DEBUG nova.compute.manager [None req-e191c2e4-758a-41d9-bef0-218c0542473c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74898) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 03:46:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 03:46:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 03:46:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74898) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 03:46:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:46:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74898) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 03:46:52 user nova-compute[74898]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74898) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}